00000001:02000400:0.0F:1789708476.699600:0:3291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_hostid 00000001:02000400:0.0:1789708484.087888:0:3493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1789708484.974549:0:3555:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1503 MB/s 00000001:01000000:0.0:1789708485.224532:0:3555:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1683 MB/s 00000001:01000000:0.0:1789708485.474315:0:3555:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 11703 MB/s 00000020:02000000:1.0F:1789708485.730715:0:3584:0:(class_obd.c:777:obdclass_init()) Lustre: Build Version: 2.17.58_39_g8752880 00000400:02000000:2.0F:1789708486.073331:0:3599:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.152@tcp [8/256/0/180] 00008000:02000000:3.0F:1789708488.247345:0:3749:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789708506.640040:0:5712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789708510.781425:0:6461:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789708510.781431:0:6461:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789708510.781432:0:6461:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789708510.781582:0:6461:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002abc9828 00000080:02000400:3.0:1789708510.781592:0:6461:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789708510.785878:0:6461:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789708510.785890:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789708510.785914:0:6461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000045fb6829) 00000020:00000080:3.0:1789708510.785929:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789708510.802166:0:6461:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789708510.802236:0:6461:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1789708510.812460:0:6461:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789708510.812647:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789708510.812654:0:6461:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789708510.812663:0:6461:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47c807 00000020:01000004:3.0:1789708510.812669:0:6461:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789708510.812673:0:6461:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789708510.812677:0:6461:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002abc9828 from MGS 00000020:01000004:3.0:1789708510.812682:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789708510.812689:0:6461:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f30456f1) 00000020:00000080:3.0:1789708510.812697:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789708510.812759:0:6461:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002abc9828 from MGS, refs=2 00080000:01000000:3.0:1789708510.812763:0:6461:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789708510.812767:0:6461:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47c815 00000100:00100000:3.0:1789708510.812868:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789708510.812990:0:6461:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789708510.812995:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789708510.813252:0:6461:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789708510.813306:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789708510.814056:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789708510.814173:0:6461:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789708510.814178:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789708510.814536:0:6461:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789708510.814548:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789708510.814743:0:6461:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789708510.814748:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789708510.815086:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708510.815089:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708510.815090:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708510.815234:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708510.815236:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708510.815237:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708510.815861:0:6461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789708510.817376:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789708511.065337:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 7179 MB/s 00000001:01000000:3.0:1789708511.315352:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 8319 MB/s 00000001:01000000:3.0:1789708511.565410:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1623 MB/s 00000001:01000000:3.0:1789708511.815812:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 2000 MB/s 00080000:10000000:3.0:1789708511.818482:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1789708511.824412:0:6461:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789708511.824900:0:6475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789708511.824916:0:6461:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789708511.824959:0:6461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789708511.825120:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789708511.825155:0:6461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789708511.825914:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708511.826066:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789708511.826073:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789708511.826510:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789708511.826518:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789708511.826734:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789708511.826741:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1789708511.827107:0:6480:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1789708511.827131:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789708511.827156:0:6461:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.152@tcp' 00000020:01000004:2.0:1789708511.827158:0:6461:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789708511.827210:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.152@tcp (typ=mgc) 00000020:00000080:2.0:1789708511.827230:0:6461:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.152@tcp (00000000a9dd0fd1) 00000020:00000080:2.0:1789708511.827247:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789708511.827386:0:6461:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000593cc882@MGC192.168.201.152@tcp: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1789708511.827611:0:6461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.152@tcp-0 is initialized 00000040:01000000:2.0:1789708511.827618:0:6461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789708511.828058:0:6481:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789708511.828124:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.152@tcp (uuid 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5) 00000020:00000080:2.0:1789708511.828138:0:6461:0:(genops.c:1384:class_connect()) connect: client 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5, cookie 0xf45f43947e47c823 00000100:00080000:2.0:1789708511.828144:0:6461:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708511.828149:0:6461:0:(import.c:666:import_select_connection()) MGC192.168.201.152@tcp: import 00000000593cc882 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708511.828182:0:6461:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e56cc7c0 x1876645365416064/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708511.828199:0:6461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS 00000020:01000004:2.0:1789708511.828215:0:6461:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789708511.828218:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789708511.828225:0:6461:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000884a7043) 00000020:00000080:2.0:1789708511.828240:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789708511.828303:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e56cc7c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3614:1876645365416064:0@lo:250: 00000100:00100000:3.0:1789708511.828372:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708511.828413:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365416064 00000100:00100000:2.0:1789708511.828427:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365416064 00000100:00100000:2.0:1789708511.828456:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708511.828462:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006864785d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3614:x1876645365416064:12345-0@lo:250: 00010000:00080000:2.0:1789708511.828482:0:6477:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5@0@lo t0 exp 0000000000000000 cur 82 last 0 00000020:00000080:2.0:1789708511.828506:0:6477:0:(genops.c:1384:class_connect()) connect: client 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5, cookie 0xf45f43947e47c831 00000100:00080000:2.0:1789708511.828644:0:6477:0:(import.c:65:import_set_state_nolock()) 00000000ba8215f1 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708511.828703:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006864785d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+5:3614:x1876645365416064:12345-0@lo:250: Request processed in 241us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708511.828709:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708511.828714:0:3614:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789708511.828721:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.152@tcp: connect to target with instance 0 00000100:00080000:3.0:1789708511.828726:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789708511.828729:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789708511.828732:0:3614:0:(import.c:65:import_set_state_nolock()) 00000000593cc882 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789708511.828734:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789708511.828739:0:3614:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789708511.828742:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e56cc7c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3614:1876645365416064:0@lo:250: 00000100:00100000:2.0:1789708511.838996:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708511.839187:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789708511.839192:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789708511.839770:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789708511.839778:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789708511.840072:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789708511.840078:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789708511.841084:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708511.841228:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789708511.841233:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789708511.841640:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789708511.841647:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:2.0:1789708511.846526:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708511.885246:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708511.885461:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789708511.885467:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789708511.886717:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789708511.886722:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789708511.887181:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708511.887297:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789708511.887301:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789708511.887563:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789708511.887571:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789708511.888080:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708511.888181:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789708511.888185:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789708511.888514:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789708511.888518:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789708511.888957:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708511.889030:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789708511.889033:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789708511.889281:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789708511.889286:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789708511.909131:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708511.909308:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789708511.909314:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789708511.910479:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789708511.910484:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789708511.911384:0:6461:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789708511.911388:0:6461:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789708511.912323:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789708511.912344:0:6461:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789708511.912350:0:6461:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789708511.912428:0:6461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789708511.912454:0:6461:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789708511.912457:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789708511.912458:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789708511.912459:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708511.912462:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708511.912463:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708511.912464:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708511.912465:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708511.912466:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789708511.912466:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708511.912467:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708511.912468:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708511.912469:0:6461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789708511.912470:0:6461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789708511.912472:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708511.912472:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789708511.912473:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708511.912473:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708511.912474:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708511.912474:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708511.912475:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708511.912475:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789708511.912476:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708511.912476:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708511.912477:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708511.912478:0:6461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789708511.912507:0:6461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789708511.912518:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416192:0@lo:253: 00000100:00100000:1.0:1789708511.912571:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708511.912605:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365416192 00000100:00100000:2.0:1789708511.912613:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365416192 00000100:00100000:1.0:1789708511.912613:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044291625 going to sleep for 11 seconds 00000100:00100000:2.0:1789708511.912651:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708511.912658:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000070ead38b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+5:6461:x1876645365416192:12345-0@lo:253: 20000000:01000000:2.0:1789708511.912705:0:6479:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789708511.912707:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789708511.912878:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789708511.912911:0:6479:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789708511.913176:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708511.913676:0:6500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789708511.913751:0:6479:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789708511.913754:0:6479:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789708511.913757:0:6479:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789708511.913760:0:6479:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789708511.913767:0:6479:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789708511.913840:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708511.913989:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789708511.914002:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789708511.914019:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789708511.914034:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789708511.914043:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789708511.914084:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789708511.914089:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789708511.914096:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789708511.914099:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789708511.914105:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789708511.914108:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789708511.914114:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789708511.914121:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789708511.914145:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789708511.914151:0:6479:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789708511.914159:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708511.914245:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789708511.914254:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789708511.914303:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789708511.914317:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789708511.914326:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789708511.914335:0:6479:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789708511.914366:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789708511.914372:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789708511.914379:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789708511.914387:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789708511.914394:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789708511.914402:0:6479:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789708511.914422:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789708511.914427:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789708511.914434:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789708511.914447:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789708511.914521:0:6479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789708511.914550:0:6479:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789708511.914556:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789708511.914761:0:6501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789708511.914875:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789708511.914893:0:6479:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.152@tcp for mdt 20000000:01000000:3.0:1789708511.914896:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:3.0:1789708511.914920:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789708511.914927:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789708511.914939:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789708511.914945:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:3.0:1789708511.914958:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789708511.914965:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789708511.914977:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789708511.914993:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789708511.915038:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789708511.915042:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789708511.915045:0:6479:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789708511.915085:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789708511.915087:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789708511.915327:0:6502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789708511.915411:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789708511.915423:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789708511.915430:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1789708511.915438:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789708511.915440:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789708511.915625:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789708511.915715:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789708511.915745:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789708511.915763:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1789708511.915776:0:6479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789708511.915778:0:6479:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789708511.915781:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789708511.915783:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789708511.915787:0:6479:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789708511.915791:0:6479:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789708511.915965:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789708511.916018:0:6479:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789708511.919112:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789708511.919130:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789708511.919138:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789708511.919153:0:6479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789708511.919170:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.919181:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.919188:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.919192:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.919195:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.919199:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.919207:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000be4f7307 already unused, calling callback (0000000020c8a59f) 00010000:00010000:2.0:1789708511.919209:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.919214:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.919223:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.919229:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.919234:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000be4f7307/0xf45f43947e47c838 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789708511.919250:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789708511.923050:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000070ead38b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+5:6461:x1876645365416192:12345-0@lo:253: Request processed in 10386us (10472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708511.923066:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708511.923084:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416192:0@lo:253: 10000000:01000000:1.0:1789708511.923098:0:6461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789708511.923100:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789708511.923102:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789708511.923103:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708511.923104:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789708511.923105:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708511.923107:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708511.923108:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708511.923109:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789708511.923111:0:6461:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789708511.923112:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708511.923120:0:6461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789708511.923145:0:6461:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002abc9828 from lustre-MDT0000 10000000:01000000:1.0:1789708511.923173:0:6461:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789708511.923175:0:6461:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789708511.923179:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bee18160000 10000000:01000000:1.0:1789708511.923181:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789708511.923187:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bee18160000 from 1 10000000:01000000:1.0:1789708511.923189:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789708511.923213:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.923220:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.923227:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708511.923243:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416320:0@lo:101: 00000100:00100000:1.0:1789708511.923302:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708511.923321:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365416320 00000100:00100000:2.0:1789708511.923328:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365416320 00000100:00100000:1.0:1789708511.923339:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e98d4e3c going to sleep for 11 seconds 00000100:00100000:2.0:1789708511.923369:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708511.923378:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009723e03f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+5:6461:x1876645365416320:12345-0@lo:101: 00010000:00010000:2.0:1789708511.923390:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708511.923401:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c948378e/0xf45f43947e47c846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c83f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.923421:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c948378e/0xf45f43947e47c846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c83f expref: 6 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.923437:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c948378e/0xf45f43947e47c846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c83f expref: 6 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.923445:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c948378e, rc 0) 00000100:00100000:2.0:1789708511.923478:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009723e03f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+6:6461:x1876645365416320:12345-0@lo:101: Request processed in 102us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708511.923485:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708511.923502:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416320:0@lo:101: 00010000:00010000:1.0:1789708511.923515:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.923522:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708511.923577:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416448:0@lo:501: 00000100:00100000:1.0:1789708511.923604:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708511.923622:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e98d4e3c going to sleep for 11 seconds 00000100:00100000:2.0:1789708511.923638:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365416448 00000100:00100000:2.0:1789708511.923652:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365416448 00000100:00100000:2.0:1789708511.923680:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708511.923685:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce67e9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+6:6461:x1876645365416448:12345-0@lo:501: 00000100:00100000:2.0:1789708511.923749:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce67e9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+6:6461:x1876645365416448:12345-0@lo:501: Request processed in 64us (145us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708511.923757:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708511.923774:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416448:0@lo:501: 10000000:01000000:1.0:1789708511.923798:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789708511.923810:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.923815:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708511.923818:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bee02bf3800 10000000:01000000:1.0:1789708511.923821:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789708511.923823:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bee02bf3800 10000000:01000000:1.0:1789708511.923825:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789708511.923826:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bee02bf3800 from 1 10000000:01000000:1.0:1789708511.923828:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789708511.923837:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000cf6abec2/0xf45f43947e47c84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.923840:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000cf6abec2/0xf45f43947e47c84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.923844:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000cf6abec2/0xf45f43947e47c84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708511.923850:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416576:0@lo:101: 00000100:00100000:1.0:1789708511.923866:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708511.923876:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e98d4e3c going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.923894:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365416576 00000100:00100000:3.0:1789708511.923899:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365416576 00000100:00100000:3.0:1789708511.923925:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708511.923931:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c49e2f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+6:6461:x1876645365416576:12345-0@lo:101: 00010000:00010000:3.0:1789708511.923939:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708511.923954:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087f8eaae/0xf45f43947e47c854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c84d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.923969:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087f8eaae/0xf45f43947e47c854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c84d expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.923975:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087f8eaae/0xf45f43947e47c854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c84d expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.923979:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087f8eaae, rc 0) 00000100:00100000:3.0:1789708511.924004:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c49e2f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+7:6461:x1876645365416576:12345-0@lo:101: Request processed in 74us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.924009:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708511.924030:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416576:0@lo:101: 00010000:00010000:1.0:1789708511.924038:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000cf6abec2/0xf45f43947e47c84d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.924053:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000cf6abec2/0xf45f43947e47c84d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708511.924062:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789708511.924071:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000cf6abec2/0xf45f43947e47c84d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.924076:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000cf6abec2/0xf45f43947e47c84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708511.924081:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789708511.924084:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789708511.924088:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bee02bf3800 10000000:01000000:1.0:1789708511.924090:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789708511.924092:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789708511.924093:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789708511.924103:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.924109:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.924113:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708511.924122:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416704:0@lo:101: 00000100:00100000:1.0:1789708511.924143:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708511.924157:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e98d4e3c going to sleep for 11 seconds 00000100:00100000:2.0:1789708511.924181:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365416704 00000100:00100000:2.0:1789708511.924186:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365416704 00000100:00100000:2.0:1789708511.924211:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789708511.924217:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae521a49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+7:6461:x1876645365416704:12345-0@lo:101: 00010000:00010000:2.0:1789708511.924224:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708511.924231:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c85b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.924245:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c85b expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.924252:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c85b expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.924302:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000078e9cc5c, rc 0) 00000100:00100000:2.0:1789708511.924333:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae521a49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+8:6461:x1876645365416704:12345-0@lo:101: Request processed in 116us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708511.924339:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708511.924359:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416704:0@lo:101: 00010000:00010000:1.0:1789708511.924369:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.924375:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708511.924407:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416832:0@lo:501: 00000100:00100000:1.0:1789708511.924427:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708511.924452:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365416832 00000100:00100000:1.0:1789708511.924453:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e98d4e3c going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.924457:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365416832 00000100:00100000:3.0:1789708511.924488:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708511.924494:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000037bf2559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+8:6461:x1876645365416832:12345-0@lo:501: 00000100:00100000:3.0:1789708511.924565:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000037bf2559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:6461:x1876645365416832:12345-0@lo:501: Request processed in 71us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.924569:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708511.924590:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416832:0@lo:501: 00000100:00100000:1.0:1789708511.924622:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416960:0@lo:503: 00000100:00100000:1.0:1789708511.924658:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708511.924674:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e98d4e3c going to sleep for 11 seconds 00000100:00100000:2.0:1789708511.924697:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365416960 00000100:00100000:2.0:1789708511.924702:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365416960 00000100:00100000:2.0:1789708511.924736:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708511.924741:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e88f7c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:6461:x1876645365416960:12345-0@lo:503: 00000100:00100000:2.0:1789708511.924829:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e88f7c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:6461:x1876645365416960:12345-0@lo:503: Request processed in 87us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708511.924838:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708511.924850:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365416960:0@lo:503: 00000100:00100000:2.0:1789708511.925129:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6505:1876645365417088:0@lo:502: 00000100:00100000:2.0:1789708511.925166:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708511.925183:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 000000006dd5a269 going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.925209:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365417088 00000100:00100000:3.0:1789708511.925215:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365417088 00000100:00100000:3.0:1789708511.925248:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708511.925254:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067c36dd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:6505:x1876645365417088:12345-0@lo:502: 00000100:00100000:3.0:1789708511.925367:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067c36dd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:6505:x1876645365417088:12345-0@lo:502: Request processed in 114us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.925375:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708511.925395:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6505:1876645365417088:0@lo:502: 00000020:01000000:2.0:1789708511.925419:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708511.925430:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708511.925433:0:6505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789708511.925437:0:6505:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789708511.925440:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708511.925452:0:6505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000fe1c6851) 00000020:00000080:2.0:1789708511.925468:0:6505:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789708511.925473:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789708511.925548:0:6505:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789708511.925555:0:6505:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47c870 00000020:00000080:2.0:1789708511.925769:0:6505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789708511.925774:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708511.925784:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708511.925785:0:6505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789708511.925788:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708511.925792:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708511.925794:0:6505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789708511.925797:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708511.925804:0:6505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000333fd934) 00000020:00000080:2.0:1789708511.925814:0:6505:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789708511.925818:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789708511.925819:0:6505:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789708511.925822:0:6505:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789708511.925829:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789708511.925876:0:6505:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002abc9828 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789708511.925902:0:6505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000072e2549) 00000020:00000080:2.0:1789708511.925910:0:6505:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789708511.925980:0:6505:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789708511.925985:0:6505:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47c885 00000020:00000080:2.0:1789708511.926067:0:6505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789708511.926074:0:6505:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789708511.926078:0:6505:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf45f43947e47c88c 00080000:01000000:2.0:1789708511.926083:0:6505:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789708511.926085:0:6505:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47c893 00080000:10000000:2.0:1789708511.926415:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789708511.926531:0:6505:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789708511.929178:0:6505:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789708511.965424:0:6505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789708511.965696:0:6505:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789708511.967312:0:6505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789708511.967468:0:6505:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789708511.968916:0:6505:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002bbb5fc4) 00000020:00000080:2.0:1789708511.968933:0:6505:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789708511.969018:0:6505:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789708511.969027:0:6505:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47c8a1 00000020:00000080:0.0:1789708511.969369:0:6505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789708511.970080:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1789708511.971154:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1789708511.972152:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1789708511.973464:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1789708511.974390:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1789708511.975169:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1789708511.976014:0:6505:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf45f43947e47c8a8 00000020:00000080:2.0:1789708511.976245:0:6505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789708511.976255:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708511.976301:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708511.976304:0:6505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789708511.976307:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708511.976311:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708511.976313:0:6505:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789708511.976315:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789708511.976317:0:6505:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789708511.976319:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708511.976321:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708511.976323:0:6505:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789708511.976325:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708511.976329:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708511.976330:0:6505:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789708511.976334:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789708511.976373:0:6505:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789708511.976425:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6505:1876645365417216:0@lo:502: 00000100:00100000:2.0:1789708511.976501:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708511.976543:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365417216 00000100:00100000:3.0:1789708511.976549:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365417216 00000100:00100000:2.0:1789708511.976550:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 00000000783c5a72 going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.976590:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708511.976596:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000099f8eaa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:6505:x1876645365417216:12345-0@lo:502: 00000100:00100000:3.0:1789708511.976687:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000099f8eaa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:6505:x1876645365417216:12345-0@lo:502: Request processed in 91us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.976692:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789708511.976732:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6505:1876645365417216:0@lo:502: 00000020:01000000:2.0:1789708511.976757:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708511.976761:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708511.976763:0:6505:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789708511.976766:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789708511.976832:0:6461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789708511.976860:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789708511.976874:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.976882:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708511.976887:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee02bf3800 from 1 10000000:01000000:1.0:1789708511.976890:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789708511.976910:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.976921:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.976928:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708511.976935:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417344:0@lo:101: 00000100:00100000:1.0:1789708511.976957:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708511.976970:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f70d1e31 going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.976996:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365417344 00000100:00100000:3.0:1789708511.977001:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365417344 00000100:00100000:3.0:1789708511.977026:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708511.977033:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cca7e74b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:6461:x1876645365417344:12345-0@lo:101: 00010000:00010000:3.0:1789708511.977042:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708511.977054:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043045e60/0xf45f43947e47c8b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c8af expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.977073:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043045e60/0xf45f43947e47c8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c8af expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.977082:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043045e60/0xf45f43947e47c8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c8af expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.977090:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043045e60, rc 0) 00000100:00100000:3.0:1789708511.977122:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cca7e74b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:6461:x1876645365417344:12345-0@lo:101: Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.977128:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708511.977144:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417344:0@lo:101: 00010000:00010000:1.0:1789708511.977154:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.977160:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708511.977551:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417472:0@lo:256: 00000100:00100000:1.0:1789708511.977584:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708511.977599:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f70d1e31 going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.977614:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365417472 00000100:00100000:3.0:1789708511.977618:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365417472 00000100:00100000:3.0:1789708511.977639:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789708511.977643:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000116e54be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:6461:x1876645365417472:12345-0@lo:256: 20000000:01000000:3.0:1789708511.977654:0:6479:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789708511.977663:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789708511.977717:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000116e54be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:6461:x1876645365417472:12345-0@lo:256: Request processed in 73us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.977723:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708511.977725:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417472:0@lo:256: 10000000:01000000:1.0:1789708511.978164:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789708511.978174:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.978180:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708511.978193:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee02bf3800 from 1 10000000:01000000:1.0:1789708511.978195:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708511.978205:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.978210:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.978214:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708511.978221:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417600:0@lo:101: 00000100:00100000:1.0:1789708511.978239:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708511.978251:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f70d1e31 going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.978281:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365417600 00000100:00100000:3.0:1789708511.978285:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365417600 00000100:00100000:3.0:1789708511.978306:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789708511.978310:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003414dc5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:6461:x1876645365417600:12345-0@lo:101: 00010000:00010000:3.0:1789708511.978315:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708511.978321:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c300214/0xf45f43947e47c8c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c8bd expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.978331:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c300214/0xf45f43947e47c8c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c8bd expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.978337:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c300214/0xf45f43947e47c8c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c8bd expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.978341:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c300214, rc 0) 00000100:00100000:3.0:1789708511.978362:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003414dc5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:6461:x1876645365417600:12345-0@lo:101: Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.978366:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708511.978384:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417600:0@lo:101: 00010000:00010000:1.0:1789708511.978392:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708511.978396:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708511.978425:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417728:0@lo:501: 00000100:00100000:1.0:1789708511.978441:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708511.978458:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f70d1e31 going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.978469:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365417728 00000100:00100000:3.0:1789708511.978474:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365417728 00000100:00100000:3.0:1789708511.978497:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708511.978500:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb365fcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:6461:x1876645365417728:12345-0@lo:501: 00000100:00100000:3.0:1789708511.978580:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb365fcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:6461:x1876645365417728:12345-0@lo:501: Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.978584:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708511.978601:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417728:0@lo:501: 00000100:00100000:1.0:1789708511.978629:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417856:0@lo:503: 00000100:00100000:1.0:1789708511.978661:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708511.978673:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f70d1e31 going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.978677:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365417856 00000100:00100000:3.0:1789708511.978681:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365417856 00000100:00100000:3.0:1789708511.978699:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708511.978702:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9949b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:6461:x1876645365417856:12345-0@lo:503: 00000040:00080000:3.0:1789708511.978726:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789708511.978756:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9949b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:6461:x1876645365417856:12345-0@lo:503: Request processed in 53us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.978761:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708511.978770:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad09f677 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417856:0@lo:503: 00000040:00080000:1.0:1789708511.979302:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789708511.979363:0:6461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789708511.979386:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708511.979398:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.979417:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708511.979463:0:6461:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789708511.979466:0:6461:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bee02bf3800 10000000:01000000:2.0:1789708511.979469:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bee02bf3800 10000000:01000000:2.0:1789708511.979473:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789708511.979477:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee02bf3800 from 1 10000000:01000000:2.0:1789708511.979479:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789708511.979495:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.979502:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.979508:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708511.979519:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417984:0@lo:101: 00000100:00100000:2.0:1789708511.979545:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708511.979572:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365417984 00000100:00100000:3.0:1789708511.979575:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365417984 00000100:00100000:2.0:1789708511.979576:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 000000006400fbdf going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.979596:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708511.979600:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac99355a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:6461:x1876645365417984:12345-0@lo:101: 00010000:00010000:3.0:1789708511.979605:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708511.979610:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c8d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c8cb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.979621:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c8cb expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.979626:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c8cb expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.979630:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd8cdc27, rc 0) 00000100:00100000:3.0:1789708511.979650:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac99355a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6461:x1876645365417984:12345-0@lo:101: Request processed in 51us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.979654:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708511.979681:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365417984:0@lo:101: 00010000:00010000:2.0:1789708511.979692:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.979698:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708511.979761:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365418112:0@lo:501: 00000100:00100000:2.0:1789708511.979787:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708511.979804:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 000000006400fbdf going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.979812:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365418112 00000100:00100000:3.0:1789708511.979816:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365418112 00000100:00100000:3.0:1789708511.979833:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708511.979836:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024bd8e6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6461:x1876645365418112:12345-0@lo:501: 00000100:00100000:3.0:1789708511.979886:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024bd8e6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6461:x1876645365418112:12345-0@lo:501: Request processed in 50us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.979890:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708511.979917:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365418112:0@lo:501: 00000100:00100000:2.0:1789708511.979945:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365418240:0@lo:503: 00000100:00100000:2.0:1789708511.979981:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708511.979998:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365418240 00000100:00100000:2.0:1789708511.979999:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 000000006400fbdf going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.980003:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365418240 00000100:00100000:3.0:1789708511.980029:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789708511.980033:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a367a4c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6461:x1876645365418240:12345-0@lo:503: 00000100:00100000:3.0:1789708511.980090:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a367a4c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6461:x1876645365418240:12345-0@lo:503: Request processed in 57us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.980095:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789708511.980114:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365418240:0@lo:503: 00000100:00100000:2.0:1789708511.980349:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6510:1876645365418368:0@lo:502: 00000100:00100000:2.0:1789708511.980384:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708511.980401:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365418368 00000100:00100000:3.0:1789708511.980405:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365418368 00000100:00100000:2.0:1789708511.980411:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fd589ab going to sleep for 11 seconds 00000100:00100000:3.0:1789708511.980426:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708511.980430:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cb961d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6510:x1876645365418368:12345-0@lo:502: 00000100:00100000:3.0:1789708511.980499:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cb961d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6510:x1876645365418368:12345-0@lo:502: Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708511.980505:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789708511.980516:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6510:1876645365418368:0@lo:502: 00000020:01000004:2.0:1789708511.980560:0:6510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789708511.980570:0:6510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000024377d76) 00000020:00000080:2.0:1789708511.980581:0:6510:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789708511.980641:0:6510:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002abc9828 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789708511.980644:0:6510:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002abc9828 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789708511.980646:0:6510:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002abc9828 4 00010000:00080000:2.0:1789708511.980671:0:6510:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002bb4ff11@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1789708511.982604:0:6510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789708511.982749:0:6510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789708511.982775:0:6510:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789708511.982784:0:6510:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf45f43947e47c8e0 00000100:00080000:2.0:1789708511.982789:0:6510:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708511.982795:0:6510:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002bb4ff11 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708511.982820:0:6510:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003d744104 x1876645365418496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708511.982836:0:6510:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789708511.982861:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365418496:0@lo:38: 00000100:00100000:3.0:1789708511.982911:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708511.982940:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365418496 00000100:00100000:2.0:1789708511.982945:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365418496 00000100:00100000:2.0:1789708511.982978:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708511.982982:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7b57091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365418496:12345-0@lo:38: 00000100:00100000:3.0:1789708511.982984:0:6484:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789708511.982990:0:6484:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789708511.983040:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7b57091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365418496:12345-0@lo:38: Request processed in 56us (128us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789708511.983046:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708511.983058:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789708511.983064:0:3614:0:(import.c:65:import_set_state_nolock()) 000000002bb4ff11 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708511.983067:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789708511.983070:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d744104 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365418496:0@lo:38: 00000100:00100000:2.0:1789708511.983137:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6510:1876645365418624:0@lo:502: 00000100:00100000:2.0:1789708511.983171:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708511.983186:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fd589ab going to sleep for 11 seconds 00000100:00100000:0.0:1789708511.983212:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365418624 00000100:00100000:0.0:1789708511.983218:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365418624 00000100:00100000:0.0:1789708511.983252:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708511.983297:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cce1f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6510:x1876645365418624:12345-0@lo:502: 00000100:00100000:0.0:1789708511.983406:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cce1f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6510:x1876645365418624:12345-0@lo:502: Request processed in 148us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708511.983416:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789708511.983428:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6510:1876645365418624:0@lo:502: 00000040:00080000:2.0:1789708511.983449:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789708511.983513:0:6461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789708511.983539:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789708511.983552:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.983559:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789708511.983596:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789708511.983599:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789708511.983601:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708511.983602:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708511.983604:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708511.983605:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708511.983607:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789708511.983608:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789708511.983609:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789708511.983611:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789708511.983612:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708511.983614:0:6461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789708511.983617:0:6461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789708511.983620:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789708511.983621:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789708511.983622:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708511.983622:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708511.983623:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708511.983624:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708511.983625:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789708511.983626:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789708511.983626:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789708511.983627:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789708511.983627:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708511.983628:0:6461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789708511.983643:0:6461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789708511.983650:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af8d5da1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365418752:0@lo:253: 00000100:00100000:3.0:1789708511.983690:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708511.983708:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365418752 00000100:00100000:2.0:1789708511.983712:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365418752 00000100:00100000:3.0:1789708511.983714:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049764492 going to sleep for 11 seconds 00000100:00100000:2.0:1789708511.983739:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708511.983745:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074a673ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6461:x1876645365418752:12345-0@lo:253: 20000000:01000000:2.0:1789708511.983761:0:6478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789708511.983772:0:6478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789708511.985950:0:6478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789708511.985965:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789708511.985981:0:6499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789708511.985990:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789708511.986003:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.986014:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000043045e60/0xf45f43947e47c8b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c8af expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.986019:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.986041:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000043045e60/0xf45f43947e47c8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c8af expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708511.986050:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000043045e60/0xf45f43947e47c8b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c8af expref: 12 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708511.986058:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ee4f656 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365418880:0@lo:104: 00000100:00100000:3.0:1789708511.986089:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708511.986134:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365418880 00000100:00100000:2.0:1789708511.986138:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074a673ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6461:x1876645365418752:12345-0@lo:253: Request processed in 2392us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708511.986140:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365418880 00000100:00100000:3.0:1789708511.986144:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032602ac3 going to sleep for 11 seconds 00000100:00100000:2.0:1789708511.986149:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789708511.986180:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af8d5da1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6461:1876645365418752:0@lo:253: 10000000:01000000:3.0:1789708511.986190:0:6461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789708511.986192:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708511.986195:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000100:00100000:1.0:1789708511.986196:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:3.0:1789708511.986197:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708511.986200:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708511.986201:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708511.986202:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708511.986203:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789708511.986204:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789708511.986205:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789708511.986208:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000100:00100000:1.0:1789708511.986208:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d28001d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6499:x1876645365418880:12345-0@lo:104: 00000020:01000004:3.0:1789708511.986210:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708511.986212:0:6461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1789708511.986220:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1789708511.986233:0:6461:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789708511.986307:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789708511.986313:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d28001d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6499:x1876645365418880:12345-0@lo:104: Request processed in 110us (223us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708511.986313:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708511.986320:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708511.986321:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ee4f656 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365418880:0@lo:104: 00000100:00100000:1.0:1789708511.986324:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789708511.986333:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002c9a231f already unused, calling callback (000000009f7eade9) 10000000:00010000:0.0:1789708511.986337:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708511.986344:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986347:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708511.986350:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708511.986360:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708511.986392:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708511.986396:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708511.986410:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708511.986414:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 000000002c9a231f/0xf45f43947e47c8af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c8b6 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708511.986426:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708511.986427:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708511.986428:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708511.986510:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f8cfed2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365419008:0@lo:103: 00000100:00100000:1.0:1789708511.986533:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708511.986560:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365419008 00000100:00100000:2.0:1789708511.986565:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365419008 00010000:00010000:2.0:1789708511.986579:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000043045e60/0xf45f43947e47c8b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c8af expref: 12 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708511.986600:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708511.986606:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad09f677 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:3616:x1876645365419008:12345-0@lo:103: 00000100:00100000:1.0:1789708511.986609:0:6470:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789708511.986614:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789708511.986616:0:6470:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789708511.986618:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000043045e60/0xf45f43947e47c8b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c8af expref: 12 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986627:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000043045e60/0xf45f43947e47c8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c8af expref: 12 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986636:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000043045e60/0xf45f43947e47c8b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c8af expref: 12 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986645:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986650:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789708511.986659:0:6469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000670418s 00010000:00010000:2.0:1789708511.986661:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986666:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986677:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986680:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986684:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008a01df86 already unused, calling callback (0000000020c8a59f) 00010000:00010000:2.0:1789708511.986687:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986692:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986704:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986715:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708511.986761:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad09f677 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:3616:x1876645365419008:12345-0@lo:103: Request processed in 155us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708511.986769:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f8cfed2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365419008:0@lo:103: 00000100:00100000:2.0:1789708511.986773:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789708511.986802:0:6499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986808:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708511.986815:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a01df86/0xf45f43947e47c8e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789708511.989032:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789708511.989145:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789708511.989316:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1789708511.989448:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789708511.989622:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1789708511.989769:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789708511.990186:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789708511.990533:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789708511.990681:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1789708511.990801:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789708511.990915:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1789708511.991023:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1789708511.992329:0:6461:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789708511.996507:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789708511.996511:0:6517:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789708511.996520:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789708511.996660:0:6518:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:2.0:1789708511.997489:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789708511.998107:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789708511.998219:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789708511.999566:0:6461:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789708511.999573:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789708511.999674:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708512.001412:0:6518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789708512.001457:0:6518:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789708512.001460:0:6518:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1789708512.001794:0:6461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789708512.002316:0:6461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789708512.002350:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789708512.002459:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789708512.002641:0:6461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1789708512.003298:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789708512.003438:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789708512.003590:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789708512.003709:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789708512.003835:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789708512.003947:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789708512.004079:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789708512.004225:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789708512.004400:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789708512.004540:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789708512.004689:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789708512.004864:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789708512.004999:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789708512.005131:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789708512.005323:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789708512.005473:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789708512.005731:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789708512.005885:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789708512.006021:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789708512.006156:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789708512.006347:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789708512.006502:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789708512.006647:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789708512.006784:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789708512.006923:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789708512.007063:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789708512.007199:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789708512.007366:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789708512.007512:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789708512.007647:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789708512.007805:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789708512.007933:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789708512.008099:0:6461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789708512.009564:0:6461:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789708512.009588:0:6461:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbde281c73988 00100000:10000000:0.0:1789708512.009595:0:6461:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789708512.009899:0:6461:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789708512.009914:0:6461:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789708512.009933:0:6461:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789708512.009943:0:6461:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789708512.010833:0:6461:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708512.010996:0:6461:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789708512.870358:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789708513.267480:0:6762:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1789708513.562182:0:6814:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708513.562397:0:6814:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708513.894504:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708514.918478:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789708515.133087:0:6915:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708515.133230:0:6915:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708515.942350:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708516.966333:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789708517.222405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789708517.222417:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789708517.222419:0:37:0:(import.c:65:import_set_state_nolock()) 000000002bb4ff11 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708517.222434:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002bb4ff11 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708517.222452:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001acb4022 x1876645365419264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789708517.222518:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc18fc0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365419136:0@lo:400: 00000100:00100000:0.0:1789708517.222518:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001acb4022 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365419264:0@lo:38: 00000100:00100000:3.0:1789708517.222584:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708517.222624:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708517.222635:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365419136 00000100:00100000:1.0:1789708517.222643:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365419136 00000100:00100000:2.0:1789708517.222660:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365419264 00000100:00100000:2.0:1789708517.222666:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365419264 00000100:00100000:1.0:1789708517.222683:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708517.222691:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003a9f2774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:3617:x1876645365419136:12345-0@lo:400: 00000100:00100000:2.0:1789708517.222702:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708517.222713:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e384effa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876645365419264:12345-0@lo:38: 00010000:00080000:2.0:1789708517.222738:0:6485:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 88 last 0 00000100:00100000:1.0:1789708517.222743:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003a9f2774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:3617:x1876645365419136:12345-0@lo:400: Request processed in 47us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708517.222750:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789708517.222763:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc18fc0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365419136:0@lo:400: 00000020:00000080:2.0:1789708517.222783:0:6485:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf45f43947e47c8ee 00000004:00100000:2.0:1789708517.222835:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789708517.222913:0:6485:0:(import.c:65:import_set_state_nolock()) 00000000aaae12dc : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708517.222958:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e384effa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876645365419264:12345-0@lo:38: Request processed in 248us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708517.222965:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789708517.222996:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001acb4022 x1876645365419264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708517.223009:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789708517.223022:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789708517.223026:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789708517.223028:0:3614:0:(import.c:65:import_set_state_nolock()) 000000002bb4ff11 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789708517.223034:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001acb4022 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365419264:0@lo:38: 00010000:00010000:2.0:1789708517.990395:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789708518.126408:0:7413:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789708518.126411:0:7413:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789708518.126412:0:7413:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789708518.126501:0:7413:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f105e6d0 00000020:01000004:1.0:1789708518.126513:0:7413:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1789708518.126520:0:7413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789708518.126536:0:7413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000f9ff0478) 00000020:00000080:1.0:1789708518.126548:0:7413:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789708518.142946:0:7413:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1789708518.143008:0:7413:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1789708518.152246:0:7413:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789708518.152456:0:7413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789708518.152464:0:7413:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789708518.152471:0:7413:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47c8fc 00000020:01000004:2.0:1789708518.152476:0:7413:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789708518.152492:0:7413:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789708518.152494:0:7413:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789708518.152499:0:7413:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789708518.152523:0:7413:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789708518.152526:0:7413:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789708518.159571:0:7413:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789708518.159600:0:7413:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.152@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789708518.159603:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789708518.159604:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789708518.159605:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708518.159606:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708518.159606:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708518.159607:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708518.159608:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708518.159609:0:7413:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789708518.159609:0:7413:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789708518.159610:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708518.159611:0:7413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789708518.159613:0:7413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789708518.159615:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789708518.159616:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789708518.159616:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708518.159617:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708518.159617:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708518.159618:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708518.159618:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708518.159619:0:7413:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789708518.159619:0:7413:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789708518.159620:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708518.159621:0:7413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789708518.159647:0:7413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789708518.159661:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365419392:0@lo:253: 00000100:00100000:2.0:1789708518.159733:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.159774:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000913c9dc7 going to sleep for 11 seconds 00000100:00100000:3.0:1789708518.159790:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365419392 00000100:00100000:3.0:1789708518.159799:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365419392 00000100:00100000:3.0:1789708518.159851:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789708518.159860:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e619abb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365419392:12345-0@lo:253: 20000000:01000000:3.0:1789708518.159889:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789708518.159894:0:6478:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1789708518.159900:0:6478:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1789708518.159903:0:6478:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1789708518.159933:0:6478:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1789708518.160118:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708518.160253:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789708518.160288:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789708518.160309:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789708518.160330:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789708518.160348:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789708518.160451:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1789708518.160461:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1789708518.160476:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1789708518.160481:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1789708518.160496:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1789708518.160501:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1789708518.160515:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789708518.160532:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789708518.160700:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1789708518.160710:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:3.0:1789708518.160724:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1789708518.160730:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789708518.160742:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1789708518.160748:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:3.0:1789708518.160761:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1789708518.160767:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789708518.160781:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789708518.160799:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789708518.160811:0:6478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789708518.160949:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1789708518.160958:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1789708518.160971:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789708518.160991:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789708518.161023:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1789708518.161032:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1789708518.161045:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789708518.161062:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789708518.161067:0:6478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1789708518.161112:0:6478:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789708518.161119:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1789708518.161383:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789708518.161515:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789708518.161527:0:6478:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.152@tcp for mdt 20000000:01000000:3.0:1789708518.161529:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:3.0:1789708518.161537:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789708518.161540:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789708518.161547:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789708518.161549:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:3.0:1789708518.161558:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789708518.161562:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1789708518.161569:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1789708518.161576:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1789708518.161630:0:6478:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1789708518.161635:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1789708518.161818:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1789708518.161922:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789708518.161935:0:6478:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.201.152@tcp for mdt 20000000:01000000:3.0:1789708518.161937:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:3.0:1789708518.161951:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789708518.161956:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789708518.161968:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789708518.161974:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:3.0:1789708518.161985:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789708518.161991:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1789708518.162003:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789708518.162018:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1789708518.162057:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789708518.162060:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789708518.162062:0:6478:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789708518.162094:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789708518.162095:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789708518.162328:0:7421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789708518.162349:0:7421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789708518.162364:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789708518.162473:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789708518.162511:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789708518.162534:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789708518.162552:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789708518.162553:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789708518.162757:0:7422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789708518.162775:0:7422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789708518.162786:0:7422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1789708518.162869:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789708518.162881:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789708518.162901:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1789708518.162913:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789708518.162914:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789708518.163078:0:7423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789708518.163089:0:7423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789708518.163096:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789708518.163203:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1789708518.163222:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1789708518.163236:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1789708518.163252:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789708518.163254:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789708518.163276:0:6478:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789708518.163281:0:6478:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789708518.163443:0:7424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1789708518.163489:0:6478:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789708518.167254:0:6478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789708518.167301:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.167314:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c948378e/0xf45f43947e47c846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c83f expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.167320:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c85b expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.167324:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c8cb expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.167328:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.167356:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c8cb expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.167365:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c8d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c8cb expref: 11 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.167379:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098a187a4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365419520:0@lo:104: 00000100:00100000:2.0:1789708518.167425:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708518.167469:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c85b expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708518.167473:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365419520 00010000:00010000:2.0:1789708518.167480:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c862 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c85b expref: 11 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708518.167482:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365419520 00000100:00100000:2.0:1789708518.167493:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097663949 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365419648:0@lo:104: 00000100:00100000:2.0:1789708518.167517:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708518.167531:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365419648 00000100:00100000:1.0:1789708518.167536:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365419648 00010000:00010000:2.0:1789708518.167538:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c948378e/0xf45f43947e47c846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c83f expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.167545:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c948378e/0xf45f43947e47c846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c83f expref: 11 pid: 6477 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708518.167549:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708518.167557:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000091a00bdb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365419776:0@lo:104: 00000100:00100000:0.0:1789708518.167573:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd010309 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6478:x1876645365419520:12345-0@lo:104: 00000100:00100000:2.0:1789708518.167580:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708518.167584:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.167599:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000548167c5 going to sleep for 11 seconds 00000100:00100000:1.0:1789708518.167599:0:6468:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789708518.167608:0:6468:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1789708518.167645:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708518.167651:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd010309 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6478:x1876645365419520:12345-0@lo:104: Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708518.167655:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098a187a4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365419520:0@lo:104: 00010000:00010000:1.0:1789708518.167656:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789708518.167661:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789708518.167663:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.167671:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000be4f7307 already unused, calling callback (000000009f7eade9) 10000000:00010000:1.0:1789708518.167673:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708518.167680:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365419776 00010000:00010000:1.0:1789708518.167681:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708518.167685:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365419776 10000000:00010000:1.0:1789708518.167697:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708518.167702:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 10000000:01000000:1.0:1789708518.167708:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789708518.167710:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f956b182 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6478:x1876645365419648:12345-0@lo:104: 00010000:00010000:0.0:1789708518.167718:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.167737:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.167743:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708518.167756:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789708518.167760:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097663949 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365419648:0@lo:104: 00010000:00010000:1.0:1789708518.167764:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708518.167764:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f956b182 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6478:x1876645365419648:12345-0@lo:104: Request processed in 52us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708518.167778:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789708518.167779:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 00000000be4f7307/0xf45f43947e47c8cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c8d2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.167792:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708518.167794:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708518.167799:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789708518.167804:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005da715f7 already unused, calling callback (000000009f7eade9) 10000000:00010000:1.0:1789708518.167806:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708518.167812:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000092249da2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6478:x1876645365419776:12345-0@lo:104: 00010000:00010000:1.0:1789708518.167813:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708518.167822:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.167822:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708518.167839:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708518.167861:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789708518.167865:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708518.167869:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000092249da2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6478:x1876645365419776:12345-0@lo:104: Request processed in 60us (287us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708518.167875:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789708518.167878:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000091a00bdb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365419776:0@lo:104: 00000100:00100000:0.0:1789708518.167879:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789708518.167893:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708518.167898:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005aadff55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365420032:0@lo:103: 00010000:00010000:0.0:1789708518.167900:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708518.167902:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.167907:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c85b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c862 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.167919:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708518.167921:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708518.167923:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708518.167933:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b430c175 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365419904:0@lo:103: 00000100:00100000:3.0:1789708518.167934:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.167962:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365420032 00000100:00100000:2.0:1789708518.167966:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365420032 00000100:00100000:1.0:1789708518.167971:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708518.167994:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c862 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c85b expref: 12 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708518.167999:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365419904 00000100:00100000:3.0:1789708518.168004:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365419904 00010000:00010000:0.0:1789708518.168008:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708518.168016:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789708518.168017:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.168019:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c8d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c8cb expref: 13 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.168026:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af8d5da1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:3615:x1876645365420032:12345-0@lo:103: 00010000:00010000:0.0:1789708518.168038:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008121b757 already unused, calling callback (000000009f7eade9) 00010000:00010000:2.0:1789708518.168039:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:0.0:1789708518.168040:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168044:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c862 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c85b expref: 13 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.168047:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708518.168048:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708518.168055:0:6514:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789708518.168061:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000122f89a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:3618:x1876645365419904:12345-0@lo:103: 00000100:00100000:1.0:1789708518.168066:0:6514:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 10000000:00010000:0.0:1789708518.168066:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168069:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c85b expref: 13 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.168077:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:0.0:1789708518.168079:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708518.168086:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c8d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c8cb expref: 13 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168097:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c85b expref: 13 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.168100:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c8cb expref: 13 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.168106:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168117:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708518.168117:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708518.168124:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c8d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c8cb expref: 12 pid: 6479 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.168131:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708518.168134:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e1479cd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365420160:0@lo:103: 00010000:00010000:3.0:1789708518.168135:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708518.168144:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af8d5da1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:3615:x1876645365420032:12345-0@lo:103: Request processed in 120us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708518.168146:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 000000008121b757/0xf45f43947e47c83f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c846 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.168165:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789708518.168177:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708518.168181:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708518.168184:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708518.168188:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000122f89a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:3618:x1876645365419904:12345-0@lo:103: Request processed in 129us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708518.168191:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708518.168199:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708518.168212:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005aadff55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365420032:0@lo:103: 00000100:00100000:2.0:1789708518.168218:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365420160 00000100:00100000:2.0:1789708518.168224:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365420160 00010000:00010000:0.0:1789708518.168232:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708518.168235:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708518.168239:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c948378e/0xf45f43947e47c846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c83f expref: 10 pid: 6477 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708518.168254:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b430c175 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365419904:0@lo:103: 00000100:00100000:2.0:1789708518.168294:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708518.168302:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c293321 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:3616:x1876645365420160:12345-0@lo:103: 00010000:00010000:2.0:1789708518.168309:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708518.168312:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c948378e/0xf45f43947e47c846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c83f expref: 10 pid: 6477 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168325:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c948378e/0xf45f43947e47c846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c83f expref: 10 pid: 6477 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168332:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c948378e/0xf45f43947e47c846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c83f expref: 10 pid: 6477 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168338:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168342:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168350:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168355:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168361:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168366:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168371:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c68189d already unused, calling callback (0000000020c8a59f) 00010000:00010000:2.0:1789708518.168373:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168380:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168402:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.168409:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708518.168415:0:6478:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.168426:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.168430:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004c68189d/0xf45f43947e47c903 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.168432:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c293321 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:3616:x1876645365420160:12345-0@lo:103: Request processed in 132us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708518.168445:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:3.0:1789708518.168454:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789708518.168457:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e1479cd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365420160:0@lo:103: 00000100:00100000:3.0:1789708518.169463:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e619abb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+8:7413:x1876645365419392:12345-0@lo:253: Request processed in 9604us (9730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708518.169471:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708518.169488:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365419392:0@lo:253: 10000000:01000000:2.0:1789708518.169498:0:7413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789708518.169500:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789708518.169501:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789708518.169502:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708518.169503:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789708518.169504:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708518.169505:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708518.169505:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708518.169506:0:7413:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789708518.169507:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708518.169508:0:7413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789708518.169528:0:7413:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f105e6d0 from lustre-MDT0001 10000000:01000000:2.0:1789708518.169543:0:7413:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789708518.169545:0:7413:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789708518.169549:0:7413:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bee18160000 local copy 10000000:01000000:2.0:1789708518.169551:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789708518.169564:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.169571:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.169578:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.169596:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365420288:0@lo:101: 00000100:00100000:2.0:1789708518.169619:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.169637:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8a7e8d5 going to sleep for 11 seconds 00000100:00100000:1.0:1789708518.169648:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365420288 00000100:00100000:1.0:1789708518.169652:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365420288 00000100:00100000:1.0:1789708518.169679:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789708518.169687:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be28b710 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+8:7413:x1876645365420288:12345-0@lo:101: 00010000:00010000:1.0:1789708518.169698:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708518.169709:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080041f45/0xf45f43947e47c911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c90a expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.169733:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080041f45/0xf45f43947e47c911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c90a expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.169738:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080041f45/0xf45f43947e47c911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c90a expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.169742:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080041f45, rc 0) 00000100:00100000:1.0:1789708518.169767:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be28b710 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:7413:x1876645365420288:12345-0@lo:101: Request processed in 83us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708518.169772:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789708518.169781:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365420288:0@lo:101: 00010000:00010000:2.0:1789708518.169792:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.169797:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.169858:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365420416:0@lo:501: 00000100:00100000:2.0:1789708518.169875:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.169887:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8a7e8d5 going to sleep for 11 seconds 00000100:00100000:3.0:1789708518.169899:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365420416 00000100:00100000:3.0:1789708518.169903:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365420416 00000100:00100000:3.0:1789708518.169923:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708518.169930:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059d2b901 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:7413:x1876645365420416:12345-0@lo:501: 00000100:00100000:3.0:1789708518.169987:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059d2b901 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:7413:x1876645365420416:12345-0@lo:501: Request processed in 55us (108us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708518.169993:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789708518.169996:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365420416:0@lo:501: 10000000:01000000:2.0:1789708518.170011:0:7413:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789708518.170027:0:7413:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789708518.170031:0:7413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170037:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170042:0:7413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170059:0:7413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708518.170079:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1789708518.170084:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bee36337800 00010000:00010000:1.0:1789708518.170084:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708518.170090:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789708518.170093:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003bb66e4b already unused, calling callback (000000009f7eade9) 10000000:01000000:2.0:1789708518.170096:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bee18160000 10000000:00010000:1.0:1789708518.170096:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708518.170103:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789708518.170104:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708518.170109:0:7413:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bee18160000 from 1 10000000:00010000:1.0:1789708518.170110:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708518.170114:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 10000000:01000000:1.0:1789708518.170117:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708518.170130:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000a7be6223/0xf45f43947e47c918 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.170132:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170144:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000a7be6223/0xf45f43947e47c918 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.170145:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708518.170151:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000a7be6223/0xf45f43947e47c918 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.170172:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365420544:0@lo:101: 00010000:00010000:1.0:1789708518.170178:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.170183:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 000000003bb66e4b/0xf45f43947e47c90a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45f43947e47c911 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.170196:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708518.170197:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b430c175 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365420672:0@lo:103: 00000100:00100000:2.0:1789708518.170197:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708518.170198:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708518.170203:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708518.170219:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8a7e8d5 going to sleep for 11 seconds 00000100:00100000:0.0:1789708518.170232:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365420544 00000100:00100000:3.0:1789708518.170233:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708518.170236:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365420544 00000100:00100000:2.0:1789708518.170271:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365420672 00000100:00100000:2.0:1789708518.170275:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365420672 00000100:00100000:0.0:1789708518.170288:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789708518.170299:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002380c232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:7413:x1876645365420544:12345-0@lo:101: 00000100:00100000:2.0:1789708518.170304:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789708518.170306:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789708518.170313:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000003b059f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:3617:x1876645365420672:12345-0@lo:103: 00010000:00010000:0.0:1789708518.170317:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee37b004/0xf45f43947e47c91f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c918 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170321:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708518.170333:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000080041f45/0xf45f43947e47c911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47c90a expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.170336:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee37b004/0xf45f43947e47c91f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c918 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.170354:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee37b004/0xf45f43947e47c91f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c918 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170357:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708518.170363:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee37b004, rc 0) 00000100:00100000:2.0:1789708518.170396:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000003b059f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:3617:x1876645365420672:12345-0@lo:103: Request processed in 85us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708518.170403:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b430c175 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365420672:0@lo:103: 00000100:00100000:0.0:1789708518.170403:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002380c232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:7413:x1876645365420544:12345-0@lo:101: Request processed in 108us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708518.170405:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708518.170412:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789708518.170446:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365420544:0@lo:101: 00010000:00010000:2.0:1789708518.170456:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000a7be6223/0xf45f43947e47c918 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c91f expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170463:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000a7be6223/0xf45f43947e47c918 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c91f expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708518.170475:0:7413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789708518.170486:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000a7be6223/0xf45f43947e47c918 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c91f expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170492:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000a7be6223/0xf45f43947e47c918 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c91f expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708518.170500:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bee36337800 10000000:01000000:2.0:1789708518.170503:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789708518.170506:0:7413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bee36337800 from 1 10000000:01000000:2.0:1789708518.170508:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789708518.170519:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000009ec59f45/0xf45f43947e47c926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170523:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 000000009ec59f45/0xf45f43947e47c926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170527:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000009ec59f45/0xf45f43947e47c926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.170533:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365420800:0@lo:101: 00000100:00100000:2.0:1789708518.170548:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.170569:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8a7e8d5 going to sleep for 11 seconds 00000100:00100000:3.0:1789708518.170571:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365420800 00000100:00100000:3.0:1789708518.170575:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365420800 00000100:00100000:3.0:1789708518.170597:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789708518.170601:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014488f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+9:7413:x1876645365420800:12345-0@lo:101: 00010000:00010000:3.0:1789708518.170606:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708518.170611:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a01df86/0xf45f43947e47c92d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c926 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.170626:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a01df86/0xf45f43947e47c92d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c926 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.170630:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a01df86/0xf45f43947e47c92d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c926 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.170634:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a01df86, rc 0) 00000100:00100000:3.0:1789708518.170656:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014488f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:7413:x1876645365420800:12345-0@lo:101: Request processed in 55us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708518.170660:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708518.170674:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365420800:0@lo:101: 00010000:00010000:2.0:1789708518.170681:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000009ec59f45/0xf45f43947e47c926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170686:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000009ec59f45/0xf45f43947e47c926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708518.170692:0:7413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789708518.170698:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000009ec59f45/0xf45f43947e47c926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170702:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 000000009ec59f45/0xf45f43947e47c926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708518.170705:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789708518.170708:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789708518.170710:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bee36337800 10000000:01000000:2.0:1789708518.170712:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789708518.170714:0:7413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789708518.170715:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789708518.170723:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170726:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170730:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.170735:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365420928:0@lo:101: 00000100:00100000:2.0:1789708518.170755:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.170766:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8a7e8d5 going to sleep for 11 seconds 00000100:00100000:0.0:1789708518.170770:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365420928 00000100:00100000:0.0:1789708518.170775:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365420928 00000100:00100000:0.0:1789708518.170799:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708518.170804:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc70e572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+10:7413:x1876645365420928:12345-0@lo:101: 00010000:00010000:0.0:1789708518.170811:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708518.170817:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d5104a4/0xf45f43947e47c93b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c934 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.170828:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d5104a4/0xf45f43947e47c93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c934 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.170835:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d5104a4/0xf45f43947e47c93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c934 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.170850:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d5104a4, rc 0) 00000100:00100000:0.0:1789708518.170874:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc70e572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365420928:12345-0@lo:101: Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708518.170878:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708518.170897:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365420928:0@lo:101: 00010000:00010000:2.0:1789708518.170907:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.170914:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.170957:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365421056:0@lo:501: 00000100:00100000:2.0:1789708518.170974:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.170988:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8a7e8d5 going to sleep for 11 seconds 00000100:00100000:3.0:1789708518.171026:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365421056 00000100:00100000:3.0:1789708518.171031:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365421056 00000100:00100000:3.0:1789708518.171060:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789708518.171067:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab377adf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365421056:12345-0@lo:501: 00000100:00100000:3.0:1789708518.171141:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab377adf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365421056:12345-0@lo:501: Request processed in 74us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708518.171148:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789708518.171172:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365421056:0@lo:501: 00000100:00100000:2.0:1789708518.171203:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365421184:0@lo:503: 00000100:00100000:2.0:1789708518.171236:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.171251:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8a7e8d5 going to sleep for 11 seconds 00000100:00100000:0.0:1789708518.171314:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365421184 00000100:00100000:0.0:1789708518.171317:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365421184 00000100:00100000:0.0:1789708518.171336:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789708518.171339:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7a658fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365421184:12345-0@lo:503: 00000100:00100000:0.0:1789708518.171404:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7a658fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365421184:12345-0@lo:503: Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708518.171409:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789708518.171420:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365421184:0@lo:503: 00000040:00080000:2.0:1789708518.171599:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708518.171648:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365421312:0@lo:502: 00000100:00100000:2.0:1789708518.171679:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.171696:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8a7e8d5 going to sleep for 11 seconds 00000100:00100000:3.0:1789708518.171715:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365421312 00000100:00100000:3.0:1789708518.171720:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365421312 00000100:00100000:3.0:1789708518.171746:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789708518.171752:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006155ade2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365421312:12345-0@lo:502: 00000100:00100000:3.0:1789708518.171821:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006155ade2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365421312:12345-0@lo:502: Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708518.171826:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789708518.171836:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365421312:0@lo:502: 00000040:00080000:2.0:1789708518.171960:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789708518.171976:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789708518.171983:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789708518.171989:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789708518.172002:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789708518.172009:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789708518.172016:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789708518.172023:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789708518.172029:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789708518.172036:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789708518.172042:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789708518.172050:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789708518.172063:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789708518.172076:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789708518.172089:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789708518.172100:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789708518.172106:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789708518.172113:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789708518.172119:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789708518.172125:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789708518.172132:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789708518.172147:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789708518.172168:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789708518.172181:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365421440:0@lo:502: 00000100:00100000:2.0:1789708518.172203:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.172216:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8a7e8d5 going to sleep for 11 seconds 00000100:00100000:0.0:1789708518.172231:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365421440 00000100:00100000:0.0:1789708518.172234:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365421440 00000100:00100000:0.0:1789708518.172253:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789708518.172256:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f161a9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365421440:12345-0@lo:502: 00000100:00100000:0.0:1789708518.172352:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f161a9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365421440:12345-0@lo:502: Request processed in 95us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708518.172358:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789708518.172365:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365421440:0@lo:502: 00000040:00080000:2.0:1789708518.172400:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1789708518.172405:0:7413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1789708518.172669:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708518.172679:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708518.172681:0:7428:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789708518.172685:0:7428:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789708518.172688:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708518.172701:0:7428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000002685dac5) 00000020:00000080:2.0:1789708518.172721:0:7428:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1789708518.172726:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789708518.172801:0:7428:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789708518.172806:0:7428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47c949 00000020:00000080:2.0:1789708518.172953:0:7428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789708518.172956:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708518.172958:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708518.172959:0:7428:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789708518.172961:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708518.172963:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708518.172964:0:7428:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789708518.172966:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708518.172974:0:7428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000000383b9a) 00000020:00000080:2.0:1789708518.172981:0:7428:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789708518.172984:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789708518.172985:0:7428:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789708518.172987:0:7428:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789708518.172991:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789708518.173013:0:7428:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f105e6d0 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789708518.173019:0:7428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000cf3bdbdf) 00000020:00000080:2.0:1789708518.173023:0:7428:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789708518.173079:0:7428:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789708518.173084:0:7428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47c95e 00000020:00000080:2.0:1789708518.173144:0:7428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789708518.173148:0:7428:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789708518.173151:0:7428:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf45f43947e47c965 00080000:01000000:2.0:1789708518.173168:0:7428:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789708518.173170:0:7428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47c96c 00080000:10000000:2.0:1789708518.173413:0:7428:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789708518.173491:0:7428:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1789708518.209328:0:7428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789708518.209510:0:7428:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789708518.210899:0:7428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789708518.211065:0:7428:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789708518.214662:0:7428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789708518.214672:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708518.214677:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708518.214679:0:7428:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789708518.214681:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708518.214685:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708518.214686:0:7428:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789708518.214688:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789708518.214691:0:7428:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:00000080:2.0:1789708518.214713:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708518.214724:0:7428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000004c0cf8ab) 00000020:00000080:2.0:1789708518.214743:0:7428:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789708518.214750:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789708518.214841:0:7428:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789708518.214847:0:7428:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789708518.214855:0:7428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47c97a 00010000:00080000:2.0:1789708518.214884:0:7428:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004ceba052@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1789708518.216344:0:7428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1789708518.216966:0:7428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789708518.216974:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789708518.217002:0:7428:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789708518.217020:0:7428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47c981 00000100:00080000:1.0:1789708518.217028:0:7428:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708518.217036:0:7428:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000004ceba052 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708518.217069:0:7428:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001911c687 x1876645365421568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708518.217093:0:7428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789708518.217106:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001911c687 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365421568:0@lo:38: 00000020:01000000:1.0:1789708518.217193:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1789708518.217194:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.217200:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365421696:0@lo:400: 00000020:00000080:1.0:1789708518.217201:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708518.217205:0:7428:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789708518.217211:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789708518.217214:0:7428:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789708518.217216:0:7428:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708518.217218:0:7428:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708518.217219:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789708518.217223:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708518.217225:0:7428:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789708518.217229:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708518.217234:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1789708518.217238:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1789708518.217238:0:7428:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789708518.217247:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789708518.217275:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365421568 00000100:00100000:0.0:1789708518.217281:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365421568 00000100:00100000:3.0:1789708518.217293:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365421696 00000100:00100000:3.0:1789708518.217298:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365421696 00000100:00100000:2.0:1789708518.217302:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000091a00bdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365421824:0@lo:400: 00000100:00100000:0.0:1789708518.217310:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708518.217315:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007c0bc502 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365421568:12345-0@lo:38: 00000004:01000000:1.0:1789708518.217322:0:7428:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00010000:00080000:0.0:1789708518.217333:0:6488:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 89 last 0 00000100:00100000:2.0:1789708518.217340:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708518.217348:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000020:01000000:1.0:1789708518.217350:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1789708518.217365:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000040f8b330 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:3618:x1876645365421696:12345-0@lo:400: 00000020:00000080:1.0:1789708518.217374:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708518.217378:0:7428:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789708518.217380:0:6488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47c988 00000020:01000000:1.0:1789708518.217383:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1789708518.217384:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365421824 00000100:00100000:2.0:1789708518.217388:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365421824 00000020:00000080:1.0:1789708518.217391:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000004:00100000:0.0:1789708518.217391:0:6488:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:1.0:1789708518.217395:0:7428:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000001:00000004:0.0:1789708518.217398:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:00000080:1.0:1789708518.217403:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789708518.217406:0:7428:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789708518.217417:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000040f8b330 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:3618:x1876645365421696:12345-0@lo:400: Request processed in 55us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708518.217422:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708518.217427:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:01000000:1.0:1789708518.217430:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1789708518.217431:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000097663949 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365421824:12345-0@lo:400: 00000020:00000080:1.0:1789708518.217436:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708518.217440:0:7428:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789708518.217444:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1789708518.217473:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000097663949 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365421824:12345-0@lo:400: Request processed in 43us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708518.217485:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789708518.217488:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000091a00bdb x1876645365421824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708518.217499:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000091a00bdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365421824:0@lo:400: 00000100:00100000:2.0:1789708518.217522:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365421696:0@lo:400: 00000020:01000000:1.0:1789708518.217537:0:7413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1789708518.217575:0:7413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789708518.217593:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.217604:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708518.217612:0:7413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee36337800 from 1 10000000:01000000:1.0:1789708518.217616:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789708518.217638:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.217645:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.217653:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708518.217678:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f976a85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365421952:0@lo:101: 00000100:00100000:1.0:1789708518.217709:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708518.217745:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000548167c5 going to sleep for 11 seconds 00000100:00100000:2.0:1789708518.217749:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365421952 00000100:00100000:2.0:1789708518.217753:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365421952 00000100:00100000:2.0:1789708518.217782:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789708518.217789:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071648ca3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:7413:x1876645365421952:12345-0@lo:101: 00010000:00010000:2.0:1789708518.217798:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708518.217809:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c948378e/0xf45f43947e47c996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c98f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.217827:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c948378e/0xf45f43947e47c996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c98f expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.217836:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c948378e/0xf45f43947e47c996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c98f expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.217844:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c948378e, rc 0) 00000100:00100000:2.0:1789708518.217882:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071648ca3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:7413:x1876645365421952:12345-0@lo:101: Request processed in 95us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708518.217888:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789708518.217912:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f976a85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365421952:0@lo:101: 00010000:00010000:1.0:1789708518.217926:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.217935:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708518.218581:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f976a85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422080:0@lo:256: 00000100:00100000:1.0:1789708518.218615:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708518.218644:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000548167c5 going to sleep for 11 seconds 00000100:00100000:0.0:1789708518.218648:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365422080 00000100:00100000:0.0:1789708518.218653:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365422080 00000100:00100000:0.0:1789708518.218679:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789708518.218684:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f6034cbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:7413:x1876645365422080:12345-0@lo:256: 20000000:01000000:0.0:1789708518.218694:0:6478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789708518.218706:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789708518.218708:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789708518.218768:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f6034cbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:7413:x1876645365422080:12345-0@lo:256: Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708518.218773:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789708518.218777:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f976a85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422080:0@lo:256: 10000000:01000000:1.0:1789708518.219253:0:7413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789708518.219279:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.219285:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708518.219290:0:7413:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee36337800 from 1 10000000:01000000:1.0:1789708518.219292:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708518.219303:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.219307:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789708518.219431:0:6488:0:(import.c:65:import_set_state_nolock()) 00000000cabc5579 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708518.219474:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007c0bc502 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3614:x1876645365421568:12345-0@lo:38: Request processed in 2158us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708518.219487:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708518.219491:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708518.219497:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789708518.219502:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789708518.219505:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789708518.219507:0:3614:0:(import.c:65:import_set_state_nolock()) 000000004ceba052 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789708518.219516:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001911c687 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365421568:0@lo:38: 00000100:00100000:0.0:1789708518.219555:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708518.219562:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d8608c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365422336:0@lo:41: 00000100:00100000:0.0:1789708518.219585:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708518.219615:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365422336 00000100:00100000:3.0:1789708518.219620:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365422336 00000100:00100000:3.0:1789708518.219648:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708518.219652:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c8e4ea0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1876645365422336:12345-0@lo:41: 00000004:00000024:3.0:1789708518.219668:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789708518.219696:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c8e4ea0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1876645365422336:12345-0@lo:41: Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708518.219701:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708518.219719:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d8608c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365422336:0@lo:41: 00010000:00010000:1.0:1789708518.219825:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708518.219836:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f976a85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422208:0@lo:101: 00000100:00100000:1.0:1789708518.219861:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708518.219878:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000548167c5 going to sleep for 11 seconds 00000100:00100000:2.0:1789708518.219894:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365422208 00000100:00100000:2.0:1789708518.219898:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365422208 00000100:00100000:2.0:1789708518.219917:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789708518.219921:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b2829669 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:7413:x1876645365422208:12345-0@lo:101: 00010000:00010000:2.0:1789708518.219927:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708518.219933:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c9a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c99d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.219951:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c99d expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.219956:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c99d expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.219960:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000078e9cc5c, rc 0) 00000100:00100000:2.0:1789708518.219982:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b2829669 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:7413:x1876645365422208:12345-0@lo:101: Request processed in 61us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708518.219986:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789708518.220003:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f976a85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422208:0@lo:101: 00010000:00010000:1.0:1789708518.220015:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.220022:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708518.220078:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f976a85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422464:0@lo:501: 00000100:00100000:1.0:1789708518.220096:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708518.220109:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000548167c5 going to sleep for 11 seconds 00000100:00100000:0.0:1789708518.220122:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365422464 00000100:00100000:0.0:1789708518.220126:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365422464 00000100:00100000:0.0:1789708518.220144:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708518.220148:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008897a4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:7413:x1876645365422464:12345-0@lo:501: 00000100:00100000:0.0:1789708518.220224:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008897a4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:7413:x1876645365422464:12345-0@lo:501: Request processed in 76us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708518.220230:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789708518.220237:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f976a85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422464:0@lo:501: 00000100:00100000:1.0:1789708518.220291:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f976a85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422592:0@lo:503: 00000100:00100000:1.0:1789708518.220316:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708518.220331:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000548167c5 going to sleep for 11 seconds 00000100:00100000:2.0:1789708518.220350:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365422592 00000100:00100000:2.0:1789708518.220355:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365422592 00000100:00100000:2.0:1789708518.220379:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789708518.220386:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e85e3b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:7413:x1876645365422592:12345-0@lo:503: 00000040:00080000:2.0:1789708518.220422:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708518.220467:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e85e3b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:7413:x1876645365422592:12345-0@lo:503: Request processed in 81us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708518.220471:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f976a85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422592:0@lo:503: 00000100:00100000:2.0:1789708518.220478:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000040:00080000:1.0:1789708518.220669:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708518.220697:0:7413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1789708518.220750:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708518.221277:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1789708518.221337:0:7413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789708518.221365:0:7413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708518.221378:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.221387:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708518.221432:0:7413:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789708518.221435:0:7413:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bee36337800 10000000:01000000:0.0:1789708518.221438:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bee36337800 10000000:01000000:0.0:1789708518.221442:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789708518.221447:0:7413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee36337800 from 1 10000000:01000000:0.0:1789708518.221449:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789708518.221461:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.221467:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.221473:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708518.221484:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422720:0@lo:101: 00000100:00100000:0.0:1789708518.221508:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708518.221531:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a42949cf going to sleep for 11 seconds 00000100:00100000:3.0:1789708518.221542:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365422720 00000100:00100000:3.0:1789708518.221548:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365422720 00000100:00100000:3.0:1789708518.221576:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789708518.221583:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eacbe70d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:7413:x1876645365422720:12345-0@lo:101: 00010000:00010000:3.0:1789708518.221590:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708518.221598:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c9b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c9ab expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.221635:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c9ab expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.221643:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c9ab expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.221649:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd8cdc27, rc 0) 00000100:00100000:3.0:1789708518.221682:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eacbe70d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365422720:12345-0@lo:101: Request processed in 100us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708518.221688:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708518.221711:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422720:0@lo:101: 00010000:00010000:0.0:1789708518.221720:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.221727:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708518.221784:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422848:0@lo:501: 00000100:00100000:0.0:1789708518.221806:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708518.221823:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a42949cf going to sleep for 11 seconds 00000100:00100000:2.0:1789708518.221853:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365422848 00000100:00100000:2.0:1789708518.221858:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365422848 00000100:00100000:2.0:1789708518.221885:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789708518.221891:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf5aa14c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365422848:12345-0@lo:501: 00000100:00100000:2.0:1789708518.221963:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf5aa14c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365422848:12345-0@lo:501: Request processed in 73us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708518.221970:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789708518.221990:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422848:0@lo:501: 00000100:00100000:0.0:1789708518.222020:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422976:0@lo:503: 00000100:00100000:0.0:1789708518.222051:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708518.222067:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a42949cf going to sleep for 11 seconds 00000100:00100000:3.0:1789708518.222087:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365422976 00000100:00100000:3.0:1789708518.222093:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365422976 00000100:00100000:3.0:1789708518.222120:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708518.222127:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000032539e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365422976:12345-0@lo:503: 00000100:00100000:3.0:1789708518.222222:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000032539e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365422976:12345-0@lo:503: Request processed in 96us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708518.222229:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789708518.222246:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365422976:0@lo:503: 00000040:00080000:0.0:1789708518.222434:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708518.222478:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365423104:0@lo:502: 00000100:00100000:0.0:1789708518.222507:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708518.222530:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a42949cf going to sleep for 11 seconds 00000100:00100000:2.0:1789708518.222541:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365423104 00000100:00100000:2.0:1789708518.222545:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365423104 00000100:00100000:2.0:1789708518.222568:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789708518.222571:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c5eacdef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365423104:12345-0@lo:502: 00000100:00100000:2.0:1789708518.222644:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c5eacdef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365423104:12345-0@lo:502: Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708518.222648:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789708518.222673:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365423104:0@lo:502: 00000040:00080000:0.0:1789708518.222832:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789708518.222853:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789708518.222866:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789708518.222880:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789708518.222891:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789708518.222901:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789708518.222912:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789708518.222932:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789708518.222942:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789708518.222953:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789708518.222964:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789708518.222974:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789708518.222985:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789708518.222995:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789708518.223006:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789708518.223016:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789708518.223027:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789708518.223038:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789708518.223049:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789708518.223063:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789708518.223077:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789708518.223088:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789708518.223099:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789708518.223111:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789708518.223134:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789708518.223150:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789708518.223180:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789708518.223191:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1789708518.223206:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365423232:0@lo:502: 00000100:00100000:0.0:1789708518.223236:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708518.223252:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a42949cf going to sleep for 11 seconds 00000100:00100000:3.0:1789708518.223279:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365423232 00000100:00100000:3.0:1789708518.223283:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365423232 00000100:00100000:3.0:1789708518.223304:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789708518.223308:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f6ffd278 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365423232:12345-0@lo:502: 00000100:00100000:3.0:1789708518.223363:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f6ffd278 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365423232:12345-0@lo:502: Request processed in 54us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708518.223369:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789708518.223384:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365423232:0@lo:502: 00000040:00080000:0.0:1789708518.223419:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789708518.223426:0:7413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789708518.223732:0:7434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789708518.223749:0:7434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000003914e3a7) 00000020:00000080:0.0:1789708518.223764:0:7434:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789708518.223865:0:7434:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f105e6d0 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789708518.223872:0:7434:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f105e6d0 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789708518.223874:0:7434:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f105e6d0 3 00010000:00080000:0.0:1789708518.223898:0:7434:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000750fd679@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1789708518.225364:0:7434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1789708518.225519:0:7434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789708518.225545:0:7434:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789708518.225553:0:7434:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf45f43947e47c9c0 00000100:00080000:0.0:1789708518.225558:0:7434:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708518.225565:0:7434:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000750fd679 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708518.225585:0:7434:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006972f8d4 x1876645365423360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708518.225606:0:7434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789708518.225623:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365423360:0@lo:38: 00000100:00100000:1.0:1789708518.225663:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708518.225699:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365423360 00000100:00100000:0.0:1789708518.225705:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365423360 00000100:00100000:0.0:1789708518.225748:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708518.225754:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f976a85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365423360:12345-0@lo:38: 00010000:00080000:0.0:1789708518.225771:0:6483:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 89 last 0 00000020:00000080:0.0:1789708518.225815:0:6483:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf45f43947e47c9c7 00000004:00100000:0.0:1789708518.225829:0:6483:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000040:00080000:2.0:1789708518.225835:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1789708518.225847:0:7435:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00080000:0.0:1789708518.225856:0:6483:0:(import.c:65:import_set_state_nolock()) 00000000ace924fd : changing import state from RECOVER to FULL 00000020:01000000:1.0:1789708518.225912:0:7413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000100:00100000:0.0:1789708518.225916:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f976a85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876645365423360:12345-0@lo:38: Request processed in 161us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708518.225925:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:1.0:1789708518.225948:0:7413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789708518.225959:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708518.225966:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789708518.226000:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789708518.226002:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789708518.226003:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708518.226003:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708518.226004:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708518.226005:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708518.226006:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708518.226007:0:7413:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708518.226008:0:7413:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708518.226008:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708518.226009:0:7413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708518.226012:0:7413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1789708518.226013:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708518.226014:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789708518.226015:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708518.226015:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708518.226016:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708518.226016:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708518.226017:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708518.226017:0:7413:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708518.226018:0:7413:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708518.226018:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708518.226019:0:7413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708518.226037:0:7413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789708518.226044:0:7413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069587c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365423488:0@lo:253: 00000100:00100000:1.0:1789708518.226095:0:7413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708518.226118:0:7413:0:(client.c:2716:ptlrpc_set_wait()) set 00000000913c9dc7 going to sleep for 11 seconds 00000100:00100000:2.0:1789708518.226135:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365423488 00010000:00080000:1.0:1789708518.226140:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006972f8d4 x1876645365423360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708518.226141:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365423488 00000100:00100000:1.0:1789708518.226149:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708518.226167:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789708518.226174:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789708518.226176:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789708518.226178:0:3614:0:(import.c:65:import_set_state_nolock()) 00000000750fd679 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789708518.226183:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006972f8d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365423360:0@lo:38: 00000100:00100000:2.0:1789708518.226189:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789708518.226197:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cede6f12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365423488:12345-0@lo:253: 20000000:01000000:2.0:1789708518.226222:0:6479:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789708518.226234:0:6479:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789708518.227032:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789708518.227072:0:6479:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789708518.227085:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789708518.227097:0:6499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789708518.227101:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789708518.227112:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.227121:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c948378e/0xf45f43947e47c996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c98f expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.227126:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.227146:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c948378e/0xf45f43947e47c996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c98f expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.227166:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c948378e/0xf45f43947e47c996 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c98f expref: 14 pid: 6479 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.227182:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365423616:0@lo:104: 00000100:00100000:2.0:1789708518.227206:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.227227:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6090d9e going to sleep for 11 seconds 00000100:00100000:3.0:1789708518.227252:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365423616 00000100:00100000:3.0:1789708518.227289:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365423616 00000100:00100000:1.0:1789708518.227296:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cede6f12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:7413:x1876645365423488:12345-0@lo:253: Request processed in 1101us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708518.227304:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789708518.227328:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708518.227342:0:7413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069587c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7413:1876645365423488:0@lo:253: 00000100:00100000:3.0:1789708518.227351:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098a187a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6499:x1876645365423616:12345-0@lo:104: 10000000:01000000:1.0:1789708518.227352:0:7413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789708518.227356:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789708518.227358:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789708518.227359:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708518.227360:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708518.227360:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708518.227361:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708518.227362:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708518.227363:0:7413:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708518.227363:0:7413:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708518.227364:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708518.227365:0:7413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1789708518.227366:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1789708518.227379:0:7413:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789708518.227427:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789708518.227428:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365423616:0@lo:104: 00010000:00010000:0.0:1789708518.227435:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789708518.227440:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098a187a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6499:x1876645365423616:12345-0@lo:104: Request processed in 93us (230us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708518.227443:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.227444:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708518.227456:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789708518.227465:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005da715f7 already unused, calling callback (000000009f7eade9) 10000000:00010000:0.0:1789708518.227473:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.227481:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708518.227488:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708518.227493:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708518.227518:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.227525:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708518.227543:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708518.227550:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 000000005da715f7/0xf45f43947e47c98f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c996 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708518.227557:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b458d590 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365423744:0@lo:103: 00010000:00010000:0.0:1789708518.227566:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708518.227569:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708518.227572:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708518.227584:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708518.227621:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365423744 00000100:00100000:3.0:1789708518.227626:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365423744 00010000:00010000:3.0:1789708518.227645:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c948378e/0xf45f43947e47c996 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c98f expref: 14 pid: 6479 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708518.227676:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708518.227686:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073000d4b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:3617:x1876645365423744:12345-0@lo:103: 00010000:00010000:3.0:1789708518.227696:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708518.227701:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c948378e/0xf45f43947e47c996 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c98f expref: 14 pid: 6479 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227712:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c948378e/0xf45f43947e47c996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c98f expref: 14 pid: 6479 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227725:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c948378e/0xf45f43947e47c996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c98f expref: 14 pid: 6479 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227736:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227743:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789708518.227766:0:6471:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000670418s 00010000:00010000:3.0:1789708518.227769:0:6471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227774:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227780:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227785:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227790:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009cca0796 already unused, calling callback (0000000020c8a59f) 00010000:00010000:3.0:1789708518.227793:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227800:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227818:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708518.227828:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708518.227849:0:6499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708518.227858:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708518.227865:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073000d4b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:3617:x1876645365423744:12345-0@lo:103: Request processed in 180us (278us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708518.227867:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009cca0796/0xf45f43947e47c9ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708518.227879:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708518.227903:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b458d590 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365423744:0@lo:103: 00080000:10000000:1.0:1789708518.229759:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1789708518.229946:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789708518.230130:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789708518.230318:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789708518.230476:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789708518.230580:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789708518.230899:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789708518.231040:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789708518.231166:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789708518.231317:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789708518.231435:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789708518.231551:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1789708518.232211:0:7413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789708518.232213:0:7439:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789708518.232223:0:7439:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789708518.232679:0:7440:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789708518.232691:0:7413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1789708518.232717:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000636543a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7440:1876645365423872:0@lo:700: 00000100:00100000:3.0:1789708518.232761:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708518.232803:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365423872 00000100:00100000:3.0:1789708518.232810:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf248302 going to sleep for 11 seconds 00000100:00100000:1.0:1789708518.232810:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365423872 00000100:00100000:1.0:1789708518.232848:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708518.232855:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000291d7e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7440:x1876645365423872:12345-0@lo:700: 00000100:00100000:2.0:1789708518.232928:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027f084e9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7441:1876645365424000:0@lo:1000: 00000100:00100000:2.0:1789708518.232975:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.233008:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5185105 going to sleep for 11 seconds 00000100:00100000:0.0:1789708518.233011:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365424000 00000100:00100000:0.0:1789708518.233017:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365424000 00000100:00100000:0.0:1789708518.233052:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708518.233061:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aa0bca98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7441:x1876645365424000:12345-0@lo:1000: 00000100:00100000:0.0:1789708518.233129:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aa0bca98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7441:x1876645365424000:12345-0@lo:1000: Request processed in 69us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708518.233137:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:3.0:1789708518.233140:0:7413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1789708518.233152:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027f084e9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7441:1876645365424000:0@lo:1000: 00000040:01000000:2.0:1789708518.233191:0:7441:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789708518.233207:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027f084e9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7441:1876645365424128:0@lo:700: 00000100:00100000:2.0:1789708518.233229:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.233244:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004728f1cf going to sleep for 11 seconds 00000100:00100000:0.0:1789708518.233280:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365424128 00000100:00100000:0.0:1789708518.233290:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365424128 00000040:00080000:3.0:1789708518.233319:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708518.233323:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708518.233327:0:6493:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:0.0:1789708518.233332:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a877b3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7441:x1876645365424128:12345-0@lo:700: 00000100:00100000:2.0:1789708518.233333:0:6493:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:0.0:1789708518.233380:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a877b3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7441:x1876645365424128:12345-0@lo:700: Request processed in 49us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708518.233387:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708518.233390:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027f084e9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7441:1876645365424128:0@lo:700: 00000100:00100000:2.0:1789708518.233430:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027f084e9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7441:1876645365424256:0@lo:900: 00000100:00100000:2.0:1789708518.233456:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.233471:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004728f1cf going to sleep for 11 seconds 00000100:00100000:1.0:1789708518.233481:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365424256 00000100:00100000:1.0:1789708518.233486:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365424256 00000100:00100000:1.0:1789708518.233508:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708518.233512:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000526881e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7441:x1876645365424256:12345-0@lo:900: 00000100:00100000:1.0:1789708518.233548:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000526881e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7441:x1876645365424256:12345-0@lo:900: Request processed in 35us (90us total) trans 0 rc 0/0 00010000:00080000:2.0:1789708518.233554:0:7441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000027f084e9 x1876645365424256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789708534 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708518.233555:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708518.233565:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027f084e9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7441:1876645365424256:0@lo:900: 00000100:00100000:2.0:1789708518.233607:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027f084e9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7441:1876645365424384:0@lo:1000: 00000100:00100000:2.0:1789708518.233629:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.233642:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025580dcf going to sleep for 11 seconds 00000100:00100000:1.0:1789708518.233650:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365424384 00000100:00100000:1.0:1789708518.233653:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365424384 00000100:00100000:1.0:1789708518.233670:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708518.233674:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bebb95f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7441:x1876645365424384:12345-0@lo:1000: 00000100:00100000:1.0:1789708518.233731:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bebb95f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7441:x1876645365424384:12345-0@lo:1000: Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708518.233737:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708518.233749:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027f084e9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7441:1876645365424384:0@lo:1000: 00000004:00080000:2.0:1789708518.233788:0:7441:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000004728f1cf with version 0 00000004:00000080:3.0:1789708518.233799:0:7413:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000020:00100000:2.0:1789708518.233800:0:7441:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789708518.233805:0:7441:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000027f084e9 x1876645365424640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:3.0:1789708518.233808:0:7413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1789708518.233821:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027f084e9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7441:1876645365424640:0@lo:1000: 00000100:00100000:2.0:1789708518.233847:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708518.233862:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dcd3a6bf going to sleep for 11 seconds 00000100:00100000:0.0:1789708518.233868:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365424640 00000100:00100000:0.0:1789708518.233873:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365424640 00000100:00100000:0.0:1789708518.233905:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708518.233913:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004127b8c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7441:x1876645365424640:12345-0@lo:1000: 00000040:00080000:3.0:1789708518.233921:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:0.0:1789708518.234355:0:6490:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:3.0:1789708518.234777:0:7413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789708518.235288:0:7413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789708518.235319:0:7413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789708518.235408:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789708518.235678:0:7413:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789708518.236077:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789708518.236192:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789708518.236347:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789708518.236485:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789708518.236644:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789708518.236848:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789708518.236981:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789708518.237110:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789708518.237301:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789708518.237431:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789708518.237566:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789708518.237686:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000100:00100000:0.0:1789708518.237776:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000291d7e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7440:x1876645365423872:12345-0@lo:700: Request processed in 4920us (5015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708518.237788:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789708518.237793:0:7440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000636543a4 x1876645365423872/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789708534 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708518.237802:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000636543a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7440:1876645365423872:0@lo:700: 40000000:02000000:2.0:1789708518.237809:0:7440:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:3.0:1789708518.237886:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789708518.238017:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789708518.238140:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789708518.238342:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000001:00080000:1.0:1789708518.238414:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1789708518.238472:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004127b8c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7441:x1876645365424640:12345-0@lo:1000: Request processed in 4560us (4623us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789708518.238478:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1789708518.238507:0:7441:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789708518.238514:0:7441:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789708518.238524:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027f084e9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7441:1876645365424640:0@lo:1000: 00100000:10000000:3.0:1789708518.238579:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:1.0:1789708518.238586:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069587c7f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7441:1876645365424768:0@lo:1000: 00000100:00100000:1.0:1789708518.238618:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708518.238639:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365424768 00000100:00100000:1.0:1789708518.238642:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365424768 00000100:00100000:1.0:1789708518.238670:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708518.238677:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006426929e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7441:x1876645365424768:12345-0@lo:1000: 00100000:10000000:3.0:1789708518.238709:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000100:00100000:1.0:1789708518.238715:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006426929e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7441:x1876645365424768:12345-0@lo:1000: Request processed in 41us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708518.238719:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708518.238740:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000007987dc7c going to sleep for 11 seconds 00000100:00100000:1.0:1789708518.238749:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069587c7f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7441:1876645365424768:0@lo:1000: 00000040:00080000:1.0:1789708518.238769:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789708518.238788:0:7441:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000791a9a66 with version 1 00000004:00080000:0.0:1789708518.238819:0:7431:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000005d83194e version 1 rpc_version 1 00000020:00100000:0.0:1789708518.238836:0:7431:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789708518.238840:0:7431:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006d4e8e9d x1876645365425024/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708518.238854:0:7431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d4e8e9d pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7431:1876645365425024:0@lo:1000: 00100000:10000000:3.0:1789708518.238884:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000100:00100000:0.0:1789708518.238889:0:7431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708518.238906:0:7431:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a796b234 going to sleep for 11 seconds 00000100:00100000:0.0:1789708518.238919:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365425024 00000100:00100000:0.0:1789708518.238923:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365425024 00000100:00100000:0.0:1789708518.238953:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708518.238960:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ed2bd9f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7431:x1876645365425024:12345-0@lo:1000: 00100000:10000000:3.0:1789708518.239063:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789708518.239205:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789708518.239360:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789708518.239495:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789708518.239684:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789708518.239852:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789708518.239981:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789708518.240099:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789708518.240340:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000040:00080000:1.0:1789708518.240657:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789708518.240695:0:7441:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:1.0:1789708518.241257:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1789708518.241375:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ed2bd9f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7431:x1876645365425024:12345-0@lo:1000: Request processed in 2414us (2485us total) trans 4294967298 rc 0/0 00000004:00080000:1.0:1789708518.241387:0:7431:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789708518.241390:0:7431:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789708518.241393:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708518.241402:0:7431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d4e8e9d pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7431:1876645365425024:0@lo:1000: 00100000:10000000:3.0:1789708518.241485:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789708518.241597:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789708518.241745:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789708518.241896:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789708518.242143:0:7413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789708518.245186:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789708518.245203:0:7413:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789708518.245223:0:7413:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbde281953988 00100000:10000000:3.0:1789708518.245227:0:7413:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789708518.245448:0:7413:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789708518.245470:0:7413:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789708518.245505:0:7413:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789708518.245516:0:7413:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789708518.246217:0:7413:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708518.246415:0:7413:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1789708518.255089:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789708518.255174:0:7440:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789708518.255179:0:7440:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1789708519.014343:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789708519.456993:0:7686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1789708519.770909:0:7738:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708519.771059:0:7738:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789708519.974323:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708519.974330:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee36337800 from 4 10000000:01000000:3.0:1789708519.974335:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708519.974380:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000e630d92b/0xf45f43947e47c9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708519.974389:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000e630d92b/0xf45f43947e47c9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708519.974396:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000e630d92b/0xf45f43947e47c9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708519.974413:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365425152:0@lo:101: 00000100:00100000:3.0:1789708519.974461:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708519.974500:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094558fa0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708519.974501:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365425152 00000100:00100000:0.0:1789708519.974510:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365425152 00000100:00100000:0.0:1789708519.974549:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789708519.974556:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008e860a03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:6481:x1876645365425152:12345-0@lo:101: 00010000:00010000:0.0:1789708519.974568:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708519.974577:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029207aeb/0xf45f43947e47c9dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c9d5 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.974594:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029207aeb/0xf45f43947e47c9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c9d5 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.974601:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029207aeb/0xf45f43947e47c9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c9d5 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.974606:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029207aeb, rc 0) 00000100:00100000:0.0:1789708519.974640:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008e860a03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:6481:x1876645365425152:12345-0@lo:101: Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708519.974644:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789708519.974667:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365425152:0@lo:101: 00010000:00010000:3.0:1789708519.974679:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000e630d92b/0xf45f43947e47c9d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708519.974686:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000e630d92b/0xf45f43947e47c9d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708519.974718:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365425280:0@lo:256: 00000100:00100000:3.0:1789708519.974739:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708519.974752:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094558fa0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708519.974768:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365425280 00000100:00100000:1.0:1789708519.974774:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365425280 00000100:00100000:1.0:1789708519.974799:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789708519.974811:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bda8ac4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:6481:x1876645365425280:12345-0@lo:256: 20000000:01000000:1.0:1789708519.974824:0:6479:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789708519.974836:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789708519.974838:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789708519.974902:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bda8ac4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:6481:x1876645365425280:12345-0@lo:256: Request processed in 92us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.974907:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789708519.974918:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365425280:0@lo:256: 10000000:01000000:3.0:1789708519.974952:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708519.974956:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000e630d92b/0xf45f43947e47c9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708519.974961:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000e630d92b/0xf45f43947e47c9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708519.974970:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789708519.974971:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee02bf3800 from 21 10000000:01000000:3.0:1789708519.974972:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789708519.974982:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708519.974986:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708519.974989:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708519.974995:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365425408:0@lo:101: 00000100:00100000:3.0:1789708519.975012:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708519.975024:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094558fa0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708519.975043:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365425408 00000100:00100000:0.0:1789708519.975047:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365425408 00000100:00100000:0.0:1789708519.975067:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789708519.975071:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004353d926 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:6481:x1876645365425408:12345-0@lo:101: 00010000:00010000:0.0:1789708519.975081:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708519.975087:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d01d7be/0xf45f43947e47c9ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c9e3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.975096:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d01d7be/0xf45f43947e47c9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c9e3 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.975101:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d01d7be/0xf45f43947e47c9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c9e3 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.975104:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d01d7be, rc 0) 00000100:00100000:0.0:1789708519.975138:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004353d926 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365425408:12345-0@lo:101: Request processed in 67us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708519.975142:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708519.975161:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365425408:0@lo:101: 00010000:00010000:3.0:1789708519.975170:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708519.975175:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708519.975209:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365425536:0@lo:501: 00000100:00100000:3.0:1789708519.975224:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708519.975236:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094558fa0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708519.975252:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365425536 00000100:00100000:1.0:1789708519.975255:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365425536 00000100:00100000:1.0:1789708519.975293:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789708519.975297:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdf6478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365425536:12345-0@lo:501: 00000100:00100000:1.0:1789708519.975380:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdf6478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365425536:12345-0@lo:501: Request processed in 83us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.975384:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789708519.975402:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365425536:0@lo:501: 00000100:00100000:3.0:1789708519.975430:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365425664:0@lo:503: 00000100:00100000:3.0:1789708519.975461:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708519.975478:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094558fa0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708519.975489:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365425664 00000100:00100000:0.0:1789708519.975493:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365425664 00000100:00100000:0.0:1789708519.975512:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789708519.975516:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002920d9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365425664:12345-0@lo:503: 00000100:00100000:0.0:1789708519.975597:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002920d9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365425664:12345-0@lo:503: Request processed in 81us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708519.975606:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789708519.975621:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365425664:0@lo:503: 00000100:00100000:3.0:1789708519.975844:0:7769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7769:1876645365425792:0@lo:502: 00000100:00100000:3.0:1789708519.975867:0:7769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708519.975884:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365425792 00000100:00100000:3.0:1789708519.975885:0:7769:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054ff1d85 going to sleep for 11 seconds 00000100:00100000:1.0:1789708519.975888:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365425792 00000100:00100000:1.0:1789708519.975910:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789708519.975913:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f874fa6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:7769:x1876645365425792:12345-0@lo:502: 00000100:00100000:1.0:1789708519.975976:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f874fa6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:7769:x1876645365425792:12345-0@lo:502: Request processed in 63us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.975982:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789708519.975995:0:7769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7769:1876645365425792:0@lo:502: 00000100:00100000:3.0:1789708519.976028:0:7769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7769:1876645365425920:0@lo:502: 00000100:00100000:3.0:1789708519.976051:0:7769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708519.976063:0:7769:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054ff1d85 going to sleep for 11 seconds 00000100:00100000:0.0:1789708519.976072:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365425920 00000100:00100000:0.0:1789708519.976077:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365425920 00000100:00100000:0.0:1789708519.976105:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789708519.976113:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab3d3df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:7769:x1876645365425920:12345-0@lo:502: 00000100:00100000:0.0:1789708519.976188:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab3d3df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:7769:x1876645365425920:12345-0@lo:502: Request processed in 75us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708519.976193:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789708519.976201:0:7769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7769:1876645365425920:0@lo:502: 00000040:00080000:3.0:1789708519.976221:0:7769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789708519.976276:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789708519.976300:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708519.976304:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.976310:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708519.976316:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789708519.976317:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee02bf3800 from 3 10000000:01000000:0.0:1789708519.976319:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789708519.976329:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000e377ce18/0xf45f43947e47c9f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.976333:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000e377ce18/0xf45f43947e47c9f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.976337:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000e377ce18/0xf45f43947e47c9f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708519.976344:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365426048:0@lo:101: 00000100:00100000:0.0:1789708519.976362:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708519.976382:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365426048 00000100:00100000:0.0:1789708519.976385:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e44a2632 going to sleep for 11 seconds 00000100:00100000:1.0:1789708519.976386:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365426048 00000100:00100000:1.0:1789708519.976407:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789708519.976412:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ae09fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365426048:12345-0@lo:101: 00010000:00010000:1.0:1789708519.976417:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708519.976422:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000023689244/0xf45f43947e47c9f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c9f1 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708519.976436:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000023689244/0xf45f43947e47c9f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c9f1 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708519.976441:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000023689244/0xf45f43947e47c9f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c9f1 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708519.976445:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000023689244, rc 0) 00000100:00100000:1.0:1789708519.976468:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ae09fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365426048:12345-0@lo:101: Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.976473:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789708519.976483:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365426048:0@lo:101: 00010000:00010000:0.0:1789708519.976491:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000e377ce18/0xf45f43947e47c9f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.976496:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000e377ce18/0xf45f43947e47c9f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708519.976528:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365426176:0@lo:256: 00000100:00100000:0.0:1789708519.976547:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708519.976560:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e44a2632 going to sleep for 11 seconds 00000100:00100000:3.0:1789708519.976576:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365426176 00000100:00100000:3.0:1789708519.976581:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365426176 00000100:00100000:3.0:1789708519.976602:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789708519.976607:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a6c7a3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365426176:12345-0@lo:256: 20000000:01000000:3.0:1789708519.976615:0:6478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789708519.976623:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789708519.976625:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1789708519.976626:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:3.0:1789708519.976695:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a6c7a3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365426176:12345-0@lo:256: Request processed in 87us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708519.976701:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365426176:0@lo:256: 00000100:00100000:3.0:1789708519.976706:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 10000000:01000000:0.0:1789708519.976734:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789708519.976737:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000e377ce18/0xf45f43947e47c9f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.976741:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000e377ce18/0xf45f43947e47c9f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708519.976745:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789708519.976746:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789708519.976747:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789708519.976756:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.976759:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.976763:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708519.976769:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365426304:0@lo:101: 00000100:00100000:0.0:1789708519.976785:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708519.976796:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e44a2632 going to sleep for 11 seconds 00000100:00100000:1.0:1789708519.976811:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365426304 00000100:00100000:1.0:1789708519.976814:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365426304 00000100:00100000:1.0:1789708519.976831:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789708519.976836:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fba1b3be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365426304:12345-0@lo:101: 00010000:00010000:1.0:1789708519.976841:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708519.976846:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005da715f7/0xf45f43947e47ca06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47c9ff expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708519.976854:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005da715f7/0xf45f43947e47ca06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47c9ff expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708519.976858:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005da715f7/0xf45f43947e47ca06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c9ff expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708519.976862:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005da715f7, rc 0) 00000100:00100000:1.0:1789708519.976884:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fba1b3be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365426304:12345-0@lo:101: Request processed in 48us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.976888:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789708519.976894:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365426304:0@lo:101: 00010000:00010000:0.0:1789708519.976909:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.976914:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708519.976940:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365426432:0@lo:501: 00000100:00100000:0.0:1789708519.976957:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708519.976968:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e44a2632 going to sleep for 11 seconds 00000100:00100000:3.0:1789708519.976983:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365426432 00000100:00100000:3.0:1789708519.976987:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365426432 00000100:00100000:3.0:1789708519.977006:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789708519.977016:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a73bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365426432:12345-0@lo:501: 00000100:00100000:3.0:1789708519.977071:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a73bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365426432:12345-0@lo:501: Request processed in 55us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708519.977076:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789708519.977081:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365426432:0@lo:501: 00000100:00100000:0.0:1789708519.977107:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365426560:0@lo:503: 00000100:00100000:0.0:1789708519.977143:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708519.977154:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e44a2632 going to sleep for 11 seconds 00000100:00100000:1.0:1789708519.977168:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365426560 00000100:00100000:1.0:1789708519.977172:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365426560 00000100:00100000:1.0:1789708519.977190:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789708519.977195:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060d9991e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365426560:12345-0@lo:503: 00000100:00100000:1.0:1789708519.977250:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060d9991e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365426560:12345-0@lo:503: Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.977255:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789708519.977274:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365426560:0@lo:503: 00000100:00100000:3.0:1789708519.977413:0:7770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7770:1876645365426688:0@lo:502: 00000100:00100000:3.0:1789708519.977437:0:7770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708519.977460:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365426688 00000100:00100000:3.0:1789708519.977462:0:7770:0:(client.c:2716:ptlrpc_set_wait()) set 00000000874db5d9 going to sleep for 11 seconds 00000100:00100000:0.0:1789708519.977464:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365426688 00000100:00100000:0.0:1789708519.977487:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789708519.977491:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000638eeb24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:7770:x1876645365426688:12345-0@lo:502: 00000100:00100000:0.0:1789708519.977552:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000638eeb24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:7770:x1876645365426688:12345-0@lo:502: Request processed in 60us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708519.977558:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789708519.977571:0:7770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bb2c988 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7770:1876645365426688:0@lo:502: 00000020:01000000:3.0:1789708519.977592:0:7770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708519.977598:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708519.977599:0:7770:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789708519.977602:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789708519.977604:0:7770:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:00000080:3.0:1789708519.977618:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789708519.977628:0:7770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000750cdd52) 00000020:00000080:3.0:1789708519.977639:0:7770:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1789708519.977642:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789708519.977703:0:7770:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789708519.977707:0:7770:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789708519.977711:0:7770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47ca14 00010000:00080000:3.0:1789708519.977730:0:7770:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000070819695@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789708519.978872:0:7770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789708519.979399:0:7770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708519.979404:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789708519.979426:0:7770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789708519.979437:0:7770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ca1b 00000100:00080000:1.0:1789708519.979442:0:7770:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708519.979447:0:7770:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000070819695 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708519.979463:0:7770:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000069587c7f x1876645365426816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708519.979480:0:7770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789708519.979505:0:7770:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789708519.979506:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069587c7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365426816:0@lo:38: 00000100:00100000:3.0:1789708519.979552:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365426944:0@lo:400: 00000100:00100000:2.0:1789708519.979553:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708519.979570:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708519.979581:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071dc6e3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365427200:0@lo:400: 00000100:00100000:3.0:1789708519.979588:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708519.979613:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365426944 00000100:00100000:1.0:1789708519.979618:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708519.979621:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365426944 00000100:00100000:3.0:1789708519.979636:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365427200 00000100:00100000:1.0:1789708519.979640:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069bb1404 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365427072:0@lo:400: 00000100:00100000:3.0:1789708519.979641:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365427200 00000100:00100000:2.0:1789708519.979659:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708519.979664:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708519.979670:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006bb2c988 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365426944:12345-0@lo:400: 00000100:00100000:3.0:1789708519.979681:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708519.979690:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e84694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365427200:12345-0@lo:400: 00000100:00100000:1.0:1789708519.979698:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365426816 00000100:00100000:0.0:1789708519.979699:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365427072 00000100:00100000:1.0:1789708519.979703:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365426816 00000100:00100000:0.0:1789708519.979705:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365427072 00000100:00100000:1.0:1789708519.979722:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708519.979727:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006bb2c988 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365426944:12345-0@lo:400: Request processed in 58us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.979732:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df28eb96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365426816:12345-0@lo:38: 00000100:00100000:2.0:1789708519.979741:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708519.979745:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e84694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365427200:12345-0@lo:400: Request processed in 56us (129us total) trans 0 rc 0/0 00010000:00080000:1.0:1789708519.979750:0:6489:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 90 last 0 00000100:00100000:3.0:1789708519.979754:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789708519.979780:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e76971bb x1876645365426944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1789708519.979782:0:6489:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ca22 00000100:00100000:2.0:1789708519.979794:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e76971bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365426944:0@lo:400: 00000004:00100000:1.0:1789708519.979794:0:6489:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789708519.979801:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:1.0:1789708519.979857:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000071dc6e3f x1876645365427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708519.979864:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071dc6e3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365427200:0@lo:400: 00000020:01000000:1.0:1789708519.979944:0:7770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708519.979947:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708519.979948:0:7770:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789708519.979950:0:7770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708519.979953:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708519.979954:0:7770:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789708519.979956:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789708519.979958:0:7770:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00080000:0.0:1789708519.979961:0:7773:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000003eba0c55 x1876645365427328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708519.979968:0:7773:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7e92e93 going to sleep for 0 seconds 00000100:00100000:1.0:1789708519.979973:0:7770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036cd204e pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7770:1876645365427456:0@lo:502: 00000100:00100000:1.0:1789708519.980005:0:7770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708519.980017:0:7770:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edb6fec4 going to sleep for 11 seconds 00000100:00100000:2.0:1789708519.980046:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365427456 00000100:00100000:2.0:1789708519.980050:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365427456 00000100:00100000:2.0:1789708519.980069:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789708519.980073:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000596229f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:7770:x1876645365427456:12345-0@lo:502: 00000100:00100000:2.0:1789708519.980155:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000596229f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:7770:x1876645365427456:12345-0@lo:502: Request processed in 81us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708519.980164:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789708519.980173:0:7770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036cd204e pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:7770:1876645365427456:0@lo:502: 00000020:01000000:1.0:1789708519.980194:0:7770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708519.980197:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708519.980198:0:7770:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789708519.980200:0:7770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789708519.980253:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789708519.980287:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789708519.980290:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.980296:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708519.980301:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789708519.980302:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bee18160000 from 1 10000000:01000000:0.0:1789708519.980303:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789708519.980313:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.980317:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.980321:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708519.980327:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e4431e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365427584:0@lo:101: 00000100:00100000:0.0:1789708519.980345:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708519.980365:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365427584 00000100:00100000:0.0:1789708519.980367:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b272ae3 going to sleep for 11 seconds 00000100:00100000:3.0:1789708519.980369:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365427584 00000100:00100000:3.0:1789708519.980393:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789708519.980398:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022416613 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365427584:12345-0@lo:101: 00010000:00010000:3.0:1789708519.980403:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708519.980409:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000003bc17f1/0xf45f43947e47ca30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ca29 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708519.980419:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003bc17f1/0xf45f43947e47ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ca29 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708519.980424:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000003bc17f1/0xf45f43947e47ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ca29 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708519.980428:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000003bc17f1, rc 0) 00000100:00100000:3.0:1789708519.980450:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022416613 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365427584:12345-0@lo:101: Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708519.980454:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708519.980477:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e4431e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365427584:0@lo:101: 00010000:00010000:0.0:1789708519.980484:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.980488:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708519.980521:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e4431e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365427712:0@lo:501: 00000100:00100000:0.0:1789708519.980536:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708519.980551:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b272ae3 going to sleep for 11 seconds 00000100:00100000:2.0:1789708519.980574:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365427712 00000100:00100000:2.0:1789708519.980578:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365427712 00000100:00100000:2.0:1789708519.980600:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789708519.980606:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec2b6379 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365427712:12345-0@lo:501: 00000100:00100000:2.0:1789708519.980651:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec2b6379 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365427712:12345-0@lo:501: Request processed in 45us (112us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708519.980657:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789708519.980680:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e4431e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365427712:0@lo:501: 10000000:01000000:0.0:1789708519.980698:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789708519.980702:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708519.980706:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789708519.984176:0:6489:0:(import.c:65:import_set_state_nolock()) 0000000079f2c797 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708519.984217:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df28eb96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1876645365426816:12345-0@lo:38: Request processed in 4487us (4668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.984223:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708519.984240:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708519.984246:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1789708519.984246:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a7d5735 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365427072:12345-0@lo:400: 00000100:00080000:2.0:1789708519.984253:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789708519.984282:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789708519.984288:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789708519.984291:0:3614:0:(import.c:65:import_set_state_nolock()) 0000000070819695 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789708519.984307:0:3614:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b7e92e93): req@000000003eba0c55 x1876645365427328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708519.984316:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a7d5735 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365427072:12345-0@lo:400: Request processed in 69us (4650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.984323:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708519.984328:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069587c7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365426816:0@lo:38: 00000100:00100000:2.0:1789708519.984355:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708519.984363:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e4431e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365427840:0@lo:41: 00000100:00100000:1.0:1789708519.984371:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069bb1404 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365427072:0@lo:400: 00000100:00100000:2.0:1789708519.984394:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708519.984409:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365427840 00000100:00100000:0.0:1789708519.984413:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365427840 00000100:00100000:1.0:1789708519.984421:0:7773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708519.984442:0:7773:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7e92e93 going to sleep for 11 seconds 00000100:00100000:0.0:1789708519.984443:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365427328 00000100:00100000:0.0:1789708519.984448:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365427328 00000100:00100000:3.0:1789708519.984456:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708519.984465:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009bc5ed8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3618:x1876645365427840:12345-0@lo:41: 00000004:00000024:3.0:1789708519.984481:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789708519.984511:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009bc5ed8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3618:x1876645365427840:12345-0@lo:41: Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708519.984515:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708519.984527:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708519.984538:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036cd204e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7773:x1876645365427328:12345-0@lo:1000: 00000100:00100000:2.0:1789708519.984544:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e4431e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365427840:0@lo:41: 00000100:00100000:3.0:1789708519.984584:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036cd204e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7773:x1876645365427328:12345-0@lo:1000: Request processed in 47us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708519.984588:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708519.984610:0:7773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003eba0c55 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365427328:0@lo:1000: 00000040:01000000:1.0:1789708519.984632:0:7773:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789708519.984651:0:7773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000783c3ba0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365427968:0@lo:1000: 00000100:00100000:1.0:1789708519.984677:0:7773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708519.984690:0:7773:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edb6fec4 going to sleep for 11 seconds 00000100:00100000:0.0:1789708519.984720:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365427968 00000100:00100000:0.0:1789708519.984726:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365427968 00000100:00100000:0.0:1789708519.984752:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708519.984758:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e1796cd8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7773:x1876645365427968:12345-0@lo:1000: 00000100:00100000:0.0:1789708519.984862:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e1796cd8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7773:x1876645365427968:12345-0@lo:1000: Request processed in 103us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.984869:0:7773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000783c3ba0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365427968:0@lo:1000: 00000100:00100000:0.0:1789708519.984870:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708519.984908:0:7773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000783c3ba0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365428096:0@lo:700: 00000100:00100000:1.0:1789708519.984925:0:7773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708519.984938:0:7773:0:(client.c:2716:ptlrpc_set_wait()) set 0000000074cab10f going to sleep for 11 seconds 00000100:00100000:0.0:1789708519.984965:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365428096 00000100:00100000:0.0:1789708519.984970:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365428096 00000100:00100000:0.0:1789708519.984994:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708519.984999:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002139f4ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7773:x1876645365428096:12345-0@lo:700: 00000100:00100000:0.0:1789708519.985035:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002139f4ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7773:x1876645365428096:12345-0@lo:700: Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708519.985041:0:7773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000783c3ba0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365428096:0@lo:700: 00000100:00100000:0.0:1789708519.985050:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708519.985161:0:7773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000783c3ba0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365428224:0@lo:1000: 00000100:00100000:1.0:1789708519.985184:0:7773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708519.985196:0:7773:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dca5d3a1 going to sleep for 11 seconds 00000100:00100000:3.0:1789708519.985210:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365428224 00000100:00100000:3.0:1789708519.985214:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365428224 00000100:00100000:3.0:1789708519.985233:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789708519.985237:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c43ec1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7773:x1876645365428224:12345-0@lo:1000: 00000100:00100000:3.0:1789708519.985293:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c43ec1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7773:x1876645365428224:12345-0@lo:1000: Request processed in 55us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708519.985298:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708519.985308:0:7773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000783c3ba0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365428224:0@lo:1000: 00000004:00080000:1.0:1789708519.985341:0:7773:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000074cab10f with version 0 00000020:00100000:1.0:1789708519.985351:0:7773:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789708519.985354:0:7773:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000783c3ba0 x1876645365428480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789708519.985362:0:7773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000783c3ba0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365428480:0@lo:1000: 00000100:00100000:1.0:1789708519.985397:0:7773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708519.985412:0:7773:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010b311f1 going to sleep for 11 seconds 00000100:00100000:0.0:1789708519.985425:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365428480 00000100:00100000:0.0:1789708519.985429:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365428480 00000100:00100000:0.0:1789708519.985447:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708519.985451:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000069587c7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7773:x1876645365428480:12345-0@lo:1000: 00000001:00080000:2.0:1789708519.989097:0:7415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1789708519.989106:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789708519.989208:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000069587c7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7773:x1876645365428480:12345-0@lo:1000: Request processed in 3755us (3808us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789708519.989218:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1789708519.989232:0:7773:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789708519.989237:0:7773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789708519.989249:0:7773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000783c3ba0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365428480:0@lo:1000: 00000100:00100000:1.0:1789708519.989349:0:7773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000783c3ba0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365428608:0@lo:1000: 00000100:00100000:1.0:1789708519.989377:0:7773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708519.989399:0:7773:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edb6fec4 going to sleep for 11 seconds 00000100:00100000:3.0:1789708519.989415:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365428608 00000100:00100000:3.0:1789708519.989421:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365428608 00000100:00100000:3.0:1789708519.989457:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708519.989466:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001911c687 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7773:x1876645365428608:12345-0@lo:1000: 00000100:00100000:3.0:1789708519.989528:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001911c687 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7773:x1876645365428608:12345-0@lo:1000: Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708519.989536:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708519.989554:0:7773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000783c3ba0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7773:1876645365428608:0@lo:1000: 00000040:00080000:1.0:1789708519.989573:0:7773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789708519.989594:0:7773:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000074cab10f with version 1 00000004:00080000:3.0:1789708519.989626:0:7771:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000006b59a8a5 version 1 rpc_version 1 00000020:00100000:3.0:1789708519.989644:0:7771:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789708519.989650:0:7771:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004fe750ce x1876645365428864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789708519.989665:0:7771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fe750ce pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7771:1876645365428864:0@lo:1000: 00000100:00100000:3.0:1789708519.989703:0:7771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708519.989724:0:7771:0:(client.c:2716:ptlrpc_set_wait()) set 0000000004d9e674 going to sleep for 11 seconds 00000100:00100000:0.0:1789708519.989776:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365428864 00000100:00100000:0.0:1789708519.989781:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365428864 00000100:00100000:0.0:1789708519.989803:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708519.989807:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087d8cba3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7771:x1876645365428864:12345-0@lo:1000: 00000001:00080000:2.0:1789708519.990406:0:7415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1789708519.990472:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087d8cba3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7771:x1876645365428864:12345-0@lo:1000: Request processed in 664us (769us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789708519.990477:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1789708519.990501:0:7771:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789708519.990505:0:7771:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789708519.990522:0:7771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fe750ce pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7771:1876645365428864:0@lo:1000: 00000040:00080000:1.0:1789708519.991086:0:7773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789708519.991144:0:7773:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789708519.991147:0:7773:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789708520.039342:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708521.063350:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789708521.321233:0:7844:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708521.321394:0:7844:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000080:0.0:1789708521.626325:0:7892:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9439a900 20000000:00000080:0.0:1789708521.626341:0:7892:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bee2f63e000 uarg=0000000000000000 20000000:01000000:0.0:1789708521.626373:0:7892:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789708521.626379:0:7892:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789708521.626382:0:7892:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789708521.626442:0:7892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789708521.626452:0:7892:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789708521.628054:0:7892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708521.628212:0:7892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789708521.628233:0:7892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789708521.628242:0:7892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789708521.628252:0:7892:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789708521.628288:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.628302:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007c300214/0xf45f43947e47c8c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c8bd expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.628310:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c99d expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.628317:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.628350:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c99d expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.628360:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c9a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c99d expref: 17 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708521.628370:0:7892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd675d46 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7892:1876645365428992:0@lo:104: 00000100:00100000:0.0:1789708521.628413:0:7892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708521.628463:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365428992 00000100:00100000:1.0:1789708521.628470:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365428992 00010000:00010000:0.0:1789708521.628471:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007c300214/0xf45f43947e47c8c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c8bd expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.628481:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007c300214/0xf45f43947e47c8c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c8bd expref: 17 pid: 6478 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708521.628490:0:7892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7892:1876645365429120:0@lo:104: 00000100:00100000:1.0:1789708521.628512:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708521.628518:0:7892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708521.628523:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d7c2a188 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:7892:x1876645365428992:12345-0@lo:104: 00010000:00010000:1.0:1789708521.628536:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708521.628536:0:7892:0:(client.c:2716:ptlrpc_set_wait()) set 000000001102062d going to sleep for 11 seconds 00000100:00100000:3.0:1789708521.628567:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789708521.628581:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365429120 00000100:00100000:3.0:1789708521.628586:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365429120 00010000:00010000:1.0:1789708521.628593:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789708521.628600:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d7c2a188 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:7892:x1876645365428992:12345-0@lo:104: Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708521.628608:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708521.628613:0:7892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd675d46 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7892:1876645365428992:0@lo:104: 00010000:00010000:2.0:1789708521.628615:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789708521.628616:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789708521.628623:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708521.628628:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a3f1d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:7892:x1876645365429120:12345-0@lo:104: 00010000:00010000:3.0:1789708521.628637:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708521.628641:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cbda77a8 already unused, calling callback (000000009f7eade9) 10000000:00010000:2.0:1789708521.628646:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708521.628655:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708521.628663:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708521.628668:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789708521.628686:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789708521.628691:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a3f1d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:7892:x1876645365429120:12345-0@lo:104: Request processed in 68us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708521.628698:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708521.628698:0:7892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7892:1876645365429120:0@lo:104: 00010000:00010000:2.0:1789708521.628703:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708521.628714:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708521.628722:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708521.628735:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708521.628741:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708521.628743:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 00000000cbda77a8/0xf45f43947e47c99d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9a4 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708521.628745:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c0da73cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365429248:0@lo:103: 00010000:00010000:3.0:1789708521.628746:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708521.628756:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079edb100 already unused, calling callback (000000009f7eade9) 00010000:00010000:2.0:1789708521.628758:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1789708521.628759:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708521.628761:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708521.628765:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708521.628770:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708521.628777:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708521.628780:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789708521.628794:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789708521.628807:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365429248 00000100:00100000:2.0:1789708521.628812:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365429248 00010000:00010000:3.0:1789708521.628818:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708521.628825:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708521.628832:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c9a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c99d expref: 18 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708521.628842:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708521.628850:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 0000000079edb100/0xf45f43947e47c8bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c8c4 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708521.628850:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d28001d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365429376:0@lo:103: 00000100:00100000:2.0:1789708521.628858:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789708521.628869:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708521.628872:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708521.628873:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000561f188a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:3618:x1876645365429248:12345-0@lo:103: 00010000:00010000:3.0:1789708521.628876:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708521.628882:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708521.628883:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708521.628887:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c9a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c99d expref: 18 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708521.628896:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c99d expref: 18 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708521.628907:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078e9cc5c/0xf45f43947e47c9a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c99d expref: 18 pid: 6479 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708521.628917:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708521.628917:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365429376 00000100:00100000:0.0:1789708521.628922:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365429376 00010000:00010000:0.0:1789708521.628935:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007c300214/0xf45f43947e47c8c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c8bd expref: 18 pid: 6478 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708521.628958:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708521.628961:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000561f188a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:3618:x1876645365429248:12345-0@lo:103: Request processed in 90us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708521.628970:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000783c3ba0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:3615:x1876645365429376:12345-0@lo:103: 00000100:00100000:2.0:1789708521.628971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708521.628977:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c0da73cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365429248:0@lo:103: 00010000:00010000:0.0:1789708521.628982:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708521.628988:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007c300214/0xf45f43947e47c8c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c8bd expref: 17 pid: 6478 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.628998:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007c300214/0xf45f43947e47c8c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c8bd expref: 17 pid: 6478 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629006:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007c300214/0xf45f43947e47c8c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c8bd expref: 17 pid: 6478 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629014:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629018:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629026:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629030:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629040:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629043:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629046:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007b7b63e8 already unused, calling callback (0000000020c8a59f) 00010000:00010000:0.0:1789708521.629048:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629051:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629061:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708521.629066:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708521.629077:0:7892:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708521.629084:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708521.629090:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000783c3ba0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:3615:x1876645365429376:12345-0@lo:103: Request processed in 123us (208us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708521.629104:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b7b63e8/0xf45f43947e47ca37 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708521.629109:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708521.629120:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d28001d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365429376:0@lo:103: 00010000:00010000:3.0:1789708522.086354:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708523.110351:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708523.366360:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fe750ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365429504:0@lo:41: 00000100:00100000:3.0:1789708523.366443:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708523.366522:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365429504 00000100:00100000:3.0:1789708523.366531:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365429504 00000100:00100000:3.0:1789708523.366656:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708523.366665:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035399ad3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365429504:12345-0@lo:41: 00000004:00000024:3.0:1789708523.366688:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789708523.366732:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035399ad3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365429504:12345-0@lo:41: Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708523.366740:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708523.366760:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fe750ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365429504:0@lo:41: 00010000:00010000:3.0:1789708524.134333:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789708524.479324:0:8390:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789708524.479327:0:8390:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789708524.479328:0:8390:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789708524.479475:0:8390:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008a90e4cd 00000020:01000004:1.0:1789708524.479491:0:8390:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789708524.479502:0:8390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789708524.479514:0:8390:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (0000000097f1ab74) 00000020:00000080:1.0:1789708524.479529:0:8390:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789708524.493493:0:8390:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789708524.493552:0:8390:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1789708524.503277:0:8390:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789708524.503468:0:8390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789708524.503479:0:8390:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789708524.503488:0:8390:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45f43947e47ca45 00000020:01000004:0.0:1789708524.503494:0:8390:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789708524.503513:0:8390:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789708524.503516:0:8390:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789708524.503521:0:8390:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789708524.503525:0:8390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789708524.503535:0:8390:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000004e7d0280) 00000020:00000080:0.0:1789708524.503552:0:8390:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1789708524.505553:0:8390:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708524.505750:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789708524.505756:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789708524.506157:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789708524.506165:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789708524.506375:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789708524.506380:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789708524.508525:0:8390:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708524.508644:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789708524.508652:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789708524.508940:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789708524.508946:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789708524.533494:0:8390:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708524.533708:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789708524.533715:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789708524.534830:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789708524.534837:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789708524.535745:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789708524.535751:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789708524.538528:0:8390:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708524.538665:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789708524.538669:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789708524.539018:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789708524.539025:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789708524.589680:0:8390:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708524.589844:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789708524.589850:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789708524.590908:0:8390:0:(service.c:3474:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789708524.590919:0:8390:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789708524.591188:0:8390:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789708524.591212:0:8390:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789708524.591218:0:8390:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789708524.602034:0:8390:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789708524.602078:0:8390:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789708524.602082:0:8390:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789708524.602083:0:8390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708524.602084:0:8390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708524.602085:0:8390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708524.602085:0:8390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708524.602086:0:8390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708524.602087:0:8390:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708524.602088:0:8390:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789708524.602089:0:8390:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789708524.602089:0:8390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708524.602090:0:8390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789708524.602093:0:8390:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789708524.602094:0:8390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789708524.602095:0:8390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708524.602095:0:8390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708524.602096:0:8390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708524.602097:0:8390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708524.602100:0:8390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708524.602100:0:8390:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708524.602101:0:8390:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789708524.602101:0:8390:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789708524.602102:0:8390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708524.602102:0:8390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789708524.602128:0:8390:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789708524.602141:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365429632:0@lo:253: 00000100:00100000:0.0:1789708524.602198:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708524.602239:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 00000000031085eb going to sleep for 11 seconds 00000100:00100000:3.0:1789708524.602249:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365429632 00000100:00100000:3.0:1789708524.602256:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365429632 00000100:00100000:3.0:1789708524.602315:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789708524.602320:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009479891b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:8390:x1876645365429632:12345-0@lo:253: 20000000:01000000:3.0:1789708524.602351:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789708524.602354:0:6478:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789708524.602357:0:6478:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789708524.602360:0:6478:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789708524.602483:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708524.602583:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789708524.602596:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789708524.602614:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789708524.602621:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789708524.602634:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789708524.602649:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789708524.602755:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789708524.602767:0:6478:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:3.0:1789708524.602769:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:3.0:1789708524.602782:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789708524.602787:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789708524.602798:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789708524.602803:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:3.0:1789708524.602814:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789708524.602820:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789708524.602831:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789708524.602844:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789708524.602939:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789708524.602950:0:6478:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:3.0:1789708524.602951:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:3.0:1789708524.602964:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789708524.602969:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789708524.602991:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789708524.602998:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:3.0:1789708524.603012:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789708524.603017:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789708524.603028:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789708524.603054:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789708524.603483:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789708524.603494:0:6478:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:3.0:1789708524.603495:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:3.0:1789708524.603508:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789708524.603513:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789708524.603523:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789708524.603528:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:3.0:1789708524.603538:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789708524.603542:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789708524.603553:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789708524.603566:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789708524.603583:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789708524.603586:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789708524.603589:0:6478:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789708524.603632:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789708524.603634:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789708524.603883:0:8409:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789708524.603904:0:8409:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789708524.603920:0:8409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789708524.604027:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789708524.604053:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789708524.604063:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789708524.604073:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789708524.604074:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789708524.604790:0:8410:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1789708524.604805:0:8410:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1789708524.604822:0:8410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1789708524.604920:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1789708524.604937:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1789708524.604949:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1789708524.604963:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789708524.604965:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789708524.605156:0:8411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789708524.605238:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789708524.605256:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789708524.605309:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789708524.605322:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789708524.605324:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789708524.606737:0:8412:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1789708524.606755:0:8412:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1789708524.606768:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789708524.606890:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1789708524.606912:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1789708524.606927:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:3.0:1789708524.606946:0:6478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789708524.606962:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.606977:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002d5104a4/0xf45f43947e47c93b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c934 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.606983:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c9b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c9ab expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.606990:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006d01d7be/0xf45f43947e47c9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c9e3 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.606996:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005da715f7/0xf45f43947e47ca06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c9ff expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.607002:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000003bc17f1/0xf45f43947e47ca30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ca29 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.607009:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.607056:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000003bc17f1/0xf45f43947e47ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ca29 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.607068:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000003bc17f1/0xf45f43947e47ca30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ca29 expref: 16 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.607083:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2c7ba84 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365429760:0@lo:104: 00000100:00100000:3.0:1789708524.607139:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708524.607184:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005da715f7/0xf45f43947e47ca06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c9ff expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708524.607186:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365429760 00000100:00100000:1.0:1789708524.607193:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365429760 00010000:00010000:3.0:1789708524.607196:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005da715f7/0xf45f43947e47ca06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c9ff expref: 16 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.607206:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9a2ded4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365429888:0@lo:104: 00000100:00100000:1.0:1789708524.607228:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708524.607233:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708524.607239:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000178ec86a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6478:x1876645365429760:12345-0@lo:104: 00010000:00010000:1.0:1789708524.607248:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.607280:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365429888 00000100:00100000:2.0:1789708524.607285:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365429888 00010000:00010000:3.0:1789708524.607310:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006d01d7be/0xf45f43947e47c9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c9e3 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.607318:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789708524.607323:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006d01d7be/0xf45f43947e47c9ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c9e3 expref: 16 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.607327:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789708524.607328:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000b102f5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6478:x1876645365429888:12345-0@lo:104: 00010000:00010000:2.0:1789708524.607339:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708524.607339:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000178ec86a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6478:x1876645365429760:12345-0@lo:104: Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.607344:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035ad9d91 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365430016:0@lo:104: 00000100:00100000:1.0:1789708524.607357:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789708524.607388:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708524.607392:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.607395:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708524.607401:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789708524.607406:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000b102f5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6478:x1876645365429888:12345-0@lo:104: Request processed in 82us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708524.607418:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789708524.607420:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003f2fd094 already unused, calling callback (000000009f7eade9) 00010000:00010000:0.0:1789708524.607420:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708524.607424:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c9ab expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708524.607425:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.607427:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.607432:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365430016 00000100:00100000:2.0:1789708524.607439:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365430016 00010000:00010000:1.0:1789708524.607446:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.607448:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000028d0906 already unused, calling callback (000000009f7eade9) 00010000:00010000:3.0:1789708524.607449:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c9b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c9ab expref: 16 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708524.607455:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708524.607457:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.607468:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789708524.607474:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708524.607476:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789708524.607482:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ddba3d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6478:x1876645365430016:12345-0@lo:104: 00000100:00100000:3.0:1789708524.607486:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fe750ce pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365430144:0@lo:104: 00010000:00010000:2.0:1789708524.607496:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708524.607503:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.607508:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708524.607509:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789708524.607520:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708524.607522:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708524.607529:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.607535:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708524.607540:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789708524.607543:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.607548:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ddba3d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6478:x1876645365430016:12345-0@lo:104: Request processed in 68us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708524.607548:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.607551:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002d5104a4/0xf45f43947e47c93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c934 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.607569:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 000000003f2fd094/0xf45f43947e47ca29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca30 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.607570:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 00000000028d0906/0xf45f43947e47c9ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca06 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.607579:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789708524.607598:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365430144 00010000:00010000:3.0:1789708524.607600:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002d5104a4/0xf45f43947e47c93b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c934 expref: 16 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.607603:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365430144 00010000:00010000:1.0:1789708524.607604:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708524.607605:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708524.607608:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708524.607612:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.607612:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708524.607616:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af8d5da1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365430528:0@lo:104: 00010000:00010000:1.0:1789708524.607627:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000043045e60 already unused, calling callback (000000009f7eade9) 00000100:00100000:2.0:1789708524.607630:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 10000000:00010000:1.0:1789708524.607631:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.607635:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b430c175 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365430272:0@lo:103: 00000100:00100000:2.0:1789708524.607644:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d28001d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6478:x1876645365430144:12345-0@lo:104: 00000100:00100000:3.0:1789708524.607651:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708524.607656:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.607662:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.607670:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee390336 going to sleep for 11 seconds 10000000:00010000:1.0:1789708524.607670:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.607671:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789708524.607680:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789708524.607701:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789708524.607704:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2c7ba84 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365429760:0@lo:104: 00010000:00010000:1.0:1789708524.607707:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.607709:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd675d46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365430400:0@lo:103: 00010000:00010000:2.0:1789708524.607710:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789708524.607720:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9a2ded4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365429888:0@lo:104: 00000100:00100000:2.0:1789708524.607722:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d28001d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6478:x1876645365430144:12345-0@lo:104: Request processed in 81us (205us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708524.607724:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789708524.607737:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708524.607737:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708524.607739:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035ad9d91 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365430016:0@lo:104: 00000100:00100000:2.0:1789708524.607755:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365430528 00000100:00100000:3.0:1789708524.607756:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fe750ce pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365430144:0@lo:104: 00000100:00100000:2.0:1789708524.607760:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365430528 00010000:00010000:1.0:1789708524.607760:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.607769:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 0000000043045e60/0xf45f43947e47c9e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9ea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.607776:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708524.607781:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.607782:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789708524.607788:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708524.607793:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000381b7c61 already unused, calling callback (000000009f7eade9) 00010000:00010000:1.0:1789708524.607793:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708524.607794:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000003b059f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6478:x1876645365430528:12345-0@lo:104: 00010000:00010000:1.0:1789708524.607797:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1789708524.607799:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.607806:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.607808:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708524.607810:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708524.607823:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005aadff55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365430656:0@lo:103: 10000000:00010000:3.0:1789708524.607825:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708524.607835:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708524.607866:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.607866:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789708524.607877:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000003b059f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6478:x1876645365430528:12345-0@lo:104: Request processed in 84us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708524.607880:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.607894:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789708524.607895:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789708524.607902:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365430272 00000100:00100000:0.0:1789708524.607906:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365430272 00010000:00010000:3.0:1789708524.607907:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708524.607910:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000636543a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365430784:0@lo:103: 00010000:00010000:3.0:1789708524.607919:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 00000000381b7c61/0xf45f43947e47c9ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9b2 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.607921:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708524.607924:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000003bc17f1/0xf45f43947e47ca30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ca29 expref: 17 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.607927:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708524.607937:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708524.607939:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708524.607944:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708524.607946:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c20c0700 already unused, calling callback (000000009f7eade9) 00010000:00010000:3.0:1789708524.607949:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789708524.607953:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.607959:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.607962:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365430400 10000000:00010000:2.0:1789708524.607964:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.607965:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365430400 00000100:00100000:3.0:1789708524.607966:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365430656 10000000:01000000:2.0:1789708524.607971:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789708524.607974:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365430656 00000100:00100000:1.0:1789708524.607979:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365430784 00000100:00100000:1.0:1789708524.607983:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365430784 00010000:00010000:0.0:1789708524.607985:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005da715f7/0xf45f43947e47ca06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c9ff expref: 19 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.607995:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006d01d7be/0xf45f43947e47c9ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c9e3 expref: 20 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.607996:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.607999:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c9b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c9ab expref: 20 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.608003:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789708524.608016:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789708524.608016:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e220b7e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:3617:x1876645365430272:12345-0@lo:103: 00010000:00010000:2.0:1789708524.608027:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608027:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708524.608034:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000003bc17f1/0xf45f43947e47ca30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ca29 expref: 20 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.608036:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47c934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c93b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.608052:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789708524.608056:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000003bc17f1/0xf45f43947e47ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ca29 expref: 20 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708524.608064:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708524.608067:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d7c2a188 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:3617:x1876645365430400:12345-0@lo:103: 00000100:00100000:1.0:1789708524.608079:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001acb4022 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:3616:x1876645365430656:12345-0@lo:103: 00010000:00010000:0.0:1789708524.608080:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000003bc17f1/0xf45f43947e47ca30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ca29 expref: 20 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.608081:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708524.608083:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708524.608088:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708524.608091:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005da715f7/0xf45f43947e47ca06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c9ff expref: 19 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.608092:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708524.608094:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708524.608096:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708524.608105:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006d01d7be/0xf45f43947e47c9ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c9e3 expref: 19 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.608109:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005da715f7/0xf45f43947e47ca06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c9ff expref: 19 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.608109:0:6514:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:2.0:1789708524.608120:0:6514:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00000100:00100000:0.0:1789708524.608121:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e220b7e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:3617:x1876645365430272:12345-0@lo:103: Request processed in 109us (450us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708524.608124:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006d01d7be/0xf45f43947e47c9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c9e3 expref: 19 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.608133:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708524.608134:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789708524.608142:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005da715f7/0xf45f43947e47ca06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c9ff expref: 18 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.608146:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006d01d7be/0xf45f43947e47c9ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c9e3 expref: 18 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.608147:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365430912:0@lo:103: 00000100:00100000:0.0:1789708524.608150:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708524.608161:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc18fc0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:3616:x1876645365430784:12345-0@lo:103: 00010000:00010000:3.0:1789708524.608167:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708524.608172:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708524.608173:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708524.608179:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c9b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c9ab expref: 16 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608188:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c9ab expref: 16 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608199:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd8cdc27/0xf45f43947e47c9b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c9ab expref: 16 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.608207:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708524.608214:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d7c2a188 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:3617:x1876645365430400:12345-0@lo:103: Request processed in 150us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708524.608219:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001acb4022 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:3616:x1876645365430656:12345-0@lo:103: Request processed in 144us (349us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708524.608225:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708524.608235:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708524.608242:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708524.608246:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd675d46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365430400:0@lo:103: 00000100:00100000:1.0:1789708524.608257:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365430912 00000100:00100000:2.0:1789708524.608281:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b430c175 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365430272:0@lo:103: 00000100:00100000:1.0:1789708524.608287:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365430912 00000100:00100000:0.0:1789708524.608293:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc18fc0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:3616:x1876645365430784:12345-0@lo:103: Request processed in 132us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708524.608303:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789708524.608306:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002d5104a4/0xf45f43947e47c93b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c934 expref: 14 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.608318:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af8d5da1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6478:1876645365430528:0@lo:104: 00000100:00100000:0.0:1789708524.608327:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708524.608336:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0da73cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:3618:x1876645365430912:12345-0@lo:103: 00010000:00010000:0.0:1789708524.608354:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708524.608356:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708524.608356:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000636543a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365430784:0@lo:103: 00010000:00010000:0.0:1789708524.608372:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002d5104a4/0xf45f43947e47c93b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c934 expref: 13 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708524.608377:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005aadff55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365430656:0@lo:103: 00010000:00010000:2.0:1789708524.608390:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708524.608392:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002d5104a4/0xf45f43947e47c93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c934 expref: 13 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608404:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002d5104a4/0xf45f43947e47c93b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c934 expref: 13 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608414:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608422:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608434:0:7427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608441:0:7427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608447:0:7427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608456:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608462:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081cbb1fa already unused, calling callback (0000000020c8a59f) 00010000:00010000:0.0:1789708524.608465:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608472:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608487:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.608498:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708524.608511:0:6478:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.608519:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.608525:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca53 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.608536:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0da73cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:3618:x1876645365430912:12345-0@lo:103: Request processed in 201us (330us total) trans 0 rc 0/0 20000000:01000000:3.0:1789708524.608540:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789708524.608546:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708524.608548:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365430912:0@lo:103: 00000100:00100000:3.0:1789708524.611820:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009479891b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:8390:x1876645365429632:12345-0@lo:253: Request processed in 9493us (9616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.611834:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789708524.611858:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365429632:0@lo:253: 10000000:01000000:0.0:1789708524.611873:0:8390:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789708524.611876:0:8390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708524.611879:0:8390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708524.611880:0:8390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708524.611881:0:8390:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789708524.611882:0:8390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708524.611883:0:8390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708524.611884:0:8390:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708524.611886:0:8390:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789708524.611887:0:8390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708524.611889:0:8390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789708524.611915:0:8390:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008a90e4cd from lustre-OST0000 10000000:01000000:0.0:1789708524.611941:0:8390:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789708524.611948:0:8390:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789708524.611955:0:8390:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bee18160000 local copy 10000000:01000000:0.0:1789708524.611959:0:8390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789708524.611986:0:8390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.611995:0:8390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.612003:0:8390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.612016:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431040:0@lo:101: 00000100:00100000:0.0:1789708524.612064:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708524.612097:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a2445b going to sleep for 11 seconds 00000100:00100000:2.0:1789708524.612110:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365431040 00000100:00100000:2.0:1789708524.612116:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365431040 00000100:00100000:2.0:1789708524.612156:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789708524.612161:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000204eef20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+11:8390:x1876645365431040:12345-0@lo:101: 00010000:00010000:2.0:1789708524.612171:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708524.612179:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be4f7307/0xf45f43947e47ca61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ca5a expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.612194:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be4f7307/0xf45f43947e47ca61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ca5a expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.612200:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be4f7307/0xf45f43947e47ca61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ca5a expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.612206:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be4f7307, rc 0) 00000100:00100000:2.0:1789708524.612230:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000204eef20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431040:12345-0@lo:101: Request processed in 70us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708524.612234:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789708524.612316:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431040:0@lo:101: 00010000:00010000:0.0:1789708524.612327:0:8390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.612335:0:8390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.612410:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431168:0@lo:501: 00000100:00100000:0.0:1789708524.612434:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708524.612457:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a2445b going to sleep for 11 seconds 00000100:00100000:3.0:1789708524.612527:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365431168 00000100:00100000:3.0:1789708524.612533:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365431168 00000100:00100000:3.0:1789708524.612558:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789708524.612565:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000afc4782d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431168:12345-0@lo:501: 00000100:00100000:3.0:1789708524.612627:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000afc4782d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431168:12345-0@lo:501: Request processed in 63us (192us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708524.612634:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789708524.612661:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431168:0@lo:501: 10000000:01000000:0.0:1789708524.612672:0:8390:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789708524.612688:0:8390:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789708524.612702:0:8390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.612715:0:8390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.612722:0:8390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.612741:0:8390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789708524.612760:0:8390:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bee2f569800 10000000:01000000:0.0:1789708524.612765:0:8390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789708524.612766:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1789708524.612771:0:8390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 00010000:00010000:3.0:1789708524.612773:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708524.612776:0:8390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789708524.612783:0:8390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789708524.612786:0:8390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789708524.612798:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2498222 already unused, calling callback (000000009f7eade9) 10000000:00010000:3.0:1789708524.612802:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.612802:0:8390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000214bca23/0xf45f43947e47ca68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.612820:0:8390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000214bca23/0xf45f43947e47ca68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.612822:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.612837:0:8390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000214bca23/0xf45f43947e47ca68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708524.612838:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708524.612853:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789708524.612858:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431296:0@lo:101: 00010000:00010000:3.0:1789708524.612873:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.612881:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789708524.612889:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708524.612903:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.612910:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 00000000d2498222/0xf45f43947e47ca5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45f43947e47ca61 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.612917:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a2445b going to sleep for 11 seconds 00010000:00010000:3.0:1789708524.612923:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708524.612924:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af8d5da1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365431424:0@lo:103: 00010000:00010000:3.0:1789708524.612926:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708524.612928:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708524.612947:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365431296 00000100:00100000:1.0:1789708524.612953:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365431296 00000100:00100000:2.0:1789708524.612960:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708524.612989:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789708524.612997:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365431424 00000100:00100000:1.0:1789708524.612998:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000da86ef25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431296:12345-0@lo:101: 00000100:00100000:3.0:1789708524.613003:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365431424 00010000:00010000:1.0:1789708524.613016:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708524.613025:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d8ba31a/0xf45f43947e47ca6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ca68 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.613050:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789708524.613056:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d8ba31a/0xf45f43947e47ca6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ca68 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.613061:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000a516aed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:3618:x1876645365431424:12345-0@lo:103: 00010000:00010000:1.0:1789708524.613072:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d8ba31a/0xf45f43947e47ca6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ca68 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.613075:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708524.613080:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d8ba31a, rc 0) 00010000:00010000:3.0:1789708524.613093:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000be4f7307/0xf45f43947e47ca61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47ca5a expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.613104:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708524.613125:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000da86ef25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365431296:12345-0@lo:101: Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708524.613133:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789708524.613140:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431296:0@lo:101: 00010000:00010000:0.0:1789708524.613154:0:8390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000214bca23/0xf45f43947e47ca68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.613155:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000a516aed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:3618:x1876645365431424:12345-0@lo:103: Request processed in 97us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.613170:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708524.613180:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af8d5da1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365431424:0@lo:103: 00010000:00010000:0.0:1789708524.613182:0:8390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000214bca23/0xf45f43947e47ca68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708524.613242:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431552:0@lo:501: 00000100:00100000:0.0:1789708524.613302:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708524.613327:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365431552 00000100:00100000:0.0:1789708524.613331:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a2445b going to sleep for 11 seconds 00000100:00100000:3.0:1789708524.613332:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365431552 00000100:00100000:3.0:1789708524.613359:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789708524.613366:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006864785d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431552:12345-0@lo:501: 00000100:00100000:3.0:1789708524.613449:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006864785d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431552:12345-0@lo:501: Request processed in 85us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.613457:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789708524.613480:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431552:0@lo:501: 00000100:00100000:0.0:1789708524.613513:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431680:0@lo:503: 00000100:00100000:0.0:1789708524.613551:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708524.613567:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a2445b going to sleep for 11 seconds 00000100:00100000:1.0:1789708524.613578:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365431680 00000100:00100000:1.0:1789708524.613584:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365431680 00000100:00100000:1.0:1789708524.613612:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789708524.613619:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000070ead38b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431680:12345-0@lo:503: 00000100:00100000:1.0:1789708524.613731:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000070ead38b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431680:12345-0@lo:503: Request processed in 112us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708524.613740:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789708524.613751:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431680:0@lo:503: 00000040:00080000:0.0:1789708524.613974:0:8390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708524.614033:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431808:0@lo:502: 00000100:00100000:0.0:1789708524.614080:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708524.614097:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a2445b going to sleep for 11 seconds 00000100:00100000:3.0:1789708524.614117:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365431808 00000100:00100000:3.0:1789708524.614122:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365431808 00000100:00100000:3.0:1789708524.614148:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789708524.614155:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009723e03f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431808:12345-0@lo:502: 00000100:00100000:3.0:1789708524.614244:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009723e03f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431808:12345-0@lo:502: Request processed in 89us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.614252:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789708524.614282:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431808:0@lo:502: 00000040:00080000:0.0:1789708524.614483:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789708524.614509:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789708524.614527:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789708524.614543:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789708524.614558:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789708524.614572:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789708524.614589:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431936:0@lo:502: 00000100:00100000:0.0:1789708524.614621:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708524.614645:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a2445b going to sleep for 11 seconds 00000100:00100000:1.0:1789708524.614668:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365431936 00000100:00100000:1.0:1789708524.614674:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365431936 00000100:00100000:1.0:1789708524.614700:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789708524.614708:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce67e9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431936:12345-0@lo:502: 00000100:00100000:1.0:1789708524.614788:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce67e9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365431936:12345-0@lo:502: Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708524.614796:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789708524.614804:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b49e267f pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365431936:0@lo:502: 00000040:00080000:0.0:1789708524.614849:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789708524.614856:0:8390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789708524.615139:0:8414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789708524.615145:0:8414:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789708524.615150:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708524.615152:0:8414:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789708524.615158:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789708524.615170:0:8414:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000619ed802) 00000020:00000080:0.0:1789708524.615186:0:8414:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789708524.615191:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789708524.615257:0:8414:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008a90e4cd from lustre-OST0000, refs=2 00080000:01000000:0.0:1789708524.615293:0:8414:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789708524.615302:0:8414:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45f43947e47ca7d 00010000:00010000:0.0:1789708524.618453:0:8414:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1789708524.618681:0:8414:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789708524.620152:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789708524.620344:0:8414:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789708524.622682:0:8414:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789708524.622820:0:8414:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789708524.625087:0:8414:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789708524.625721:0:8414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789708524.625729:0:8414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708524.625734:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708524.625735:0:8414:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789708524.625737:0:8414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708524.625740:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708524.625741:0:8414:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789708524.625743:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789708524.625744:0:8414:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789708524.625757:0:8414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708524.625759:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708524.625765:0:8414:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789708524.625767:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789708524.625840:0:8390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789708524.625874:0:8390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789708524.625888:0:8390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000214bca23/0xf45f43947e47ca68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.625905:0:8390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000214bca23/0xf45f43947e47ca68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708524.625911:0:8390:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee2f569800 from 1 10000000:01000000:2.0:1789708524.625914:0:8390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708524.625943:0:8390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47ca84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.625948:0:8390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47ca84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.625955:0:8390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47ca84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.625972:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432064:0@lo:101: 00000100:00100000:2.0:1789708524.626051:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.626092:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 00000000537b90a4 going to sleep for 11 seconds 00000100:00100000:3.0:1789708524.626100:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365432064 00000100:00100000:3.0:1789708524.626109:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365432064 00000100:00100000:3.0:1789708524.626149:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789708524.626156:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c49e2f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:8390:x1876645365432064:12345-0@lo:101: 00010000:00010000:3.0:1789708524.626168:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708524.626179:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ca84 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.626205:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ca84 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.626212:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000081cbb1fa/0xf45f43947e47ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ca84 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.626218:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000081cbb1fa, rc 0) 00000100:00100000:3.0:1789708524.626254:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c49e2f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365432064:12345-0@lo:101: Request processed in 100us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.626277:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789708524.626302:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432064:0@lo:101: 00010000:00010000:2.0:1789708524.626312:0:8390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47ca84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.626318:0:8390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000c20c0700/0xf45f43947e47ca84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.626392:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432192:0@lo:501: 00000100:00100000:2.0:1789708524.626420:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.626452:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 00000000537b90a4 going to sleep for 11 seconds 00000100:00100000:3.0:1789708524.626453:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365432192 00000100:00100000:3.0:1789708524.626459:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365432192 00000100:00100000:3.0:1789708524.626492:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789708524.626500:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae521a49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365432192:12345-0@lo:501: 00000100:00100000:3.0:1789708524.626576:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae521a49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365432192:12345-0@lo:501: Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.626583:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789708524.626601:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432192:0@lo:501: 00000100:00100000:2.0:1789708524.626632:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432320:0@lo:503: 00000100:00100000:2.0:1789708524.626671:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.626684:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 00000000537b90a4 going to sleep for 11 seconds 00000100:00100000:3.0:1789708524.626697:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365432320 00000100:00100000:3.0:1789708524.626702:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365432320 00000100:00100000:3.0:1789708524.626722:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789708524.626726:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000037bf2559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365432320:12345-0@lo:503: 00000100:00100000:3.0:1789708524.626801:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000037bf2559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365432320:12345-0@lo:503: Request processed in 74us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.626808:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789708524.626834:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432320:0@lo:503: 00000040:00080000:2.0:1789708524.626973:0:8390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708524.627030:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432448:0@lo:502: 00000100:00100000:2.0:1789708524.627085:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.627099:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 00000000537b90a4 going to sleep for 11 seconds 00000100:00100000:3.0:1789708524.627121:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365432448 00000100:00100000:3.0:1789708524.627126:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365432448 00000100:00100000:3.0:1789708524.627154:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789708524.627168:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e88f7c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365432448:12345-0@lo:502: 00000100:00100000:3.0:1789708524.627277:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e88f7c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365432448:12345-0@lo:502: Request processed in 92us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708524.627284:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432448:0@lo:502: 00000100:00100000:3.0:1789708524.627288:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000040:00080000:2.0:1789708524.627467:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789708524.627488:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789708524.627502:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432576:0@lo:502: 00000100:00100000:2.0:1789708524.627528:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.627546:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set 00000000537b90a4 going to sleep for 11 seconds 00000100:00100000:3.0:1789708524.627565:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365432576 00000100:00100000:3.0:1789708524.627570:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365432576 00000100:00100000:3.0:1789708524.627595:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789708524.627601:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067c36dd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365432576:12345-0@lo:502: 00000100:00100000:3.0:1789708524.627681:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067c36dd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365432576:12345-0@lo:502: Request processed in 79us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.627689:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789708524.627690:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073000d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432576:0@lo:502: 00000040:00080000:2.0:1789708524.627733:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789708524.627740:0:8390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789708524.627993:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708524.627999:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708524.628001:0:8418:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789708524.628006:0:8418:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee2f569800 00000020:00000080:2.0:1789708524.628009:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708524.628090:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708524.628094:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708524.628095:0:8418:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789708524.628097:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789708524.628158:0:8390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789708524.628184:0:8390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708524.628198:0:8390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebcc00/0xf45f43947e47ca84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.628207:0:8390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebcc00/0xf45f43947e47ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708524.628251:0:8390:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789708524.628254:0:8390:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bee2f569800 10000000:01000000:3.0:1789708524.628257:0:8390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bee2f569800 10000000:01000000:3.0:1789708524.628284:0:8390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708524.628289:0:8390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee2f569800 from 1 10000000:01000000:3.0:1789708524.628292:0:8390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789708524.628310:0:8390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.628325:0:8390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.628338:0:8390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.628351:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432704:0@lo:101: 00000100:00100000:3.0:1789708524.628384:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708524.628412:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f6e89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708524.628433:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365432704 00000100:00100000:1.0:1789708524.628440:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365432704 00000100:00100000:1.0:1789708524.628476:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789708524.628486:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:8390:x1876645365432704:12345-0@lo:101: 00010000:00010000:1.0:1789708524.628495:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708524.628506:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188adc00/0xf45f43947e47ca99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ca92 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.628523:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188adc00/0xf45f43947e47ca99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ca92 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.628533:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188adc00/0xf45f43947e47ca99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ca92 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708524.628540:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188adc00, rc 0) 00000100:00100000:1.0:1789708524.628577:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365432704:12345-0@lo:101: Request processed in 93us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708524.628584:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789708524.628600:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432704:0@lo:101: 00010000:00010000:3.0:1789708524.628615:0:8390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.628624:0:8390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.628687:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432832:0@lo:501: 00000100:00100000:3.0:1789708524.628714:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708524.628730:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f6e89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708524.628747:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365432832 00000100:00100000:2.0:1789708524.628752:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365432832 00000100:00100000:2.0:1789708524.628780:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789708524.628788:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365432832:12345-0@lo:501: 00000100:00100000:2.0:1789708524.628873:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365432832:12345-0@lo:501: Request processed in 87us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708524.628881:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789708524.628911:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432832:0@lo:501: 00000100:00100000:3.0:1789708524.628945:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432960:0@lo:503: 00000100:00100000:3.0:1789708524.628974:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708524.629000:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f6e89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708524.629009:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365432960 00000100:00100000:1.0:1789708524.629015:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365432960 00000100:00100000:1.0:1789708524.629059:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789708524.629067:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365432960:12345-0@lo:503: 00000100:00100000:1.0:1789708524.629154:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365432960:12345-0@lo:503: Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708524.629161:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789708524.629182:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365432960:0@lo:503: 00000040:00080000:3.0:1789708524.629372:0:8390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789708524.629424:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365433088:0@lo:502: 00000100:00100000:3.0:1789708524.629460:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.629479:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365433088 00000100:00100000:3.0:1789708524.629482:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc70000 going to sleep for 11 seconds 00000100:00100000:2.0:1789708524.629484:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365433088 00000100:00100000:2.0:1789708524.629512:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789708524.629518:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365433088:12345-0@lo:502: 00000100:00100000:2.0:1789708524.629596:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365433088:12345-0@lo:502: Request processed in 77us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708524.629603:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789708524.629607:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365433088:0@lo:502: 00000040:00080000:3.0:1789708524.629761:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789708524.629800:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789708524.629827:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789708524.629843:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789708524.629857:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789708524.629864:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789708524.629872:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789708524.629882:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789708524.629890:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789708524.629899:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789708524.629907:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789708524.629915:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789708524.629924:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789708524.629932:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789708524.629941:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789708524.629949:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789708524.629958:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789708524.629965:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789708524.629981:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789708524.629990:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789708524.629998:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789708524.630007:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789708524.630022:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789708524.630052:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789708524.630079:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789708524.630105:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789708524.630124:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789708524.630138:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789708524.630155:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789708524.630173:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789708524.630193:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789708524.630219:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789708524.630234:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789708524.630248:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789708524.630300:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789708524.630322:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789708524.630341:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789708524.630362:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365433216:0@lo:502: 00000100:00100000:3.0:1789708524.630402:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708524.630431:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365433216 00000100:00100000:0.0:1789708524.630437:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365433216 00000100:00100000:3.0:1789708524.630440:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc70000 going to sleep for 11 seconds 00000100:00100000:0.0:1789708524.630473:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789708524.630482:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365433216:12345-0@lo:502: 00000100:00100000:0.0:1789708524.630569:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365433216:12345-0@lo:502: Request processed in 88us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708524.630576:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789708524.630581:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365433216:0@lo:502: 00000040:00080000:3.0:1789708524.630621:0:8390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789708524.630629:0:8390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789708524.630961:0:8419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789708524.630975:0:8419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bee10da8000) 00000020:00000080:3.0:1789708524.630992:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789708524.631083:0:8419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee2f569800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789708524.631088:0:8419:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee2f569800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789708524.631090:0:8419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee2f569800 3 00010000:00080000:3.0:1789708524.631116:0:8419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed08567800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789708524.633135:0:8419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789708524.633364:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789708524.633400:0:8419:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789708524.633411:0:8419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf45f43947e47caa7 00000100:00080000:3.0:1789708524.633417:0:8419:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708524.633427:0:8419:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bed08567800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708524.633457:0:8419:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622f480 x1876645365433344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708524.633479:0:8419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789708524.633515:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365433344:0@lo:38: 00000100:00100000:2.0:1789708524.633580:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708524.633583:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365433472:0@lo:400: 00000100:00100000:0.0:1789708524.633617:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365433728:0@lo:400: 00000100:00100000:3.0:1789708524.633632:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.633654:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365433344 00000100:00100000:0.0:1789708524.633659:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708524.633662:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708524.633662:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365433344 00000100:00100000:3.0:1789708524.633674:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3608aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365433600:0@lo:400: 00000100:00100000:0.0:1789708524.633689:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708524.633706:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365433856:0@lo:400: 00000100:00100000:2.0:1789708524.633707:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365433472 00000100:00100000:2.0:1789708524.633714:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365433472 00000100:00100000:3.0:1789708524.633715:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.633742:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365433728 00000100:00100000:2.0:1789708524.633747:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365433728 00000100:00100000:0.0:1789708524.633753:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708524.633764:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708524.633778:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365433472:12345-0@lo:400: 00000100:00100000:2.0:1789708524.633784:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708524.633792:0:6483:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789708524.633798:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365433728:12345-0@lo:400: 00000100:00100000:0.0:1789708524.633803:0:6483:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789708524.633822:0:6485:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789708524.633834:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708524.633842:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876645365433344:12345-0@lo:38: 00000100:00100000:3.0:1789708524.633844:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365433472:12345-0@lo:400: Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.633856:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708524.633862:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365433728:12345-0@lo:400: Request processed in 69us (203us total) trans 0 rc 0/0 00010000:00080000:0.0:1789708524.633868:0:6485:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 95 last 0 00000100:00100000:2.0:1789708524.633874:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708524.633885:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365433600 00000100:00100000:3.0:1789708524.633891:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365433600 00000020:00000080:0.0:1789708524.633908:0:6485:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf45f43947e47caae 00000100:00100000:3.0:1789708524.633916:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365433856 00000100:00100000:3.0:1789708524.633921:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365433856 00000004:00100000:0.0:1789708524.633921:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789708524.633949:0:6485:0:(import.c:65:import_set_state_nolock()) ffff9bed084f5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708524.633956:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789708524.633966:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365433600:12345-0@lo:400: 00000100:00100000:0.0:1789708524.634005:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876645365433344:12345-0@lo:38: Request processed in 163us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708524.634012:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708524.634017:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365433600:12345-0@lo:400: Request processed in 51us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.634026:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708524.634052:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708524.634058:0:6488:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789708524.634064:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365433856:12345-0@lo:400: 00000100:00100000:3.0:1789708524.634068:0:6488:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789708524.634099:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3608aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365433600:0@lo:400: 00010000:00080000:3.0:1789708524.634115:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bee36088380 x1876645365433472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708524.634125:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365433472:0@lo:400: 00000100:00100000:0.0:1789708524.634147:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365433856:12345-0@lo:400: Request processed in 72us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708524.634156:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708524.634191:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365433856:0@lo:400: 00010000:00080000:2.0:1789708524.634203:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bee3622f480 x1876645365433344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789708524.634209:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bee36088e00 x1876645365433728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000004:3.0:1789708524.634235:0:8419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000100:00100000:2.0:1789708524.634238:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1789708524.634241:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365433728:0@lo:400: 00000100:00080000:2.0:1789708524.634246:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789708524.634254:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789708524.634279:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000020:00000080:3.0:1789708524.634281:0:8419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9bed086719c0) 00000100:00080000:2.0:1789708524.634282:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08567800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789708524.634293:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365433344:0@lo:38: 00000020:00000080:3.0:1789708524.634300:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1789708524.634391:0:8419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee2f569800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789708524.634396:0:8419:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee2f569800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789708524.634399:0:8419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee2f569800 3 00010000:00080000:3.0:1789708524.634431:0:8419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed08567000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789708524.636768:0:8419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1789708524.636930:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789708524.636970:0:8419:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789708524.636981:0:8419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf45f43947e47cabc 00000100:00080000:3.0:1789708524.636989:0:8419:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708524.636998:0:8419:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9bed08567000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708524.637024:0:8419:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622ed80 x1876645365433984/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708524.637059:0:8419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789708524.637087:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876645365433984:0@lo:38: 00000100:00100000:2.0:1789708524.637147:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708524.637171:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365433984 00000100:00100000:3.0:1789708524.637177:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365433984 00000100:00100000:3.0:1789708524.637212:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708524.637220:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876645365433984:12345-0@lo:38: 00010000:00080000:3.0:1789708524.637239:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 95 last 0 00000020:00000080:3.0:1789708524.637297:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf45f43947e47cac3 00000004:00100000:3.0:1789708524.637312:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789708524.637341:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9bed08560000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708524.637400:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876645365433984:12345-0@lo:38: Request processed in 179us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.637408:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789708524.637425:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bee3622ed80 x1876645365433984/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708524.637436:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789708524.637443:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789708524.637450:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789708524.637454:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789708524.637458:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08567000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789708524.637465:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876645365433984:0@lo:38: 00000040:00080000:3.0:1789708524.637518:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789708524.637590:0:8390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789708524.637638:0:8390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789708524.637651:0:8390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.637660:0:8390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789708524.637725:0:8390:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789708524.637732:0:8390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789708524.637733:0:8390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708524.637734:0:8390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708524.637735:0:8390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708524.637736:0:8390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708524.637737:0:8390:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708524.637738:0:8390:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789708524.637739:0:8390:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789708524.637740:0:8390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708524.637741:0:8390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789708524.637744:0:8390:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789708524.637746:0:8390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789708524.637748:0:8390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789708524.637750:0:8390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708524.637751:0:8390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708524.637752:0:8390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708524.637753:0:8390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708524.637755:0:8390:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708524.637756:0:8390:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789708524.637757:0:8390:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789708524.637759:0:8390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708524.637760:0:8390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789708524.637791:0:8390:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789708524.637802:0:8390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365434112:0@lo:253: 00000100:00100000:2.0:1789708524.637844:0:8390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.637880:0:8390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708524.637890:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365434112 00000100:00100000:3.0:1789708524.637895:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365434112 00000100:00100000:3.0:1789708524.637936:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789708524.637954:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365434112:12345-0@lo:253: 20000000:01000000:3.0:1789708524.637975:0:6478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789708524.637989:0:6478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789708524.640328:0:6478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789708524.640344:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789708524.640360:0:6499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789708524.640366:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789708524.640385:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640402:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebe600/0xf45f43947e47c9dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c9d5 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640410:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188ac400/0xf45f43947e47c9f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47c9f1 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640432:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640465:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188ac400/0xf45f43947e47c9f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c9f1 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640479:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee188ac400/0xf45f43947e47c9f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c9f1 expref: 14 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.640493:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365434240:0@lo:104: 00000100:00100000:2.0:1789708524.640533:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708524.640552:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:8390:x1876645365434112:12345-0@lo:253: Request processed in 2600us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708524.640562:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:2.0:1789708524.640578:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebe600/0xf45f43947e47c9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47c9d5 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640586:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebe600/0xf45f43947e47c9dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47c9d5 expref: 13 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708524.640587:0:8390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:8390:1876645365434112:0@lo:253: 00000100:00100000:2.0:1789708524.640601:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365434368:0@lo:104: 00000100:00100000:0.0:1789708524.640604:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365434240 10000000:01000000:1.0:1789708524.640605:0:8390:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789708524.640609:0:8390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000100:00100000:0.0:1789708524.640609:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365434240 00000020:01000004:1.0:1789708524.640617:0:8390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789708524.640618:0:8390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708524.640620:0:8390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708524.640621:0:8390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708524.640623:0:8390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708524.640625:0:8390:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:2.0:1789708524.640628:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1789708524.640629:0:8390:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708524.640632:0:8390:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708524.640633:0:8390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708524.640635:0:8390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1789708524.640653:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0651f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708524.640656:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000020:02000000:1.0:1789708524.640663:0:8390:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789708524.640666:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365434368 00000100:00100000:0.0:1789708524.640670:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365434368 00000100:00100000:2.0:1789708524.640673:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708524.640686:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6499:x1876645365434240:12345-0@lo:104: 00000100:00100000:0.0:1789708524.640695:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708524.640705:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f6ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6499:x1876645365434368:12345-0@lo:104: 00010000:00010000:2.0:1789708524.640711:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47c9f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.640715:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47c9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640775:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789708524.640782:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6499:x1876645365434240:12345-0@lo:104: Request processed in 101us (249us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708524.640784:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708524.640793:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f6ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6499:x1876645365434368:12345-0@lo:104: Request processed in 90us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708524.640805:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708524.640811:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789708524.640826:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708524.640833:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47c9f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640841:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebfe00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708524.640845:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47c9f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640853:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47c9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.640855:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1789708524.640861:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47c9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.640864:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47c9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708524.640873:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708524.640876:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee0165aa00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708524.640880:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47c9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.640886:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47c9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708524.640892:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47c9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708524.640895:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708524.640905:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47c9f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.640912:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47c9d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640913:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708524.640919:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708524.640934:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47c9d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.640936:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47c9f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.640940:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47c9d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9dc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.640946:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365434496:0@lo:103: 00010000:00010000:2.0:1789708524.640951:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47c9f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47c9f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708524.640961:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708524.640965:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708524.640968:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708524.640972:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708524.640976:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708524.640978:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365434624:0@lo:103: 00010000:00010000:2.0:1789708524.640980:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708524.640992:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.641021:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365434240:0@lo:104: 00000100:00100000:0.0:1789708524.641024:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708524.641056:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365434368:0@lo:104: 00000100:00100000:3.0:1789708524.641062:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365434496 00000100:00100000:3.0:1789708524.641068:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365434496 00010000:00010000:2.0:1789708524.641070:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.641088:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188ac400/0xf45f43947e47c9f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c9f1 expref: 14 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.641113:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365434624 00000100:00100000:3.0:1789708524.641117:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365434624 00000100:00100000:2.0:1789708524.641121:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708524.641131:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:3615:x1876645365434496:12345-0@lo:103: 00010000:00010000:3.0:1789708524.641132:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebe600/0xf45f43947e47c9dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c9d5 expref: 15 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.641139:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708524.641145:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188ac400/0xf45f43947e47c9f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c9f1 expref: 15 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.641153:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188ac400/0xf45f43947e47c9f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c9f1 expref: 15 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.641162:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789708524.641164:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ac400/0xf45f43947e47c9f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c9f1 expref: 15 pid: 6479 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.641174:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708524.641175:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:3616:x1876645365434624:12345-0@lo:103: 00010000:00010000:3.0:1789708524.641188:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708524.641193:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebe600/0xf45f43947e47c9dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47c9d5 expref: 14 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.641202:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:3615:x1876645365434496:12345-0@lo:103: Request processed in 74us (212us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708524.641207:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebe600/0xf45f43947e47c9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47c9d5 expref: 14 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708524.641210:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708524.641221:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365434496:0@lo:103: 00010000:00010000:3.0:1789708524.641228:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebe600/0xf45f43947e47c9dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47c9d5 expref: 13 pid: 6478 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.641246:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.641289:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789708524.641301:0:6471:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000935960s 00010000:00010000:3.0:1789708524.641305:0:6471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.641311:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.641318:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.641325:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.641330:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708524.641334:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.641341:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.641357:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708524.641368:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708524.641369:0:6499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.641376:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708524.641380:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47caca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708524.641404:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:3616:x1876645365434624:12345-0@lo:103: Request processed in 234us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708524.641413:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708524.641430:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365434624:0@lo:103: 00080000:10000000:1.0:1789708524.644028:0:8390:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789708524.644204:0:8390:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789708524.644479:0:8390:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789708524.644588:0:8390:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789708524.644758:0:8390:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789708524.644958:0:8390:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789708524.645636:0:8390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789708524.649769:0:8390:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789708524.649776:0:8390:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789708524.649809:0:8390:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789708524.649845:0:8390:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789708524.649864:0:8390:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789708524.649879:0:8390:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789708524.650716:0:8390:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708524.650919:0:8390:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:1.0:1789708524.926548:0:8477:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708524.926673:0:8477:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789708525.158331:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708525.414384:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365434752:0@lo:41: 00000100:00100000:2.0:1789708525.414440:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708525.414470:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365434752 00000100:00100000:0.0:1789708525.414478:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365434752 00000100:00100000:0.0:1789708525.414528:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708525.414538:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365434752:12345-0@lo:41: 00000004:00000024:0.0:1789708525.414567:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789708525.414608:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365434752:12345-0@lo:41: Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708525.414613:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789708525.414644:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365434752:0@lo:41: 00010000:00010000:0.0:1789708526.182359:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789708526.403082:0:8766:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1789708526.690554:0:8818:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708526.690682:0:8818:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789708527.206395:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708528.230346:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789708528.249676:0:8919:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708528.249803:0:8919:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789708528.486403:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365434880:0@lo:41: 00000100:00100000:0.0:1789708528.486457:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708528.486494:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365434880 00000100:00100000:2.0:1789708528.486503:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365434880 00000100:00100000:2.0:1789708528.486554:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708528.486566:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365434880:12345-0@lo:41: 00000004:00000024:2.0:1789708528.486600:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1789708528.486652:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365434880:12345-0@lo:41: Request processed in 90us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708528.486658:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708528.486702:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365434880:0@lo:41: 00000020:00000004:0.0:1789708528.521661:0:8967:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708528.521667:0:8967:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1789708529.254362:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789708529.510325:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789708529.510332:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee36337800 from 30 10000000:01000000:1.0:1789708529.510337:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789708529.510379:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.510392:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.510401:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708529.510420:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435008:0@lo:101: 00000100:00100000:1.0:1789708529.510493:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.510538:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.511072:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365435008 00000100:00100000:0.0:1789708529.511079:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365435008 00000100:00100000:0.0:1789708529.511131:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789708529.511148:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+12:6481:x1876645365435008:12345-0@lo:101: 00010000:00010000:0.0:1789708529.511162:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708529.511174:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebe400/0xf45f43947e47cad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cad1 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708529.511199:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebe400/0xf45f43947e47cad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cad1 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708529.511210:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebe400/0xf45f43947e47cad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cad1 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708529.511229:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebe400, rc 0) 00000100:00100000:0.0:1789708529.511304:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:6481:x1876645365435008:12345-0@lo:101: Request processed in 162us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.511311:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789708529.511366:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435008:0@lo:101: 00010000:00010000:0.0:1789708529.511383:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708529.511396:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708529.511459:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36089880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435136:0@lo:501: 00000100:00100000:0.0:1789708529.511487:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.511529:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7639c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708529.511534:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365435136 00000100:00100000:3.0:1789708529.511541:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365435136 00000100:00100000:3.0:1789708529.511573:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789708529.511582:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:6481:x1876645365435136:12345-0@lo:501: 00000100:00100000:3.0:1789708529.511700:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:6481:x1876645365435136:12345-0@lo:501: Request processed in 119us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708529.511709:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789708529.511726:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36089880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435136:0@lo:501: 00000100:00100000:0.0:1789708529.511769:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36089880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435264:0@lo:503: 00000100:00100000:0.0:1789708529.511814:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.511829:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7639c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.511842:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365435264 00000100:00100000:0.0:1789708529.511844:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365435264 00000100:00100000:0.0:1789708529.511867:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789708529.511874:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:6481:x1876645365435264:12345-0@lo:503: 00000100:00100000:0.0:1789708529.511970:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:6481:x1876645365435264:12345-0@lo:503: Request processed in 97us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.511977:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789708529.511991:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36089880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435264:0@lo:503: 00000100:00100000:3.0:1789708529.512525:0:9128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9128:1876645365435392:0@lo:502: 00000100:00100000:3.0:1789708529.512567:0:9128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.512598:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365435392 00000100:00100000:3.0:1789708529.512602:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365435392 00000100:00100000:3.0:1789708529.512634:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789708529.512645:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:9128:x1876645365435392:12345-0@lo:502: 00000100:00100000:3.0:1789708529.512744:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:9128:x1876645365435392:12345-0@lo:502: Request processed in 103us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708529.512752:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789708529.512794:0:9128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708529.512811:0:9128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9128:1876645365435392:0@lo:502: 00000100:00100000:3.0:1789708529.512855:0:9128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9128:1876645365435520:0@lo:502: 00000100:00100000:3.0:1789708529.512899:0:9128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.512918:0:9128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.514154:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365435520 00000100:00100000:0.0:1789708529.514160:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365435520 00000100:00100000:0.0:1789708529.514207:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789708529.514217:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:9128:x1876645365435520:12345-0@lo:502: 00000100:00100000:0.0:1789708529.514314:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:9128:x1876645365435520:12345-0@lo:502: Request processed in 100us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.514319:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789708529.515353:0:9128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9128:1876645365435520:0@lo:502: 00000040:00080000:3.0:1789708529.515397:0:9128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789708529.515472:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789708529.515499:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789708529.515508:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708529.515520:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708529.515530:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708529.515533:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee36337800 from 5 10000000:01000000:3.0:1789708529.515536:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708529.515561:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708529.515568:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708529.515577:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708529.515597:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435648:0@lo:101: 00000100:00100000:3.0:1789708529.515637:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.515681:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365435648 00000100:00100000:0.0:1789708529.515686:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365435648 00000100:00100000:3.0:1789708529.515687:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.515722:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789708529.515732:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+13:6481:x1876645365435648:12345-0@lo:101: 00010000:00010000:0.0:1789708529.515742:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708529.515758:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebfa00/0xf45f43947e47cae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cadf expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708529.515775:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebfa00/0xf45f43947e47cae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cadf expref: 14 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708529.515782:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebfa00/0xf45f43947e47cae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cadf expref: 14 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708529.515788:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebfa00, rc 0) 00000100:00100000:0.0:1789708529.515815:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:6481:x1876645365435648:12345-0@lo:101: Request processed in 87us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.515819:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789708529.515847:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435648:0@lo:101: 00010000:00010000:3.0:1789708529.515862:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708529.515870:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708529.515925:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435776:0@lo:256: 00000100:00100000:3.0:1789708529.515972:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.515988:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708529.516003:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365435776 00000100:00100000:3.0:1789708529.516007:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365435776 00000100:00100000:3.0:1789708529.516030:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789708529.516037:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:6481:x1876645365435776:12345-0@lo:256: 20000000:01000000:3.0:1789708529.516049:0:6478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789708529.516064:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789708529.516068:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789708529.516154:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:6481:x1876645365435776:12345-0@lo:256: Request processed in 118us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708529.516161:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789708529.516425:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435776:0@lo:256: 10000000:01000000:3.0:1789708529.516475:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708529.516481:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708529.516489:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708529.516496:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789708529.516498:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1789708529.516500:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789708529.516514:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708529.516530:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708529.516537:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708529.516608:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435904:0@lo:101: 00000100:00100000:3.0:1789708529.516638:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.516667:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708529.516685:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365435904 00000100:00100000:3.0:1789708529.516689:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365435904 00000100:00100000:3.0:1789708529.516722:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789708529.516731:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:6481:x1876645365435904:12345-0@lo:101: 00010000:00010000:3.0:1789708529.516738:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708529.516748:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01508c00/0xf45f43947e47caf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47caed expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708529.516763:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01508c00/0xf45f43947e47caf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47caed expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708529.516771:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01508c00/0xf45f43947e47caf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47caed expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708529.516778:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508c00, rc 0) 00000100:00100000:3.0:1789708529.516812:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365435904:12345-0@lo:101: Request processed in 84us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708529.516818:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789708529.516849:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365435904:0@lo:101: 00010000:00010000:2.0:1789708529.516862:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.516871:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708529.516929:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365436032:0@lo:501: 00000100:00100000:2.0:1789708529.516980:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.517000:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67900 going to sleep for 11 seconds 00000100:00100000:2.0:1789708529.517012:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365436032 00000100:00100000:2.0:1789708529.517016:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365436032 00000100:00100000:2.0:1789708529.517044:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789708529.517050:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365436032:12345-0@lo:501: 00000100:00100000:2.0:1789708529.517147:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365436032:12345-0@lo:501: Request processed in 96us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.517156:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789708529.517165:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365436032:0@lo:501: 00000100:00100000:3.0:1789708529.517211:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365436160:0@lo:503: 00000100:00100000:3.0:1789708529.517253:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.517304:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365436160 00000100:00100000:2.0:1789708529.517309:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365436160 00000100:00100000:0.0:1789708529.517338:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789708529.517346:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365436160:12345-0@lo:503: 00000100:00100000:3.0:1789708529.517383:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.517432:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365436160:12345-0@lo:503: Request processed in 86us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.517445:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789708529.517471:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365436160:0@lo:503: 00000100:00100000:3.0:1789708529.517763:0:9129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9129:1876645365436288:0@lo:502: 00000100:00100000:3.0:1789708529.517846:0:9129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.517868:0:9129:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.517881:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365436288 00000100:00100000:0.0:1789708529.517886:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365436288 00000100:00100000:0.0:1789708529.517913:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789708529.517920:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9129:x1876645365436288:12345-0@lo:502: 00000100:00100000:0.0:1789708529.518013:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9129:x1876645365436288:12345-0@lo:502: Request processed in 93us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.518020:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789708529.518040:0:9129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9129:1876645365436288:0@lo:502: 00000020:01000000:3.0:1789708529.518064:0:9129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789708529.518071:0:9129:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789708529.518077:0:9129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708529.518080:0:9129:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789708529.518086:0:9129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789708529.518090:0:9129:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:3.0:1789708529.518113:0:9129:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789708529.518118:0:9129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789708529.518131:0:9129:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9bed08673380) 00000020:00000080:3.0:1789708529.518147:0:9129:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1789708529.518154:0:9129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789708529.518244:0:9129:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789708529.518250:0:9129:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789708529.518257:0:9129:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47cb02 00010000:00080000:3.0:1789708529.518689:0:9129:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee3dd52800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789708529.518882:0:9129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789708529.523117:0:9129:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789708529.523130:0:9129:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789708529.523238:0:9129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708529.523428:0:9129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708529.523511:0:9129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789708529.523587:0:9129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789708529.523753:0:9132:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708529.523756:0:9132:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789708529.524154:0:9129:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789708529.524164:0:9129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789708529.524197:0:9129:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789708529.524217:0:9129:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47cb09 00000100:00080000:1.0:1789708529.524227:0:9129:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708529.524236:0:9129:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bee3dd52800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708529.524540:0:9129:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee048f0e00 x1876645365436416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708529.524558:0:9129:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789708529.524576:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365436416:0@lo:8: 00000020:01000000:1.0:1789708529.524618:0:9129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708529.524622:0:9129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708529.524624:0:9129:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789708529.524626:0:9129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708529.524630:0:9129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708529.524631:0:9129:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789708529.524636:0:9129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789708529.524637:0:9129:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789708529.524643:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.524661:0:9129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9129:1876645365437312:0@lo:502: 00000100:00100000:2.0:1789708529.524696:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365436800:0@lo:400: 00000100:00100000:1.0:1789708529.524704:0:9129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.524706:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365436544:0@lo:400: 00000100:00100000:1.0:1789708529.524724:0:9129:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789708529.524733:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.524748:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365436672:0@lo:400: 00000100:00100000:1.0:1789708529.524763:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365436800 00000100:00100000:1.0:1789708529.524768:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365436800 00000100:00100000:2.0:1789708529.524774:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789708529.524785:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365436928:0@lo:400: 00000100:00100000:0.0:1789708529.524789:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.524811:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708529.524819:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365437184:0@lo:400: 00000100:00100000:1.0:1789708529.524825:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365436800:12345-0@lo:400: 00000100:00100000:2.0:1789708529.524826:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.524851:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.524875:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365436672 00000100:00100000:2.0:1789708529.524882:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365436672 00000100:00100000:1.0:1789708529.524885:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365436800:12345-0@lo:400: Request processed in 65us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.524892:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708529.524894:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365436416 00000100:00100000:0.0:1789708529.524898:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365436416 00000100:00100000:1.0:1789708529.524915:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365437184 00000100:00100000:2.0:1789708529.524917:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365436928 00000100:00100000:1.0:1789708529.524919:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365437184 00000100:00100000:2.0:1789708529.524922:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365436928 00000100:00100000:0.0:1789708529.524924:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708529.524930:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876645365436416:12345-0@lo:8: 00010000:00080000:0.0:1789708529.524960:0:8397:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 100 last 0 00000100:00100000:2.0:1789708529.524966:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708529.524969:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708529.524983:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365436672:12345-0@lo:400: 00000100:00100000:1.0:1789708529.524983:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365437184:12345-0@lo:400: 00000020:00000080:0.0:1789708529.524984:0:8397:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47cb10 00002000:00100000:0.0:1789708529.525011:0:8397:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9bed084f6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789708529.525015:0:8397:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1789708529.525018:0:8397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789708529.525031:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365437184:12345-0@lo:400: Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.525036:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708529.525041:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365436672:12345-0@lo:400: Request processed in 63us (254us total) trans 0 rc 0/0 00002000:00100000:0.0:1789708529.525047:0:8397:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789708529.525058:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789708529.525058:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708529.525085:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789708529.525087:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365436672:0@lo:400: 00000100:00100000:2.0:1789708529.525098:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365436928:12345-0@lo:400: 00010000:00080000:1.0:1789708529.525107:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3622c000 x1876645365437184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708529.525114:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365437184:0@lo:400: 00000100:00100000:1.0:1789708529.525143:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365436928:0@lo:400: 00000100:00100000:2.0:1789708529.525146:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365436928:12345-0@lo:400: Request processed in 51us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.525155:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789708529.525157:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3622e680 x1876645365436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708529.525165:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365436800:0@lo:400: 00000100:00100000:2.0:1789708529.525191:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.525219:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365437056:0@lo:400: 00002000:00080000:0.0:1789708529.525241:0:8397:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:2.0:1789708529.525252:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789708529.525284:0:8397:0:(import.c:65:import_set_state_nolock()) ffff9bed084f0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708529.525309:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365436544 00000100:00100000:1.0:1789708529.525313:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365436544 00000100:00100000:2.0:1789708529.525324:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365437056 00000100:00100000:2.0:1789708529.525330:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365437056 00000100:00100000:0.0:1789708529.525334:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3614:x1876645365436416:12345-0@lo:8: Request processed in 402us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.525342:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708529.525342:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708529.525355:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365436544:12345-0@lo:400: 00000100:00100000:0.0:1789708529.525368:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365437312 00000100:00100000:0.0:1789708529.525372:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365437312 00000100:00100000:2.0:1789708529.525376:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708529.525387:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365437056:12345-0@lo:400: 00000100:00100000:1.0:1789708529.525395:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365436544:12345-0@lo:400: Request processed in 45us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.525401:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708529.525405:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789708529.525413:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9129:x1876645365437312:12345-0@lo:502: 00000100:00080000:1.0:1789708529.525422:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708529.525435:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365437056:12345-0@lo:400: Request processed in 50us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.525442:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789708529.525446:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3622f100 x1876645365436544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708529.525468:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365436544:0@lo:400: 00010000:00080000:1.0:1789708529.525487:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3622f800 x1876645365437056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708529.525497:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365437056:0@lo:400: 00000100:00100000:0.0:1789708529.525507:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9129:x1876645365437312:12345-0@lo:502: Request processed in 94us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.525513:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789708529.525526:0:9129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9129:1876645365437312:0@lo:502: 00000020:01000000:2.0:1789708529.525554:0:9129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708529.525559:0:9129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708529.525562:0:9129:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789708529.525566:0:9129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00010000:00080000:0.0:1789708529.525572:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee048f0e00 x1876645365436416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708529.525579:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708529.525584:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789708529.525589:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789708529.525593:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789708529.525594:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3dd52800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789708529.525609:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789708529.525615:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365436416:0@lo:8: 00000020:01000000:2.0:1789708529.525624:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 00000100:00100000:1.0:1789708529.525631:0:9133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9133:1876645365437440:0@lo:700: 00000004:00080000:0.0:1789708529.525634:0:9132:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 10000000:01000000:2.0:1789708529.525655:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:1.0:1789708529.525661:0:9133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708529.525665:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789708529.525672:0:9132:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 100335410506ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789708529.525676:0:9133:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005c3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789708529.525678:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1789708529.525678:0:9132:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 10000000:01000000:2.0:1789708529.525695:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789708529.525698:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee36337800 from 1 10000000:01000000:2.0:1789708529.525702:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:0.0:1789708529.525708:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365437440 00000100:00100000:0.0:1789708529.525712:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365437440 00010000:00010000:2.0:1789708529.525725:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.525734:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.525743:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708529.525750:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708529.525759:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365437568:0@lo:101: 00000100:00100000:0.0:1789708529.525761:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9133:x1876645365437440:12345-0@lo:700: 00000100:00100000:0.0:1789708529.525797:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3608ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8405:1876645365437696:0@lo:700: 00000100:00100000:2.0:1789708529.525798:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.525823:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.525840:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.525844:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365437568 00000100:00100000:2.0:1789708529.525849:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365437568 00000100:00100000:0.0:1789708529.525855:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.525870:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365437696 00000100:00100000:0.0:1789708529.525874:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365437696 00000100:00100000:2.0:1789708529.525883:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789708529.525890:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708529.525895:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365437568:12345-0@lo:101: 00000100:00100000:0.0:1789708529.525901:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789708529.525906:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789708529.525908:0:6491:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 2 min 2 max 256 00000100:00100000:0.0:1789708529.525909:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8405:x1876645365437696:12345-0@lo:700: 00000100:00100000:1.0:1789708529.525917:0:6491:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0002' 00010000:00010000:2.0:1789708529.525921:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47cb1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cb17 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.525943:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47cb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cb17 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.525968:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47cb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb17 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.525988:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebda00, rc 0) 00000100:00100000:2.0:1789708529.526025:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365437568:12345-0@lo:101: Request processed in 134us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.526031:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789708529.526069:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365437568:0@lo:101: 00010000:00010000:2.0:1789708529.526081:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.526090:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708529.526132:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365437824:0@lo:501: 00000100:00100000:2.0:1789708529.526156:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.526179:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.526193:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365437824 00000100:00100000:0.0:1789708529.526197:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365437824 00000100:00100000:0.0:1789708529.526231:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789708529.526238:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365437824:12345-0@lo:501: 00000100:00100000:0.0:1789708529.526373:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365437824:12345-0@lo:501: Request processed in 136us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.526380:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789708529.526410:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365437824:0@lo:501: 00000100:00100000:2.0:1789708529.526474:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365437952:0@lo:503: 00000100:00100000:2.0:1789708529.526514:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.526541:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365437952 00000100:00100000:0.0:1789708529.526545:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365437952 00000100:00100000:2.0:1789708529.526565:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.526577:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789708529.526586:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365437952:12345-0@lo:503: 00000100:00100000:0.0:1789708529.526656:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365437952:12345-0@lo:503: Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.526662:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789708529.526674:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365437952:0@lo:503: 00000004:00080000:2.0:1789708529.526815:0:7415:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789708529.526913:0:9136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9136:1876645365438080:0@lo:502: 00000100:00100000:0.0:1789708529.526941:0:9136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.526970:0:9136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.526978:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365438080 00000100:00100000:1.0:1789708529.526983:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365438080 00000100:00100000:1.0:1789708529.527012:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789708529.527020:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9136:x1876645365438080:12345-0@lo:502: 00000100:00100000:1.0:1789708529.527101:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9136:x1876645365438080:12345-0@lo:502: Request processed in 82us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.527107:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789708529.527111:0:9136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9136:1876645365438080:0@lo:502: 00000020:01000000:0.0:1789708529.527150:0:9136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708529.527156:0:9136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708529.527158:0:9136:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789708529.527169:0:9136:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee36337800 00000020:00000080:0.0:1789708529.527173:0:9136:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789708529.527194:0:9136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9136:1876645365438208:0@lo:502: 00000100:00100000:0.0:1789708529.527231:0:9136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.527248:0:9136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.527251:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365438208 00000100:00100000:1.0:1789708529.527255:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365438208 00000100:00100000:1.0:1789708529.527305:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789708529.527314:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9136:x1876645365438208:12345-0@lo:502: 00000100:00100000:1.0:1789708529.527395:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9136:x1876645365438208:12345-0@lo:502: Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.527404:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789708529.527407:0:9136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9136:1876645365438208:0@lo:502: 00000020:01000000:0.0:1789708529.527434:0:9136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708529.527438:0:9136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708529.527440:0:9136:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789708529.527445:0:9136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789708529.527556:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789708529.527577:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708529.527582:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.527606:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708529.527625:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789708529.527626:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee02bf3800 from 30 10000000:01000000:2.0:1789708529.527628:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789708529.527640:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.527645:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.527651:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708529.527682:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365438336:0@lo:101: 00000100:00100000:2.0:1789708529.527713:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.527744:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.527747:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365438336 00000100:00100000:1.0:1789708529.527757:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365438336 00000100:00100000:1.0:1789708529.527784:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789708529.527791:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365438336:12345-0@lo:101: 00010000:00010000:1.0:1789708529.527798:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708529.527808:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cb2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cb25 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.527825:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cb25 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.527834:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb25 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.527841:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ade00, rc 0) 00000100:00100000:1.0:1789708529.527872:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365438336:12345-0@lo:101: Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.527879:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789708529.527886:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365438336:0@lo:101: 00010000:00010000:2.0:1789708529.527913:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.527922:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708529.527991:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365438464:0@lo:501: 00000100:00100000:2.0:1789708529.528045:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 40000000:02000000:1.0:1789708529.528071:0:6490:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1789708529.528072:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365438464 00000100:00100000:2.0:1789708529.528073:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.528076:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365438464 00000100:00100000:0.0:1789708529.528101:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789708529.528108:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365438464:12345-0@lo:501: 00000100:00100000:0.0:1789708529.528179:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365438464:12345-0@lo:501: Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.528187:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789708529.528196:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365438464:0@lo:501: 00000100:00100000:2.0:1789708529.528231:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365438592:0@lo:503: 00000100:00100000:2.0:1789708529.528294:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.528325:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.528494:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365438592 00000100:00100000:0.0:1789708529.528498:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365438592 00000100:00100000:0.0:1789708529.528527:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789708529.528535:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365438592:12345-0@lo:503: 00000100:00100000:0.0:1789708529.528618:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365438592:12345-0@lo:503: Request processed in 83us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.528625:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789708529.528631:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365438592:0@lo:503: 00000100:00100000:1.0:1789708529.530544:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8405:x1876645365437696:12345-0@lo:700: Request processed in 4636us (4704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.530552:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789708529.530570:0:8405:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3608ad80 x1876645365437696/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789708545 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708529.530581:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3608ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8405:1876645365437696:0@lo:700: 40000000:02000000:0.0:1789708529.530594:0:8405:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:2.0:1789708529.530716:0:9138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9138:1876645365438720:0@lo:502: 00000100:00100000:2.0:1789708529.530747:0:9138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.530774:0:9138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.530785:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365438720 00000100:00100000:1.0:1789708529.530790:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365438720 00000100:00100000:1.0:1789708529.530817:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789708529.530826:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9138:x1876645365438720:12345-0@lo:502: 00000100:00100000:1.0:1789708529.530906:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9138:x1876645365438720:12345-0@lo:502: Request processed in 82us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.530914:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789708529.530917:0:9138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9138:1876645365438720:0@lo:502: 00000100:00100000:2.0:1789708529.530962:0:9138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9138:1876645365438848:0@lo:502: 00000100:00100000:2.0:1789708529.530985:0:9138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.530997:0:9138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.531006:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365438848 00000100:00100000:1.0:1789708529.531012:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365438848 00000100:00100000:1.0:1789708529.531036:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789708529.531044:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9138:x1876645365438848:12345-0@lo:502: 00000100:00100000:1.0:1789708529.531112:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9138:x1876645365438848:12345-0@lo:502: Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.531120:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789708529.531129:0:9138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9138:1876645365438848:0@lo:502: 00000040:00080000:2.0:1789708529.531147:0:9138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789708529.531186:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789708529.531212:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789708529.531219:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.531228:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708529.531235:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789708529.531237:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee02bf3800 from 5 10000000:01000000:1.0:1789708529.531240:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789708529.531255:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.531301:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.531309:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708529.531322:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365438976:0@lo:101: 00000100:00100000:1.0:1789708529.531347:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.531365:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.531382:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365438976 00000100:00100000:1.0:1789708529.531386:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365438976 00000100:00100000:1.0:1789708529.531408:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789708529.531414:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365438976:12345-0@lo:101: 00010000:00010000:1.0:1789708529.531420:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708529.531430:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cb3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cb33 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.531444:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cb33 expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.531452:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb33 expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.531460:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ac000, rc 0) 00000100:00100000:1.0:1789708529.531492:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365438976:12345-0@lo:101: Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.531498:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789708529.531501:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365438976:0@lo:101: 00010000:00010000:2.0:1789708529.531513:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.531520:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708529.531551:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365439104:0@lo:256: 00000100:00100000:2.0:1789708529.531570:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.531581:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.531595:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365439104 00000100:00100000:1.0:1789708529.531600:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365439104 00000100:00100000:1.0:1789708529.531624:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789708529.531631:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365439104:12345-0@lo:256: 20000000:01000000:1.0:1789708529.531642:0:6479:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789708529.531657:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789708529.531660:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789708529.531736:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365439104:12345-0@lo:256: Request processed in 105us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.531741:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365439104:0@lo:256: 00000100:00100000:1.0:1789708529.531746:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 10000000:01000000:2.0:1789708529.531773:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789708529.531776:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.531781:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708529.531786:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789708529.531787:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789708529.531788:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789708529.531797:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.531801:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.531806:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708529.531812:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365439232:0@lo:101: 00000100:00100000:2.0:1789708529.531827:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.531837:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.531853:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365439232 00000100:00100000:1.0:1789708529.531862:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365439232 00000100:00100000:1.0:1789708529.531888:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789708529.531896:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365439232:12345-0@lo:101: 00010000:00010000:1.0:1789708529.531902:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708529.531909:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188ace00/0xf45f43947e47cb48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cb41 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.531922:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ace00/0xf45f43947e47cb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cb41 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.531930:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188ace00/0xf45f43947e47cb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb41 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.531937:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ace00, rc 0) 00000100:00100000:1.0:1789708529.532075:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365439232:12345-0@lo:101: Request processed in 180us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.532082:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789708529.532090:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365439232:0@lo:101: 00010000:00010000:2.0:1789708529.532098:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.532103:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708529.532135:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365439360:0@lo:501: 00000100:00100000:2.0:1789708529.532150:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.532160:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.532176:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365439360 00000100:00100000:1.0:1789708529.532180:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365439360 00000100:00100000:1.0:1789708529.532203:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789708529.532211:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365439360:12345-0@lo:501: 00000100:00100000:1.0:1789708529.532301:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365439360:12345-0@lo:501: Request processed in 90us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.532305:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365439360:0@lo:501: 00000100:00100000:1.0:1789708529.532315:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789708529.532331:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365439488:0@lo:503: 00000100:00100000:2.0:1789708529.532354:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.532370:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.532379:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365439488 00000100:00100000:1.0:1789708529.532384:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365439488 00000100:00100000:1.0:1789708529.532407:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789708529.532413:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365439488:12345-0@lo:503: 00000100:00100000:1.0:1789708529.532488:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365439488:12345-0@lo:503: Request processed in 74us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.532491:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365439488:0@lo:503: 00000100:00100000:1.0:1789708529.532503:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789708529.532652:0:9139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9139:1876645365439616:0@lo:502: 00000100:00100000:2.0:1789708529.532679:0:9139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.532690:0:9139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67300 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.532704:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365439616 00000100:00100000:1.0:1789708529.532709:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365439616 00000100:00100000:1.0:1789708529.532734:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789708529.532742:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:9139:x1876645365439616:12345-0@lo:502: 00000100:00100000:1.0:1789708529.532818:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:9139:x1876645365439616:12345-0@lo:502: Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.532820:0:9139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9139:1876645365439616:0@lo:502: 00000100:00100000:1.0:1789708529.532832:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000020:01000000:2.0:1789708529.532842:0:9139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789708529.532846:0:9139:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789708529.532850:0:9139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708529.532851:0:9139:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789708529.532855:0:9139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789708529.532858:0:9139:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:2.0:1789708529.532872:0:9139:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789708529.532874:0:9139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708529.532884:0:9139:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bee3dd78000) 00000020:00000080:2.0:1789708529.532894:0:9139:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1789708529.532897:0:9139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789708529.532965:0:9139:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789708529.532969:0:9139:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789708529.532976:0:9139:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47cb56 00010000:00080000:2.0:1789708529.532995:0:9139:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee3fa13800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1789708529.533125:0:9139:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:1.0:1789708529.534542:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789708529.534610:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9133:x1876645365437440:12345-0@lo:700: Request processed in 8851us (8948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.534618:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789708529.534627:0:9133:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee048f2d80 x1876645365437440/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789708545 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708529.534639:0:9133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9133:1876645365437440:0@lo:700: 00000040:01000000:3.0:1789708529.535326:0:9139:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789708529.535336:0:9139:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789708529.535432:0:9139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708529.535548:0:9139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708529.535619:0:9139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789708529.535686:0:9139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789708529.535895:0:9141:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789708529.535899:0:9141:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789708529.536377:0:9139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789708529.536386:0:9139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789708529.536424:0:9139:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789708529.536442:0:9139:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47cb5d 00000100:00080000:3.0:1789708529.536449:0:9139:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708529.536457:0:9139:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bee3fa13800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708529.536483:0:9139:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622ed80 x1876645365439744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708529.536498:0:9139:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789708529.536508:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365439744:0@lo:8: 00000020:01000000:3.0:1789708529.536559:0:9139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1789708529.536564:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789708529.536565:0:9139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708529.536568:0:9139:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789708529.536571:0:9139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708529.536574:0:9139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708529.536574:0:9139:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789708529.536577:0:9139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789708529.536578:0:9139:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789708529.536595:0:9139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9139:1876645365439872:0@lo:502: 00000100:00100000:1.0:1789708529.536598:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365439744 00000100:00100000:1.0:1789708529.536604:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365439744 00000100:00100000:1.0:1789708529.536630:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708529.536639:0:9139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.536639:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876645365439744:12345-0@lo:8: 00000100:00100000:3.0:1789708529.536653:0:9139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d6c0 going to sleep for 11 seconds 00010000:00080000:1.0:1789708529.536662:0:8399:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 100 last 0 00000020:00000080:1.0:1789708529.536686:0:8399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47cb64 00002000:00100000:1.0:1789708529.536697:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bee2f6ab000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789708529.536702:0:8399:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789708529.536705:0:8399:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789708529.536753:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789708529.536771:0:8399:0:(import.c:65:import_set_state_nolock()) ffff9bee2f6ab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708529.536816:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1876645365439744:12345-0@lo:8: Request processed in 178us (253us total) trans 0 rc 0/0 00010000:00080000:0.0:1789708529.536828:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3622ed80 x1876645365439744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708529.536832:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708529.536837:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708529.536842:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789708529.536847:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789708529.536852:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00100000:1.0:1789708529.536853:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365439872 00000100:00080000:0.0:1789708529.536854:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa13800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789708529.536856:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365439872 00000004:00080000:0.0:1789708529.536863:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789708529.536869:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365439744:0@lo:8: 00000100:00100000:1.0:1789708529.536886:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000004:00080000:0.0:1789708529.536886:0:9141:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789708529.536894:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:9139:x1876645365439872:12345-0@lo:502: 00000004:00080000:0.0:1789708529.536923:0:9141:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 100346661885ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789708529.536930:0:9141:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789708529.536997:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:9139:x1876645365439872:12345-0@lo:502: Request processed in 103us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.537006:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789708529.537012:0:9139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9139:1876645365439872:0@lo:502: 00000020:01000000:3.0:1789708529.537036:0:9139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708529.537040:0:9139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708529.537042:0:9139:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789708529.537045:0:9139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789708529.537103:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789708529.537137:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789708529.537145:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.537155:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708529.537164:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789708529.537167:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee02bf3800 from 1 10000000:01000000:1.0:1789708529.537169:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000004:00080000:3.0:1789708529.537188:0:9133:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00010000:00010000:1.0:1789708529.537192:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.537201:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708529.537203:0:9133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9133:1876645365440256:0@lo:7: 00010000:00010000:1.0:1789708529.537216:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708529.537230:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365440128:0@lo:101: 00000100:00100000:3.0:1789708529.537236:0:9133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.537279:0:9133:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708529.537292:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708529.537294:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.537301:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365440000:0@lo:13: 00000100:00100000:1.0:1789708529.537320:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee083cf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.537324:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365440256 00000100:00100000:3.0:1789708529.537326:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.537332:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365440256 00000100:00100000:1.0:1789708529.537341:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365440128 00000100:00100000:1.0:1789708529.537344:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365440128 00000100:00100000:2.0:1789708529.537360:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365440000 00000100:00100000:0.0:1789708529.537367:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708529.537368:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365440000 00000100:00100000:1.0:1789708529.537371:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789708529.537380:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365440128:12345-0@lo:101: 00000100:00100000:0.0:1789708529.537380:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9133:x1876645365440256:12345-0@lo:7: 00010000:00010000:1.0:1789708529.537388:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708529.537397:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cb72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cb6b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708529.537406:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789708529.537417:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cb72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cb6b expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708529.537418:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876645365440000:12345-0@lo:13: 00010000:00010000:1.0:1789708529.537434:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cb72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb6b expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1789708529.537442:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00010000:00010000:1.0:1789708529.537443:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ada00, rc 0) 00000100:00100000:1.0:1789708529.537478:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365440128:12345-0@lo:101: Request processed in 100us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.537485:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789708529.537501:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876645365440000:12345-0@lo:13: Request processed in 86us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.537510:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789708529.537518:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3622f480 x1876645365440000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708529.537530:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365440128:0@lo:101: 00000100:00100000:3.0:1789708529.537542:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365440000:0@lo:13: 00010000:00010000:1.0:1789708529.537548:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.537558:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708529.537597:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365440384:0@lo:501: 00000100:00100000:1.0:1789708529.537632:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.537650:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee083cf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.537662:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365440384 00000100:00100000:1.0:1789708529.537666:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365440384 00000100:00100000:1.0:1789708529.537692:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789708529.537700:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365440384:12345-0@lo:501: 00000100:00100000:1.0:1789708529.537769:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365440384:12345-0@lo:501: Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.537775:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789708529.537805:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365440384:0@lo:501: 00000100:00100000:1.0:1789708529.537838:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365440512:0@lo:503: 00000100:00100000:1.0:1789708529.537872:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.537889:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee083cf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.537902:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365440512 00000100:00100000:1.0:1789708529.537905:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365440512 00000100:00100000:1.0:1789708529.537933:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789708529.537941:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365440512:12345-0@lo:503: 00000100:00100000:1.0:1789708529.538029:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365440512:12345-0@lo:503: Request processed in 88us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.538035:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789708529.538076:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365440512:0@lo:503: 00000100:00100000:3.0:1789708529.538278:0:9143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9143:1876645365440640:0@lo:502: 00000100:00100000:3.0:1789708529.538315:0:9143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.538347:0:9143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.538353:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365440640 00000100:00100000:1.0:1789708529.538359:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365440640 00000100:00100000:1.0:1789708529.538390:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789708529.538399:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:9143:x1876645365440640:12345-0@lo:502: 00000100:00100000:1.0:1789708529.538475:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:9143:x1876645365440640:12345-0@lo:502: Request processed in 77us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708529.538484:0:9143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9143:1876645365440640:0@lo:502: 00000100:00100000:1.0:1789708529.538490:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000020:01000000:3.0:1789708529.538506:0:9143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708529.538512:0:9143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708529.538513:0:9143:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789708529.538519:0:9143:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee02bf3800 00000020:00000080:3.0:1789708529.538522:0:9143:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789708529.538541:0:9143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9143:1876645365440768:0@lo:502: 00000100:00100000:3.0:1789708529.538570:0:9143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.538588:0:9143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.538603:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365440768 00000100:00100000:1.0:1789708529.538609:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365440768 00000100:00100000:1.0:1789708529.538636:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789708529.538642:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:9143:x1876645365440768:12345-0@lo:502: 00000100:00100000:1.0:1789708529.538716:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:9143:x1876645365440768:12345-0@lo:502: Request processed in 73us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.538724:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789708529.538733:0:9143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9143:1876645365440768:0@lo:502: 00000020:01000000:2.0:1789708529.538761:0:9143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708529.538768:0:9143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708529.538770:0:9143:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789708529.538775:0:9143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789708529.538839:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789708529.538871:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708529.538876:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.538884:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708529.538891:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789708529.538893:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bee18160000 from 1 10000000:01000000:1.0:1789708529.538896:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789708529.538909:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.538916:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.538923:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708529.538934:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365440896:0@lo:101: 00000100:00100000:1.0:1789708529.538980:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.539002:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708529.539018:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365440896 00000100:00100000:2.0:1789708529.539023:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365440896 00000100:00100000:2.0:1789708529.539054:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789708529.539063:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365440896:12345-0@lo:101: 00010000:00010000:2.0:1789708529.539071:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708529.539081:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cb80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cb79 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.539098:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cb79 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.539108:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb79 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708529.539130:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd000, rc 0) 00000100:00100000:2.0:1789708529.539170:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365440896:12345-0@lo:101: Request processed in 109us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.539177:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789708529.539203:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365440896:0@lo:101: 00010000:00010000:1.0:1789708529.539214:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.539222:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708529.539279:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365441024:0@lo:501: 00000100:00100000:1.0:1789708529.539309:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.539348:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.539366:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365441024 00000100:00100000:1.0:1789708529.539369:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365441024 00000100:00100000:1.0:1789708529.539393:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789708529.539400:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365441024:12345-0@lo:501: 00000100:00100000:1.0:1789708529.539455:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365441024:12345-0@lo:501: Request processed in 54us (146us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789708529.539464:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789708529.539509:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365441024:0@lo:501: 10000000:01000000:1.0:1789708529.539531:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789708529.539536:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708529.539543:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789708529.539973:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789708529.540908:0:8397:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789708529.540913:0:8397:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789708529.540937:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365441152:0@lo:13: 00000004:00080000:1.0:1789708529.540937:0:9142:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789708529.540967:0:9142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9142:1876645365441280:0@lo:7: 00000100:00100000:0.0:1789708529.540970:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9133:x1876645365440256:12345-0@lo:7: Request processed in 3593us (3732us total) trans 0 rc 0/0 00010000:00080000:3.0:1789708529.540983:0:9133:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3622e300 x1876645365440256/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789708545 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708529.540984:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708529.540995:0:9133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9133:1876645365440256:0@lo:7: 00000004:00080000:3.0:1789708529.541004:0:9133:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789708529.541008:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.541009:0:9142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.541025:0:9133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9133:1876645365441408:0@lo:5: 00000100:00100000:1.0:1789708529.541044:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365441280 00000100:00100000:1.0:1789708529.541050:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365441280 00000100:00100000:3.0:1789708529.541051:0:9133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708529.541052:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365441152 00000100:00100000:2.0:1789708529.541058:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365441152 00000100:00100000:3.0:1789708529.541074:0:9133:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.541078:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365441408 00000100:00100000:0.0:1789708529.541083:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365441408 00000100:00100000:2.0:1789708529.541092:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708529.541097:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708529.541105:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1876645365441152:12345-0@lo:13: 00000100:00100000:1.0:1789708529.541109:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:9142:x1876645365441280:12345-0@lo:7: 00002000:00000024:2.0:1789708529.541122:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789708529.541160:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1876645365441152:12345-0@lo:13: Request processed in 59us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.541166:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789708529.541202:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee048f2d80 x1876645365441152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708529.541218:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365441152:0@lo:13: 00000100:00080000:0.0:1789708529.541311:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708529.541323:0:9142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31cc0 going to sleep for 11 seconds 00002000:00080000:1.0:1789708529.543596:0:8398:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789708529.543599:0:8398:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789708529.543632:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9142:x1876645365441280:12345-0@lo:7: Request processed in 2528us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.543638:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708529.543652:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789708529.543655:0:9142:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee048f1c00 x1876645365441280/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789708545 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708529.543657:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9133:x1876645365441408:12345-0@lo:5: 00000100:00100000:0.0:1789708529.543665:0:9142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9142:1876645365441280:0@lo:7: 00000004:00080000:0.0:1789708529.543672:0:9142:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00002000:00080000:1.0:1789708529.543673:0:8398:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789708529.543688:0:9142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9142:1876645365441536:0@lo:5: 00000100:00100000:1.0:1789708529.543704:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9133:x1876645365441408:12345-0@lo:5: Request processed in 48us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708529.543708:0:9142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708529.543710:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708529.543721:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365441536 00000100:00100000:1.0:1789708529.543724:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365441536 00000100:00100000:0.0:1789708529.543727:0:9142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.543749:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708529.543753:0:8397:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789708529.543757:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9142:x1876645365441536:12345-0@lo:5: 00000100:00100000:0.0:1789708529.543760:0:8397:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:3.0:1789708529.543762:0:9133:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3622e300 x1876645365441408/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708545 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1789708529.543770:0:8398:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00000100:00100000:3.0:1789708529.543771:0:9133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9133:1876645365441408:0@lo:5: 00002000:00080000:1.0:1789708529.543775:0:8398:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000004:00080000:3.0:1789708529.543781:0:9133:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789708529.543802:0:9133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9133:1876645365441664:0@lo:5: 00000100:00100000:3.0:1789708529.543827:0:9133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708529.543853:0:9133:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.543860:0:8399:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789708529.543868:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365441664 00000100:00100000:0.0:1789708529.543871:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365441664 00000100:00100000:3.0:1789708529.544125:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708529.544131:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9133:x1876645365441664:12345-0@lo:5: 00002000:00080000:3.0:1789708529.544149:0:9145:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000001:00080000:0.0:1789708529.545691:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789708529.545703:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789708529.545785:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9142:x1876645365441536:12345-0@lo:5: Request processed in 2027us (2074us total) trans 4294967297 rc 0/0 00010000:00080000:0.0:1789708529.545796:0:9142:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee36088e00 x1876645365441536/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708545 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708529.545800:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708529.545804:0:9142:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789708529.545809:0:9142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9142:1876645365441536:0@lo:5: 00000004:00080000:0.0:1789708529.545818:0:9142:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789708529.545847:0:9142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9142:1876645365441792:0@lo:700: 00000100:00100000:0.0:1789708529.545870:0:9142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.545900:0:9142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee189e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.545914:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365441792 00000100:00100000:1.0:1789708529.545918:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365441792 00000100:00100000:1.0:1789708529.545945:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708529.545963:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9142:x1876645365441792:12345-0@lo:700: 00000100:00100000:3.0:1789708529.546165:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9133:x1876645365441664:12345-0@lo:5: Request processed in 2034us (2338us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789708529.546170:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789708529.546187:0:9133:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3622e300 x1876645365441664/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708545 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708529.546196:0:9133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9133:1876645365441664:0@lo:5: 00000004:00080000:0.0:1789708529.546202:0:9133:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789708529.546217:0:9133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:9133:1876645365441920:0@lo:900: 00000100:00100000:0.0:1789708529.546235:0:9133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.546251:0:9133:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee189e5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708529.546283:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365441920 00000100:00100000:1.0:1789708529.546288:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365441920 00000100:00100000:1.0:1789708529.546318:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708529.546324:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9133:x1876645365441920:12345-0@lo:900: 00000100:00100000:0.0:1789708529.546334:0:6495:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:0.0:1789708529.546339:0:6495:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000100:00100000:1.0:1789708529.546370:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9133:x1876645365441920:12345-0@lo:900: Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708529.546376:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789708529.546378:0:9133:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee36088700 x1876645365441920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789708545 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708529.546387:0:9133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:9133:1876645365441920:0@lo:900: 00000001:00080000:0.0:1789708529.549690:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1789708529.549758:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9142:x1876645365441792:12345-0@lo:700: Request processed in 3796us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708529.549767:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789708529.549775:0:9142:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee36088e00 x1876645365441792/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789708545 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708529.549787:0:9142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9142:1876645365441792:0@lo:700: 00000004:02000040:2.0:1789708529.550352:0:9142:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1789708529.552298:0:9142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9142:1876645365442048:0@lo:5: 00000100:00100000:2.0:1789708529.552328:0:9142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708529.552355:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365442048 00000100:00100000:0.0:1789708529.552361:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365442048 00000100:00100000:2.0:1789708529.552367:0:9142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708529.552392:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708529.552398:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9142:x1876645365442048:12345-0@lo:5: 00002000:00080000:0.0:1789708529.554625:0:8399:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789708529.554635:0:8399:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1789708529.555379:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9142:x1876645365442048:12345-0@lo:5: Request processed in 2980us (3049us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789708529.555384:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789708529.555416:0:9142:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee18001f80 x1876645365442048/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708545 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708529.555428:0:9142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9142:1876645365442048:0@lo:5: 00000004:00080000:2.0:1789708529.555436:0:9142:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1789708530.278359:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708530.534382:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708530.534400:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365442176:0@lo:41: 00000100:00100000:0.0:1789708530.534453:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708530.534483:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365442176 00000100:00100000:1.0:1789708530.534491:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365442176 00000100:00100000:1.0:1789708530.534529:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789708530.534536:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365442176:12345-0@lo:41: 00000004:00000024:1.0:1789708530.534563:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789708530.534605:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365442176:12345-0@lo:41: Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708530.534610:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708530.534665:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365442176:0@lo:41: 00010000:00010000:3.0:1789708531.302408:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789708531.451071:0:9478:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789708531.451075:0:9478:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789708531.451076:0:9478:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789708531.451244:0:9478:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bed08a9c000 00000020:01000004:0.0:1789708531.451280:0:9478:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789708531.451293:0:9478:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789708531.451306:0:9478:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bee2f48b380) 00000020:00000080:0.0:1789708531.451324:0:9478:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789708531.465025:0:9478:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789708531.465080:0:9478:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1789708531.472516:0:9478:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789708531.472698:0:9478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789708531.472708:0:9478:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789708531.472715:0:9478:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45f43947e47cb8e 00000020:01000004:1.0:1789708531.472720:0:9478:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789708531.472744:0:9478:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789708531.472749:0:9478:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789708531.472755:0:9478:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789708531.472781:0:9478:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789708531.472785:0:9478:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789708531.481143:0:9478:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789708531.481168:0:9478:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.152@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789708531.481171:0:9478:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789708531.481173:0:9478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708531.481174:0:9478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708531.481174:0:9478:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708531.481175:0:9478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708531.481176:0:9478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708531.481177:0:9478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708531.481178:0:9478:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708531.481179:0:9478:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708531.481180:0:9478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708531.481181:0:9478:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789708531.481183:0:9478:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789708531.481184:0:9478:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708531.481185:0:9478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708531.481186:0:9478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708531.481186:0:9478:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708531.481187:0:9478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708531.481187:0:9478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708531.481188:0:9478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708531.481189:0:9478:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708531.481189:0:9478:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708531.481190:0:9478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708531.481190:0:9478:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789708531.481214:0:9478:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789708531.481228:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365442304:0@lo:253: 00000100:00100000:1.0:1789708531.481302:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708531.481332:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365442304 00000100:00100000:1.0:1789708531.481337:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789708531.481340:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365442304 00000100:00100000:2.0:1789708531.481382:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789708531.481390:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:9478:x1876645365442304:12345-0@lo:253: 20000000:01000000:2.0:1789708531.481414:0:6477:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789708531.481417:0:6477:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789708531.481421:0:6477:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789708531.481423:0:6477:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789708531.481573:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708531.481649:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1789708531.481660:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789708531.481670:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1789708531.481674:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789708531.481681:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1789708531.481697:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1789708531.481772:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1789708531.481783:0:6477:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:2.0:1789708531.481785:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:2.0:1789708531.481792:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1789708531.481795:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789708531.481802:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1789708531.481805:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:2.0:1789708531.481812:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1789708531.481815:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789708531.481831:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1789708531.481844:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1789708531.481906:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1789708531.481928:0:6477:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:2.0:1789708531.481930:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:2.0:1789708531.481939:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1789708531.481942:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789708531.481949:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1789708531.481952:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:2.0:1789708531.481958:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1789708531.481961:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789708531.481967:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1789708531.481975:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1789708531.482306:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1789708531.482314:0:6477:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:2.0:1789708531.482315:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:2.0:1789708531.482322:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1789708531.482325:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789708531.482331:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1789708531.482334:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:2.0:1789708531.482341:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1789708531.482343:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789708531.482350:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1789708531.482357:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1789708531.482368:0:6477:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789708531.482370:0:6477:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789708531.482372:0:6477:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789708531.482407:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789708531.482409:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789708531.482650:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1789708531.482739:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1789708531.482751:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1789708531.482767:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1789708531.482777:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789708531.482781:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789708531.482971:0:9485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789708531.482986:0:9485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789708531.482994:0:9485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1789708531.483067:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1789708531.483079:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1789708531.483086:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1789708531.483094:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789708531.483095:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789708531.483252:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789708531.483301:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789708531.483317:0:9486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1789708531.483378:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1789708531.483390:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1789708531.483397:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1789708531.483405:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789708531.483406:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789708531.483557:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1789708531.483578:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1789708531.483589:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789708531.483662:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789708531.483674:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789708531.483681:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789708531.483689:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789708531.483690:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789708531.483836:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1789708531.483855:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1789708531.483863:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1789708531.483938:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1789708531.483950:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1789708531.483957:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:2.0:1789708531.483969:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789708531.483983:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.483994:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188ad600/0xf45f43947e47ca6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ca68 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.483999:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188adc00/0xf45f43947e47ca99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ca92 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484003:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebe400/0xf45f43947e47cad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cad1 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484007:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01508c00/0xf45f43947e47caf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47caed expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484014:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cb2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb25 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484019:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188ace00/0xf45f43947e47cb48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb41 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484022:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb79 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484027:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484045:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cb79 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484053:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cb80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cb79 expref: 21 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484060:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365442432:0@lo:104: 00000100:00100000:2.0:1789708531.484084:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708531.484112:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188ace00/0xf45f43947e47cb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cb41 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.484112:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365442432 00000100:00100000:0.0:1789708531.484118:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365442432 00010000:00010000:2.0:1789708531.484121:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee188ace00/0xf45f43947e47cb48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cb41 expref: 21 pid: 6478 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484128:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365442560:0@lo:104: 00000100:00100000:2.0:1789708531.484142:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708531.484156:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365442560 00000100:00100000:0.0:1789708531.484160:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365442560 00010000:00010000:2.0:1789708531.484166:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cb25 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484178:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cb2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cb25 expref: 21 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.484183:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708531.484190:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365442688:0@lo:104: 00000100:00100000:0.0:1789708531.484195:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789708531.484197:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6477:x1876645365442432:12345-0@lo:104: 00000100:00100000:0.0:1789708531.484209:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6477:x1876645365442560:12345-0@lo:104: 00010000:00010000:1.0:1789708531.484212:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484215:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708531.484226:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.484238:0:6467:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:2.0:1789708531.484241:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01508c00/0xf45f43947e47caf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47caed expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.484247:0:6467:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:2.0:1789708531.484251:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee01508c00/0xf45f43947e47caf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47caed expref: 21 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484288:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ce680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365442816:0@lo:104: 00010000:00010000:1.0:1789708531.484306:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789708531.484312:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789708531.484315:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6477:x1876645365442432:12345-0@lo:104: Request processed in 121us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.484319:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6477:x1876645365442560:12345-0@lo:104: Request processed in 114us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708531.484330:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708531.484336:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708531.484340:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708531.484346:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365442688 00000100:00100000:3.0:1789708531.484351:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365442688 00000100:00100000:1.0:1789708531.484355:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365442816 00000100:00100000:1.0:1789708531.484361:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365442816 00000100:00100000:3.0:1789708531.484384:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1789708531.484384:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebe400/0xf45f43947e47cad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cad1 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.484396:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789708531.484399:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebe400/0xf45f43947e47cad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cad1 expref: 21 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.484400:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6477:x1876645365442688:12345-0@lo:104: 00000100:00100000:0.0:1789708531.484411:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6477:x1876645365442816:12345-0@lo:104: 00010000:00010000:3.0:1789708531.484413:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484419:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365442944:0@lo:104: 00010000:00010000:0.0:1789708531.484426:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484462:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708531.484476:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1789708531.484477:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789708531.484483:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6477:x1876645365442688:12345-0@lo:104: Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.484487:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6477:x1876645365442816:12345-0@lo:104: Request processed in 80us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708531.484497:0:7425:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:2.0:1789708531.484498:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188adc00/0xf45f43947e47ca99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ca92 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.484503:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708531.484510:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365442944 00000100:00100000:0.0:1789708531.484511:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708531.484516:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365442944 00010000:00010000:2.0:1789708531.484517:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee188adc00/0xf45f43947e47ca99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ca92 expref: 21 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484525:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789708531.484530:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484531:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ce300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365443072:0@lo:104: 00010000:00010000:3.0:1789708531.484537:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ac800 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708531.484542:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484550:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.484556:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 10000000:00010000:3.0:1789708531.484558:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708531.484563:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789708531.484568:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6477:x1876645365442944:12345-0@lo:104: 00000100:00100000:2.0:1789708531.484572:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708531.484582:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484592:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484598:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789708531.484599:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365443072 00000100:00100000:0.0:1789708531.484605:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365443072 00010000:00010000:2.0:1789708531.484612:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188ad600/0xf45f43947e47ca6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ca68 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484614:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.484624:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789708531.484631:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789708531.484636:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee188ad600/0xf45f43947e47ca6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ca68 expref: 21 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.484637:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6477:x1876645365442944:12345-0@lo:104: Request processed in 70us (173us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708531.484641:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee188ac800/0xf45f43947e47cb79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb80 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.484644:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6477:x1876645365443072:12345-0@lo:104: 00000100:00100000:1.0:1789708531.484656:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789708531.484658:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484664:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365443328:0@lo:104: 00010000:00010000:3.0:1789708531.484673:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789708531.484677:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484681:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc200 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708531.484684:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484694:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708531.484698:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708531.484702:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708531.484702:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789708531.484710:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708531.484711:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6477:x1876645365443072:12345-0@lo:104: Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.484717:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1789708531.484725:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484730:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789708531.484739:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1814a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.484741:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789708531.484748:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.484753:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365443328 00000100:00100000:0.0:1789708531.484757:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365443328 00000100:00100000:2.0:1789708531.484760:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365442432:0@lo:104: 00000100:00100000:1.0:1789708531.484761:0:7425:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00010000:00010000:3.0:1789708531.484763:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc200/0xf45f43947e47cb41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb48 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.484774:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708531.484780:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365442560:0@lo:104: 00000100:00100000:0.0:1789708531.484785:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed084e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6477:x1876645365443328:12345-0@lo:104: 00010000:00010000:3.0:1789708531.484787:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789708531.484792:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47ca68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484794:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365442688:0@lo:104: 00010000:00010000:3.0:1789708531.484798:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484808:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ce680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365442816:0@lo:104: 00010000:00010000:3.0:1789708531.484818:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc400 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708531.484822:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.484825:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365442944:0@lo:104: 00010000:00010000:0.0:1789708531.484828:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:3.0:1789708531.484835:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.484837:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed084e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:6477:x1876645365443328:12345-0@lo:104: Request processed in 55us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708531.484843:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ce300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365443072:0@lo:104: 10000000:00010000:3.0:1789708531.484848:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.484851:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708531.484855:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6477:1876645365443328:0@lo:104: 10000000:01000000:3.0:1789708531.484859:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708531.484882:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484886:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708531.484893:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484897:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebc400/0xf45f43947e47cb25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb2c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484904:0:6477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484905:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789708531.484909:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484938:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509000 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708531.484940:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484948:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789708531.484957:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.484958:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708531.484968:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708531.484976:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708531.484976:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ad800 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708531.484983:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.484994:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485008:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708531.485013:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.485016:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485019:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47caed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47caf4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485037:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:2.0:1789708531.485037:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485041:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708531.485054:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708531.485055:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708531.485059:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485064:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708531.485067:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708531.485075:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708531.485086:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485092:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.485095:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708531.485098:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708531.485105:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.485106:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485114:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47ca92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca99 expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.485125:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee188ad800/0xf45f43947e47cad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cad8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485128:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708531.485132:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47ca68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485139:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebfc00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708531.485141:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47ca68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.485143:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708531.485147:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47ca68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.485147:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708531.485151:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1789708531.485154:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47ca68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708531.485157:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708531.485161:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708531.485174:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365443584:0@lo:103: 00010000:00010000:3.0:1789708531.485180:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47ca68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485184:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708531.485192:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47ca68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485197:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47ca68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca6f expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.485205:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708531.485207:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708531.485210:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708531.485211:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708531.485221:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365443200:0@lo:103: 00000100:00100000:2.0:1789708531.485239:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365444096:0@lo:103: 00000100:00100000:0.0:1789708531.485241:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365443584 00000100:00100000:0.0:1789708531.485246:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365443584 00000100:00100000:3.0:1789708531.485248:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708531.485283:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cb2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb25 expref: 22 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.485301:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365443840:0@lo:103: 00000100:00100000:2.0:1789708531.485307:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708531.485309:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365443200 00000100:00100000:0.0:1789708531.485311:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365443200 00000100:00100000:1.0:1789708531.485320:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365444096 00010000:00010000:0.0:1789708531.485323:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cb80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb79 expref: 23 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.485327:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365444096 00000100:00100000:3.0:1789708531.485332:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708531.485343:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:1.0:1789708531.485349:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188ad600/0xf45f43947e47ca6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ca68 expref: 24 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.485349:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365443840 00000100:00100000:0.0:1789708531.485354:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365443840 00000100:00100000:2.0:1789708531.485355:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365443456:0@lo:103: 00000100:00100000:3.0:1789708531.485360:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708531.485372:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365443712:0@lo:103: 00010000:00010000:0.0:1789708531.485373:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebe400/0xf45f43947e47cad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cad1 expref: 25 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.485383:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708531.485395:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3618:x1876645365443584:12345-0@lo:103: 00000100:00100000:0.0:1789708531.485403:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708531.485405:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708531.485406:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708531.485412:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789708531.485415:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3616:x1876645365443200:12345-0@lo:103: 00010000:00010000:0.0:1789708531.485424:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708531.485427:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cb2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb25 expref: 25 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.485430:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cb80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb79 expref: 25 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.485431:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365443712 00000100:00100000:2.0:1789708531.485436:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365443968:0@lo:103: 00000100:00100000:3.0:1789708531.485437:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365443712 00010000:00010000:1.0:1789708531.485449:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cb25 expref: 26 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485454:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01508c00/0xf45f43947e47caf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47caed expref: 26 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.485472:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708531.485473:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cb79 expref: 26 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.485474:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365443456 00000100:00100000:3.0:1789708531.485478:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365443456 00010000:00010000:3.0:1789708531.485490:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188ace00/0xf45f43947e47cb48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb41 expref: 27 pid: 6478 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.485495:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cb2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cb25 expref: 27 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.485500:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cb80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cb79 expref: 27 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.485505:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365443968 00000100:00100000:3.0:1789708531.485510:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708531.485512:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365443968 00010000:00010000:1.0:1789708531.485516:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708531.485518:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708531.485520:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+26:3618:x1876645365444096:12345-0@lo:103: 00010000:00010000:3.0:1789708531.485528:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708531.485530:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188adc00/0xf45f43947e47ca99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ca92 expref: 26 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485540:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188ad600/0xf45f43947e47ca6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ca68 expref: 26 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485548:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188ad600/0xf45f43947e47ca6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ca68 expref: 26 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.485555:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789708531.485560:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ad600/0xf45f43947e47ca6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ca68 expref: 26 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.485569:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+26:3618:x1876645365443584:12345-0@lo:103: Request processed in 173us (361us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708531.485570:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708531.485571:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3616:x1876645365443840:12345-0@lo:103: 00000100:00100000:0.0:1789708531.485571:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3616:x1876645365443200:12345-0@lo:103: Request processed in 154us (319us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708531.485587:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789708531.485588:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708531.485597:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3618:x1876645365444096:12345-0@lo:103: Request processed in 76us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.485597:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1789708531.485598:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebe400/0xf45f43947e47cad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cad1 expref: 25 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.485612:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789708531.485617:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebe400/0xf45f43947e47cad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cad1 expref: 23 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.485621:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708531.485626:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:3616:x1876645365443712:12345-0@lo:103: 00000100:00100000:0.0:1789708531.485633:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789708531.485637:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebe400/0xf45f43947e47cad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cad1 expref: 22 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.485637:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789708531.485643:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789708531.485644:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08574050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:3618:x1876645365443456:12345-0@lo:103: 00010000:00010000:1.0:1789708531.485648:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01508c00/0xf45f43947e47caf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47caed expref: 22 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.485655:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:3618:x1876645365443968:12345-0@lo:103: 00010000:00010000:2.0:1789708531.485656:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708531.485658:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708531.485666:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188ace00/0xf45f43947e47cb48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb41 expref: 21 pid: 6478 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485669:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708531.485672:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01508c00/0xf45f43947e47caf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47caed expref: 21 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485675:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188adc00/0xf45f43947e47ca99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ca92 expref: 21 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.485685:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:3616:x1876645365443840:12345-0@lo:103: Request processed in 120us (352us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708531.485697:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188ace00/0xf45f43947e47cb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cb41 expref: 21 pid: 6478 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.485700:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1789708531.485716:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01508c00/0xf45f43947e47caf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47caed expref: 20 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.485718:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188adc00/0xf45f43947e47ca99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ca92 expref: 20 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.485731:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365444096:0@lo:103: 00010000:00010000:0.0:1789708531.485745:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ace00/0xf45f43947e47cb48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cb41 expref: 19 pid: 6478 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.485746:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365443584:0@lo:103: 00010000:00010000:3.0:1789708531.485752:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188adc00/0xf45f43947e47ca99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ca92 expref: 19 pid: 6479 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.485752:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.485773:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.485792:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708531.485793:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708531.485798:0:7427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.485806:0:7427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.485813:0:7427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.485820:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.485826:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08574050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:3618:x1876645365443456:12345-0@lo:103: Request processed in 184us (426us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708531.485829:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebdc00 already unused, calling callback (ffffffffc0d676c0) 00000100:00100000:0.0:1789708531.485834:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789708531.485835:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365443456:0@lo:103: 00010000:00010000:1.0:1789708531.485837:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.485839:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:3618:x1876645365443968:12345-0@lo:103: Request processed in 185us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708531.485856:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708531.485856:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365443968:0@lo:103: 00010000:00010000:1.0:1789708531.485857:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.485879:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.485891:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708531.485892:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365443200:0@lo:103: 00010000:00010000:2.0:1789708531.485895:0:6477:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.485902:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.485904:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365443840:0@lo:103: 00010000:00010000:2.0:1789708531.485908:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cb95 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789708531.485942:0:6477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789708531.485949:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:3616:x1876645365443712:12345-0@lo:103: Request processed in 328us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.485956:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365443712:0@lo:103: 00000100:00100000:1.0:1789708531.485960:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789708531.486957:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:9478:x1876645365442304:12345-0@lo:253: Request processed in 5567us (5652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708531.486966:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789708531.486980:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365442304:0@lo:253: 10000000:01000000:1.0:1789708531.486988:0:9478:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789708531.486990:0:9478:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789708531.486996:0:9478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708531.486997:0:9478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708531.486998:0:9478:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789708531.486998:0:9478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708531.487005:0:9478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708531.487006:0:9478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708531.487007:0:9478:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789708531.487008:0:9478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708531.487009:0:9478:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789708531.487027:0:9478:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bed08a9c000 from lustre-OST0001 10000000:01000000:1.0:1789708531.487042:0:9478:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789708531.487043:0:9478:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789708531.487049:0:9478:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bee18160000 local copy 10000000:01000000:1.0:1789708531.487051:0:9478:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789708531.487064:0:9478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.487069:0:9478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.487075:0:9478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.487081:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444224:0@lo:101: 00000100:00100000:1.0:1789708531.487100:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.487118:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708531.487136:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365444224 00000100:00100000:2.0:1789708531.487141:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365444224 00000100:00100000:2.0:1789708531.487170:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789708531.487178:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+14:9478:x1876645365444224:12345-0@lo:101: 00010000:00010000:2.0:1789708531.487188:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708531.487198:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47cba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cb9c expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.487213:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47cba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cb9c expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.487223:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47cba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb9c expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.487230:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd600, rc 0) 00000100:00100000:2.0:1789708531.487303:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365444224:12345-0@lo:101: Request processed in 125us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708531.487304:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444224:0@lo:101: 00010000:00010000:1.0:1789708531.487319:0:9478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.487327:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00010000:1.0:1789708531.487329:0:9478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.487408:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444352:0@lo:501: 00000100:00100000:1.0:1789708531.487424:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.487439:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708531.487447:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365444352 00000100:00100000:2.0:1789708531.487452:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365444352 00000100:00100000:2.0:1789708531.487479:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789708531.487487:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365444352:12345-0@lo:501: 00000100:00100000:2.0:1789708531.487542:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365444352:12345-0@lo:501: Request processed in 56us (114us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789708531.487545:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444352:0@lo:501: 00000100:00100000:2.0:1789708531.487557:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 10000000:01000000:1.0:1789708531.487559:0:9478:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789708531.487579:0:9478:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789708531.487582:0:9478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.487587:0:9478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.487591:0:9478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.487600:0:9478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708531.487612:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1789708531.487613:0:9478:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bed08a9c000 10000000:01000000:1.0:1789708531.487618:0:9478:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789708531.487619:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708531.487621:0:9478:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789708531.487624:0:9478:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789708531.487629:0:9478:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789708531.487633:0:9478:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789708531.487634:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ac400 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708531.487639:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.487642:0:9478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.487652:0:9478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.487653:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708531.487667:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.487670:0:9478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708531.487681:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789708531.487686:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444480:0@lo:101: 00010000:00010000:2.0:1789708531.487701:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.487709:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708531.487714:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789708531.487724:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6ff00 going to sleep for 11 seconds 00010000:00010000:2.0:1789708531.487737:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.487746:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708531.487755:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365444608:0@lo:103: 00010000:00010000:2.0:1789708531.487758:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee188ac400/0xf45f43947e47cb9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45f43947e47cba3 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.487771:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708531.487774:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708531.487776:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365444480 00010000:00010000:2.0:1789708531.487778:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708531.487781:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708531.487790:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365444480 00000100:00100000:2.0:1789708531.487804:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365444608 00000100:00100000:2.0:1789708531.487810:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365444608 00000100:00100000:3.0:1789708531.487827:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789708531.487837:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365444480:12345-0@lo:101: 00010000:00010000:3.0:1789708531.487844:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789708531.487847:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789708531.487852:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01508e00/0xf45f43947e47cbb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cbaa expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.487859:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:3616:x1876645365444608:12345-0@lo:103: 00010000:00010000:3.0:1789708531.487869:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01508e00/0xf45f43947e47cbb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cbaa expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.487870:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708531.487879:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01508e00/0xf45f43947e47cbb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cbaa expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.487886:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47cba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cb9c expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.487887:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508e00, rc 0) 00010000:00010000:2.0:1789708531.487900:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708531.487939:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444480:0@lo:101: 00000100:00100000:3.0:1789708531.487942:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365444480:12345-0@lo:101: Request processed in 105us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708531.487947:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00010000:1.0:1789708531.487950:0:9478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.487960:0:9478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.487961:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:3616:x1876645365444608:12345-0@lo:103: Request processed in 105us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708531.487976:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708531.487979:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365444608:0@lo:103: 00000100:00100000:1.0:1789708531.488013:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444736:0@lo:501: 00000100:00100000:1.0:1789708531.488034:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.488047:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708531.488056:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365444736 00000100:00100000:2.0:1789708531.488061:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365444736 00000100:00100000:2.0:1789708531.488085:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789708531.488092:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365444736:12345-0@lo:501: 00000100:00100000:2.0:1789708531.488155:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365444736:12345-0@lo:501: Request processed in 63us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708531.488160:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444736:0@lo:501: 00000100:00100000:2.0:1789708531.488166:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789708531.488188:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444864:0@lo:503: 00000100:00100000:1.0:1789708531.488215:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.488226:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708531.488241:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365444864 00000100:00100000:3.0:1789708531.488244:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365444864 00000100:00100000:3.0:1789708531.488280:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789708531.488285:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365444864:12345-0@lo:503: 00000100:00100000:3.0:1789708531.488359:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365444864:12345-0@lo:503: Request processed in 74us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708531.488365:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789708531.488375:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444864:0@lo:503: 00000040:00080000:1.0:1789708531.488516:0:9478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708531.488558:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444992:0@lo:502: 00000100:00100000:1.0:1789708531.488585:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.488601:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708531.488613:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365444992 00000100:00100000:2.0:1789708531.488617:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365444992 00000100:00100000:2.0:1789708531.488642:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789708531.488647:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365444992:12345-0@lo:502: 00000100:00100000:2.0:1789708531.488711:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365444992:12345-0@lo:502: Request processed in 63us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708531.488717:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365444992:0@lo:502: 00000100:00100000:2.0:1789708531.488718:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000040:00080000:1.0:1789708531.488827:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789708531.488841:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789708531.488848:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789708531.488855:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789708531.488862:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789708531.488868:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789708531.488879:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445120:0@lo:502: 00000100:00100000:1.0:1789708531.488902:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.488925:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708531.488946:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365445120 00000100:00100000:3.0:1789708531.488951:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365445120 00000100:00100000:3.0:1789708531.488974:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789708531.488979:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365445120:12345-0@lo:502: 00000100:00100000:3.0:1789708531.489044:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365445120:12345-0@lo:502: Request processed in 64us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708531.489050:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445120:0@lo:502: 00000100:00100000:3.0:1789708531.489061:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000040:00080000:1.0:1789708531.489081:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789708531.489088:0:9478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1789708531.489362:0:9490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789708531.489367:0:9490:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789708531.489371:0:9490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708531.489373:0:9490:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789708531.489377:0:9490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789708531.489387:0:9490:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bed08670000) 00000020:00000080:3.0:1789708531.489407:0:9490:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789708531.489411:0:9490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789708531.490047:0:9490:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed08a9c000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789708531.490056:0:9490:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789708531.490063:0:9490:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45f43947e47cbbf 00010000:00010000:3.0:1789708531.492796:0:9490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1789708531.493025:0:9490:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789708531.494815:0:9490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789708531.494984:0:9490:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789708531.496755:0:9490:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789708531.496892:0:9490:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789708531.500526:0:9490:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789708531.501311:0:9490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789708531.501323:0:9490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708531.501331:0:9490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708531.501333:0:9490:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789708531.501338:0:9490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708531.501342:0:9490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708531.501344:0:9490:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789708531.501348:0:9490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789708531.501350:0:9490:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789708531.501366:0:9490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708531.501369:0:9490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708531.501371:0:9490:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789708531.501374:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789708531.501454:0:9478:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789708531.501489:0:9478:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789708531.501504:0:9478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.501513:0:9478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708531.501519:0:9478:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed08a9c000 from 1 10000000:01000000:3.0:1789708531.501521:0:9478:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708531.501551:0:9478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.501562:0:9478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.501570:0:9478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.501587:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445248:0@lo:101: 00000100:00100000:3.0:1789708531.501639:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708531.501679:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.501687:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365445248 00000100:00100000:0.0:1789708531.501696:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365445248 00000100:00100000:0.0:1789708531.501743:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789708531.501755:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:9478:x1876645365445248:12345-0@lo:101: 00010000:00010000:0.0:1789708531.501768:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708531.501782:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cbcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cbc6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.501807:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cbcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cbc6 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.501817:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cbcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cbc6 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.501826:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebf800, rc 0) 00000100:00100000:0.0:1789708531.501875:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365445248:12345-0@lo:101: Request processed in 122us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.501883:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789708531.501893:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445248:0@lo:101: 00010000:00010000:3.0:1789708531.501905:0:9478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.501924:0:9478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708531.501998:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445376:0@lo:501: 00000100:00100000:3.0:1789708531.502022:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708531.502036:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.502062:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365445376 00000100:00100000:0.0:1789708531.502067:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365445376 00000100:00100000:0.0:1789708531.502104:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789708531.502112:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365445376:12345-0@lo:501: 00000100:00100000:0.0:1789708531.502201:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365445376:12345-0@lo:501: Request processed in 90us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.502209:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789708531.502226:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445376:0@lo:501: 00000100:00100000:1.0:1789708531.502294:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445504:0@lo:503: 00000100:00100000:1.0:1789708531.502342:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.502372:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.502395:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365445504 00000100:00100000:0.0:1789708531.502400:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365445504 00000100:00100000:0.0:1789708531.502427:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789708531.502434:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365445504:12345-0@lo:503: 00000100:00100000:0.0:1789708531.502534:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365445504:12345-0@lo:503: Request processed in 100us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.502541:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789708531.502563:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445504:0@lo:503: 00000040:00080000:1.0:1789708531.502717:0:9478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708531.502774:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445632:0@lo:502: 00000100:00100000:1.0:1789708531.502811:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.502830:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.502845:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365445632 00000100:00100000:0.0:1789708531.502850:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365445632 00000100:00100000:0.0:1789708531.502873:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789708531.502880:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365445632:12345-0@lo:502: 00000100:00100000:0.0:1789708531.502984:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365445632:12345-0@lo:502: Request processed in 105us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.502992:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789708531.503013:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445632:0@lo:502: 00000040:00080000:1.0:1789708531.503192:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789708531.503220:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789708531.503241:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445760:0@lo:502: 00000100:00100000:1.0:1789708531.503311:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708531.503344:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365445760 00000100:00100000:2.0:1789708531.503349:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365445760 00000100:00100000:1.0:1789708531.503351:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708531.503378:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789708531.503388:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365445760:12345-0@lo:502: 00000100:00100000:2.0:1789708531.503475:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365445760:12345-0@lo:502: Request processed in 89us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708531.503482:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789708531.503492:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445760:0@lo:502: 00000040:00080000:1.0:1789708531.503536:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789708531.503544:0:9478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789708531.503805:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708531.503811:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708531.503812:0:9494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789708531.503819:0:9494:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bed08a9c000 00000020:00000080:1.0:1789708531.503821:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789708531.503834:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708531.503837:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708531.503839:0:9494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789708531.503842:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789708531.503898:0:9478:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789708531.503937:0:9478:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708531.503946:0:9478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.503953:0:9478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708531.503990:0:9478:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789708531.503992:0:9478:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bed08a9c000 10000000:01000000:2.0:1789708531.503994:0:9478:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bed08a9c000 10000000:01000000:2.0:1789708531.503997:0:9478:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789708531.504000:0:9478:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bed08a9c000 from 1 10000000:01000000:2.0:1789708531.504002:0:9478:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789708531.504015:0:9478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.504028:0:9478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.504033:0:9478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.504041:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445888:0@lo:101: 00000100:00100000:2.0:1789708531.504065:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708531.504083:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1814a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.504107:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365445888 00000100:00100000:0.0:1789708531.504112:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365445888 00000100:00100000:0.0:1789708531.504145:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789708531.504155:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:9478:x1876645365445888:12345-0@lo:101: 00010000:00010000:0.0:1789708531.504163:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708531.504172:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebe200/0xf45f43947e47cbdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cbd4 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.504187:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebe200/0xf45f43947e47cbdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cbd4 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.504197:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebe200/0xf45f43947e47cbdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cbd4 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.504204:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebe200, rc 0) 00000100:00100000:0.0:1789708531.504249:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365445888:12345-0@lo:101: Request processed in 96us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.504257:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789708531.504279:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365445888:0@lo:101: 00010000:00010000:2.0:1789708531.504295:0:9478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.504302:0:9478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708531.504354:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365446016:0@lo:501: 00000100:00100000:2.0:1789708531.504375:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708531.504411:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1814a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.504412:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365446016 00000100:00100000:0.0:1789708531.504418:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365446016 00000100:00100000:0.0:1789708531.504455:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789708531.504466:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365446016:12345-0@lo:501: 00000100:00100000:0.0:1789708531.504539:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365446016:12345-0@lo:501: Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.504546:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789708531.504559:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365446016:0@lo:501: 00000100:00100000:1.0:1789708531.504601:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365446144:0@lo:503: 00000100:00100000:1.0:1789708531.504642:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.504660:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.504673:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365446144 00000100:00100000:0.0:1789708531.504679:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365446144 00000100:00100000:0.0:1789708531.504712:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789708531.504721:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365446144:12345-0@lo:503: 00000100:00100000:0.0:1789708531.504796:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365446144:12345-0@lo:503: Request processed in 77us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.504803:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789708531.504806:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365446144:0@lo:503: 00000040:00080000:1.0:1789708531.504931:0:9478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708531.504973:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365446272:0@lo:502: 00000100:00100000:1.0:1789708531.505004:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.505020:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.505036:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365446272 00000100:00100000:0.0:1789708531.505041:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365446272 00000100:00100000:0.0:1789708531.505066:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789708531.505073:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365446272:12345-0@lo:502: 00000100:00100000:0.0:1789708531.505152:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365446272:12345-0@lo:502: Request processed in 79us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.505159:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789708531.505163:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365446272:0@lo:502: 00000040:00080000:1.0:1789708531.505304:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789708531.505327:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789708531.505342:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789708531.505355:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789708531.505369:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789708531.505381:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789708531.505393:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789708531.505406:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789708531.505418:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789708531.505431:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789708531.505444:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789708531.505456:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789708531.505470:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789708531.505484:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789708531.505508:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789708531.505523:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789708531.505536:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789708531.505548:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789708531.505560:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789708531.505572:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789708531.505593:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789708531.505607:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789708531.505619:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789708531.505632:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789708531.505644:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789708531.505657:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789708531.505670:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789708531.505683:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789708531.505696:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789708531.505709:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789708531.505731:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789708531.505747:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789708531.505759:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789708531.505772:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789708531.505785:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789708531.505797:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789708531.505810:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1789708531.505822:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789708531.505834:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1789708531.505847:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1789708531.505859:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1789708531.505887:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789708531.505902:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789708531.505928:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789708531.505943:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789708531.505956:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789708531.505973:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365446400:0@lo:502: 00000100:00100000:1.0:1789708531.506005:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.506028:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.506039:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365446400 00000100:00100000:0.0:1789708531.506045:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365446400 00000100:00100000:0.0:1789708531.506070:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789708531.506077:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365446400:12345-0@lo:502: 00000100:00100000:0.0:1789708531.506732:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365446400:12345-0@lo:502: Request processed in 655us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.506739:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789708531.506764:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365446400:0@lo:502: 00000040:00080000:1.0:1789708531.506807:0:9478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1789708531.506819:0:9478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1789708531.507095:0:9495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789708531.507109:0:9495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bed095fcd40) 00000020:00000080:2.0:1789708531.507125:0:9495:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1789708531.507191:0:9495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed08a9c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789708531.507194:0:9495:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bed08a9c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789708531.507197:0:9495:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed08a9c000 3 00010000:00080000:2.0:1789708531.507222:0:9495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed09600000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1789708531.508200:0:9495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789708531.508334:0:9495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789708531.508350:0:9495:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789708531.508357:0:9495:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf45f43947e47cbe9 00000100:00080000:2.0:1789708531.508361:0:9495:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708531.508367:0:9495:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bed09600000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708531.508385:0:9495:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee363cf480 x1876645365446528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708531.508407:0:9495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789708531.508431:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365446528:0@lo:38: 00000100:00100000:1.0:1789708531.508476:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708531.508498:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365446656:0@lo:400: 00000100:00100000:1.0:1789708531.508529:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365446528 00000100:00100000:1.0:1789708531.508535:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365446528 00000100:00100000:2.0:1789708531.508538:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.508566:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365446656 00000100:00100000:1.0:1789708531.508570:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365446656 00000100:00100000:2.0:1789708531.508572:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876645365447168:0@lo:400: 00000100:00100000:3.0:1789708531.508576:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365446784:0@lo:400: 00000100:00100000:1.0:1789708531.508604:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789708531.508609:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.508615:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365446656:12345-0@lo:400: 00000100:00100000:3.0:1789708531.508624:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708531.508636:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789708531.508646:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365447040:0@lo:400: 00000100:00100000:3.0:1789708531.508654:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365447296:0@lo:400: 00000100:00100000:1.0:1789708531.508667:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365446656:12345-0@lo:400: Request processed in 54us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708531.508675:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789708531.508681:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.508695:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365447168 00000100:00100000:3.0:1789708531.508700:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.508700:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365447168 00000100:00100000:2.0:1789708531.508707:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365447552:0@lo:400: 00000100:00100000:3.0:1789708531.508722:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789708531.508732:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365446912:0@lo:400: 00000100:00100000:1.0:1789708531.508735:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365447296 00000100:00100000:1.0:1789708531.508740:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365447296 00000100:00100000:2.0:1789708531.508744:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.508768:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708531.508772:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789708531.508778:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0855d880 x1876645365446656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708531.508781:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876645365447168:12345-0@lo:400: 00000100:00100000:2.0:1789708531.508797:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365446656:0@lo:400: 00000100:00100000:3.0:1789708531.508814:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365447424:0@lo:400: 00000100:00100000:2.0:1789708531.508830:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365446912 00000100:00100000:2.0:1789708531.508835:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365446912 00000100:00100000:1.0:1789708531.508841:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876645365447168:12345-0@lo:400: Request processed in 61us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708531.508848:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708531.508854:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708531.508865:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708531.508873:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708531.508877:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365447296:12345-0@lo:400: 00000100:00100000:1.0:1789708531.508886:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365446912:12345-0@lo:400: 00000100:00100000:3.0:1789708531.508892:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365447552 00000100:00100000:3.0:1789708531.508898:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365447552 00000100:00100000:2.0:1789708531.508932:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365447296:12345-0@lo:400: Request processed in 59us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708531.508946:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708531.508947:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365446912:12345-0@lo:400: Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708531.508949:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365447424 00000100:00100000:3.0:1789708531.508955:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365447424 00000100:00100000:1.0:1789708531.508960:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708531.508966:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789708531.508971:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876645365446528:12345-0@lo:38: 00010000:00080000:2.0:1789708531.508986:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 102 last 0 00000100:00100000:3.0:1789708531.508993:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708531.509003:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1876645365447552:12345-0@lo:400: 00000020:00000080:2.0:1789708531.509015:0:6484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf45f43947e47cbf0 00000004:00100000:2.0:1789708531.509027:0:6484:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789708531.509048:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1876645365447552:12345-0@lo:400: Request processed in 48us (306us total) trans 0 rc 0/0 00000100:00080000:2.0:1789708531.509053:0:6484:0:(import.c:65:import_set_state_nolock()) ffff9bed09605000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708531.509057:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708531.509075:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708531.509083:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365447424:12345-0@lo:400: 00000100:00100000:2.0:1789708531.509094:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876645365446528:12345-0@lo:38: Request processed in 122us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708531.509099:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789708531.509123:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365446784 00000100:00100000:2.0:1789708531.509127:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365446784 00010000:00080000:1.0:1789708531.509127:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee363cf480 x1876645365446528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708531.509130:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365447424:12345-0@lo:400: Request processed in 47us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708531.509144:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708531.509154:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365447040 00000100:00100000:2.0:1789708531.509157:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365447040 00000100:00100000:1.0:1789708531.509160:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708531.509168:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00100000:2.0:1789708531.509174:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789708531.509175:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789708531.509181:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:2.0:1789708531.509182:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365446784:12345-0@lo:400: 00000100:00080000:1.0:1789708531.509186:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed09600000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789708531.509195:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365446528:0@lo:38: 00000100:00100000:2.0:1789708531.509214:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365446784:12345-0@lo:400: Request processed in 34us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708531.509218:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789708531.509226:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789708531.509230:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365447040:12345-0@lo:400: 00000100:00100000:2.0:1789708531.509248:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365447040:12345-0@lo:400: Request processed in 19us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708531.509251:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789708531.509296:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0855f100 x1876645365446912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708531.509314:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365447040:0@lo:400: 00000100:00100000:2.0:1789708531.509314:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365446912:0@lo:400: 00010000:00080000:3.0:1789708531.509336:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0855ce00 x1876645365447552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789708531.509338:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0855ea00 x1876645365447424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708531.509359:0:3617:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789708531.509360:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365447552:0@lo:400: 00000100:00100000:2.0:1789708531.509372:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365447424:0@lo:400: 00010000:00080000:3.0:1789708531.509380:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0855c000 x1876645365447168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708531.509388:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365446784:0@lo:400: 00000100:00100000:3.0:1789708531.509390:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876645365447168:0@lo:400: 00010000:00080000:2.0:1789708531.509414:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0855fb80 x1876645365447296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708531.509424:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365447296:0@lo:400: 00000100:00080000:0.0:1789708531.509775:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789708531.509780:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789708531.509782:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:0.0:1789708531.509958:0:9495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:1.0:1789708531.509963:0:9497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9497:1876645365447680:0@lo:901: 00000020:00000080:0.0:1789708531.509975:0:9495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9bed09710000) 00000020:00000080:0.0:1789708531.509994:0:9495:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:1.0:1789708531.510009:0:9497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.510031:0:9497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708531.510064:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365447680 00000020:01000004:0.0:1789708531.510068:0:9495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed08a9c000 from lustre-OST0001, refs=3 00000100:00100000:3.0:1789708531.510072:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365447680 00000020:01000004:0.0:1789708531.510074:0:9495:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bed08a9c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789708531.510078:0:9495:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed08a9c000 3 00000100:00080000:1.0:1789708531.510103:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789708531.510110:0:9495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed07d39800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.152@tcp at head 00000100:00100000:3.0:1789708531.510122:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708531.510135:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9497:x1876645365447680:12345-0@lo:901: 00000100:00100000:3.0:1789708531.510199:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9497:x1876645365447680:12345-0@lo:901: Request processed in 66us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708531.510204:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789708531.510229:0:9497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee048f0700 x1876645365447680/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789708547 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708531.510240:0:9497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9497:1876645365447680:0@lo:901: 00010000:00010000:0.0:1789708531.511785:0:9495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1789708531.511979:0:9495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789708531.512008:0:9495:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789708531.512026:0:9495:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf45f43947e47cbfe 00000100:00080000:0.0:1789708531.512031:0:9495:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708531.512038:0:9495:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9bed07d39800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708531.512055:0:9495:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee36088000 x1876645365447808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708531.512076:0:9495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789708531.512105:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876645365447808:0@lo:38: 00000100:00100000:2.0:1789708531.512146:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708531.512183:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365447808 00000100:00100000:3.0:1789708531.512189:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365447808 00000100:00100000:3.0:1789708531.512218:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708531.512224:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876645365447808:12345-0@lo:38: 00010000:00080000:3.0:1789708531.512243:0:6485:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 102 last 0 00000040:00080000:0.0:1789708531.512281:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:00000080:3.0:1789708531.512302:0:6485:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf45f43947e47cc05 00000004:00100000:3.0:1789708531.512313:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789708531.512337:0:6485:0:(import.c:65:import_set_state_nolock()) ffff9bed08bff800 : changing import state from RECOVER to FULL 00000020:01000000:2.0:1789708531.512359:0:9478:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 00000100:00100000:3.0:1789708531.512386:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876645365447808:12345-0@lo:38: Request processed in 160us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708531.512394:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:01000000:2.0:1789708531.512398:0:9478:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789708531.512416:0:9478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708531.512427:0:9478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789708531.512469:0:9478:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789708531.512471:0:9478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789708531.512473:0:9478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708531.512474:0:9478:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708531.512476:0:9478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708531.512477:0:9478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708531.512479:0:9478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708531.512485:0:9478:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789708531.512487:0:9478:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789708531.512489:0:9478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708531.512490:0:9478:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789708531.512493:0:9478:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789708531.512495:0:9478:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789708531.512496:0:9478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789708531.512498:0:9478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708531.512499:0:9478:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708531.512500:0:9478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708531.512501:0:9478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708531.512503:0:9478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708531.512504:0:9478:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789708531.512505:0:9478:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789708531.512506:0:9478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708531.512507:0:9478:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789708531.512529:0:9478:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789708531.512538:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365447936:0@lo:253: 00000100:00100000:2.0:1789708531.512578:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708531.512602:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1814a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.512614:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365447936 00000100:00100000:0.0:1789708531.512619:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365447936 00010000:00080000:2.0:1789708531.512629:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee36088000 x1876645365447808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708531.512637:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789708531.512642:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789708531.512647:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789708531.512651:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00100000:0.0:1789708531.512654:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1789708531.512655:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed07d39800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789708531.512663:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876645365447808:0@lo:38: 00000100:00100000:0.0:1789708531.512669:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365447936:12345-0@lo:253: 20000000:01000000:0.0:1789708531.512687:0:6477:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789708531.512704:0:6477:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789708531.514536:0:6477:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789708531.514550:0:6477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789708531.514571:0:6499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789708531.514577:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789708531.514593:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.514606:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebfa00/0xf45f43947e47cae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cadf expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.514615:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cb3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb33 expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.514623:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.514657:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cb33 expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.514670:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cb3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cb33 expref: 17 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.514682:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365448064:0@lo:104: 00000100:00100000:1.0:1789708531.514720:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708531.514721:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:9478:x1876645365447936:12345-0@lo:253: Request processed in 2055us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708531.514727:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:9478:1876645365447936:0@lo:253: 00000100:00100000:0.0:1789708531.514733:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 10000000:01000000:2.0:1789708531.514738:0:9478:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789708531.514741:0:9478:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789708531.514743:0:9478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789708531.514748:0:9478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708531.514750:0:9478:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708531.514751:0:9478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708531.514752:0:9478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708531.514753:0:9478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708531.514755:0:9478:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789708531.514756:0:9478:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789708531.514758:0:9478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708531.514759:0:9478:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789708531.514776:0:9478:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789708531.514779:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebfa00/0xf45f43947e47cae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cadf expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.514792:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebfa00/0xf45f43947e47cae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cadf expref: 16 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.514801:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365448192:0@lo:104: 00000100:00100000:1.0:1789708531.514830:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708531.514852:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708531.514865:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365448064 00000100:00100000:1.0:1789708531.514870:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365448192 00000100:00100000:0.0:1789708531.514872:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365448064 00000100:00100000:1.0:1789708531.514875:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365448192 00000100:00100000:0.0:1789708531.514903:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708531.514926:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708531.514927:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6499:x1876645365448064:12345-0@lo:104: 00000100:00100000:1.0:1789708531.514940:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6499:x1876645365448192:12345-0@lo:104: 00010000:00010000:0.0:1789708531.514942:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.514951:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.514999:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708531.515006:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6499:x1876645365448064:12345-0@lo:104: Request processed in 95us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708531.515007:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789708531.515008:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789708531.515017:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.515018:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:6499:x1876645365448192:12345-0@lo:104: Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.515021:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789708531.515033:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ac600 already unused, calling callback (ffffffffc13d2d20) 00000100:00100000:1.0:1789708531.515035:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 10000000:00010000:3.0:1789708531.515038:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.515048:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708531.515053:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.515061:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365448064:0@lo:104: 10000000:01000000:3.0:1789708531.515072:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789708531.515077:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1876645365448192:0@lo:104: 00010000:00010000:0.0:1789708531.515096:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.515098:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.515113:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708531.515129:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.515135:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee188ac600/0xf45f43947e47cb33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb3a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.515142:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708531.515144:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.515148:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509600 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708531.515150:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.515152:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789708531.515157:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708531.515162:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708531.515166:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365448320:0@lo:103: 10000000:01000000:3.0:1789708531.515167:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708531.515186:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.515191:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789708531.515205:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708531.515208:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708531.515214:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47cadf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cae6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.515222:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365448320 00010000:00010000:3.0:1789708531.515228:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708531.515228:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365448320 00010000:00010000:3.0:1789708531.515231:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708531.515233:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708531.515239:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708531.515247:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cb3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb33 expref: 17 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.515295:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708531.515303:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:3615:x1876645365448320:12345-0@lo:103: 00010000:00010000:0.0:1789708531.515322:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708531.515327:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cb3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb33 expref: 17 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.515337:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cb33 expref: 17 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.515347:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cb3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cb33 expref: 17 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.515357:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708531.515386:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:3615:x1876645365448320:12345-0@lo:103: Request processed in 86us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.515393:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708531.515412:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365448320:0@lo:103: 00000100:00100000:3.0:1789708531.516316:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365448448:0@lo:103: 00000100:00100000:3.0:1789708531.516344:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708531.516379:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365448448 00000100:00100000:0.0:1789708531.516384:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365448448 00010000:00010000:0.0:1789708531.516401:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebfa00/0xf45f43947e47cae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cadf expref: 16 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.516429:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708531.516438:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:3617:x1876645365448448:12345-0@lo:103: 00010000:00010000:0.0:1789708531.516446:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708531.516450:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebfa00/0xf45f43947e47cae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cadf expref: 16 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516459:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebfa00/0xf45f43947e47cae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cadf expref: 16 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516470:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebfa00/0xf45f43947e47cae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cadf expref: 16 pid: 6477 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516491:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516499:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789708531.516510:0:6469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001934124s 00010000:00010000:0.0:1789708531.516514:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516521:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516528:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516535:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516540:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ade00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708531.516544:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516551:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516568:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708531.516577:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708531.516581:0:6499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.516589:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708531.516593:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ade00/0xf45f43947e47cc0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708531.516618:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:3617:x1876645365448448:12345-0@lo:103: Request processed in 182us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708531.516625:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708531.516652:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365448448:0@lo:103: 00080000:10000000:2.0:1789708531.517451:0:9478:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789708531.517614:0:9478:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789708531.517793:0:9478:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789708531.517949:0:9478:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789708531.518109:0:9478:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789708531.518249:0:9478:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789708531.518926:0:9478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789708531.522234:0:9478:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789708531.522238:0:9478:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789708531.522316:0:9478:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789708531.522354:0:9478:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789708531.522369:0:9478:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789708531.522380:0:9478:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789708531.523039:0:9478:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708531.523193:0:9478:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:0.0:1789708531.818829:0:9552:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708531.818997:0:9552:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708532.326394:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708533.330424:0:9841:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789708533.351422:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708533.606357:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365448576:0@lo:41: 00000100:00100000:2.0:1789708533.606425:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708533.606458:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365448576 00000100:00100000:3.0:1789708533.606465:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365448576 00000100:00100000:3.0:1789708533.606511:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789708533.606519:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365448576:12345-0@lo:41: 00000004:00000024:3.0:1789708533.606546:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789708533.606588:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365448576:12345-0@lo:41: Request processed in 71us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708533.606593:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708533.606628:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365448576:0@lo:41: 00000020:00000004:0.0:1789708533.627661:0:9893:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708533.627815:0:9893:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1789708533.907447:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1789708534.374425:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708534.630434:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365448832:0@lo:13: 00000100:00100000:1.0:1789708534.630434:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365448704:0@lo:13: 00000100:00100000:1.0:1789708534.630501:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708534.630533:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708534.630557:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365448704 00000100:00100000:2.0:1789708534.630565:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365448704 00000100:00100000:0.0:1789708534.630585:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365448832 00000100:00100000:0.0:1789708534.630592:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365448832 00000100:00080000:1.0:1789708534.630598:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708534.630610:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789708534.630618:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708534.630623:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365448704:12345-0@lo:13: 00002000:00000024:2.0:1789708534.630650:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708534.630695:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365448704:12345-0@lo:13: Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708534.630702:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708534.630719:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708534.630726:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365448832:12345-0@lo:13: 00010000:00080000:1.0:1789708534.630733:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee363cd500 x1876645365448704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708534.630742:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00002000:00000024:2.0:1789708534.630753:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789708534.630761:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365448704:0@lo:13: 00000100:00100000:2.0:1789708534.630786:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365448832:12345-0@lo:13: Request processed in 60us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708534.630793:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789708534.630820:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee36088e00 x1876645365448832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708534.630832:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365448832:0@lo:13: 00000020:00000004:1.0:1789708535.209455:0:9994:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708535.209643:0:9994:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708535.399364:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789708535.483392:0:10042:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708535.483403:0:10042:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1789708535.591287:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708535.591332:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357027456 00000100:00100000:0.0:1789708535.591342:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357027456 00000100:00100000:0.0:1789708535.591385:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:0.0:1789708535.591394:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2394:x1876645357027456:12345-192.168.201.52@tcp:250: 00010000:00080000:0.0:1789708535.591424:0:6479:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 098f9bc4-0284-4f29-9497-0447ce008685@192.168.201.52@tcp t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:0.0:1789708535.591450:0:6479:0:(genops.c:1384:class_connect()) connect: client 098f9bc4-0284-4f29-9497-0447ce008685, cookie 0xf45f43947e47cc13 00000100:00080000:0.0:1789708535.591580:0:6479:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa75000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708535.591639:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+5:2394:x1876645357027456:12345-192.168.201.52@tcp:250: Request processed in 244us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708535.591647:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:0.0:1789708535.592233:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708535.592282:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357027584 00000100:00100000:2.0:1789708535.592287:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357027584 00000100:00100000:2.0:1789708535.592327:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:2.0:1789708535.592333:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+5:6141:x1876645357027584:12345-192.168.201.52@tcp:101: 00010000:00010000:2.0:1789708535.592343:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708535.592358:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47cc1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715de01 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708535.592381:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47cc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de01 expref: 6 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708535.592388:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47cc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de01 expref: 6 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708535.592396:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebde00, rc 0) 00000100:00100000:2.0:1789708535.592420:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+6:6141:x1876645357027584:12345-192.168.201.52@tcp:101: Request processed in 87us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708535.592423:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:1.0:1789708535.593383:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708535.593420:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357027712 00000100:00100000:0.0:1789708535.593425:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357027712 00000100:00100000:0.0:1789708535.593453:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:0.0:1789708535.593461:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+6:6141:x1876645357027712:12345-192.168.201.52@tcp:501: 00000100:00100000:0.0:1789708535.593546:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+6:6141:x1876645357027712:12345-192.168.201.52@tcp:501: Request processed in 87us (164us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708535.593551:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:3.0:1789708535.594084:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708535.594112:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357027840 00000100:00100000:2.0:1789708535.594117:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357027840 00000100:00100000:2.0:1789708535.594145:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:2.0:1789708535.594150:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+6:6141:x1876645357027840:12345-192.168.201.52@tcp:101: 00010000:00010000:2.0:1789708535.594156:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708535.594170:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cc21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715de08 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708535.594182:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de08 expref: 7 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708535.594189:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de08 expref: 7 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708535.594194:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc800, rc 0) 00000100:00100000:2.0:1789708535.594217:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+7:6141:x1876645357027840:12345-192.168.201.52@tcp:101: Request processed in 67us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708535.594221:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:3.0:1789708535.594771:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708535.594804:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357027968 00000100:00100000:0.0:1789708535.594808:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357027968 00000100:00100000:0.0:1789708535.594831:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:0.0:1789708535.594851:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+7:6141:x1876645357027968:12345-192.168.201.52@tcp:501: 00000100:00100000:0.0:1789708535.594931:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+8:6141:x1876645357027968:12345-192.168.201.52@tcp:501: Request processed in 94us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708535.594936:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:1.0:1789708535.595491:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708535.595517:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357028096 00000100:00100000:2.0:1789708535.595522:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357028096 00000100:00100000:2.0:1789708535.595547:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:2.0:1789708535.595553:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+8:6141:x1876645357028096:12345-192.168.201.52@tcp:503: 00000100:00100000:2.0:1789708535.595637:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+8:6141:x1876645357028096:12345-192.168.201.52@tcp:503: Request processed in 84us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708535.595642:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:3.0:1789708535.596384:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708535.596414:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357028224 00000100:00100000:0.0:1789708535.596418:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357028224 00000100:00100000:0.0:1789708535.596438:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:0.0:1789708535.596442:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+8:6158:x1876645357028224:12345-192.168.201.52@tcp:502: 00000100:00100000:0.0:1789708535.596505:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+8:6158:x1876645357028224:12345-192.168.201.52@tcp:502: Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708535.596510:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:3.0:1789708535.606519:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708535.606585:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357028352 00000100:00100000:2.0:1789708535.606597:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357028352 00000100:00100000:2.0:1789708535.606649:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:2.0:1789708535.606657:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+8:6158:x1876645357028352:12345-192.168.201.52@tcp:502: 00000100:00100000:2.0:1789708535.606835:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+8:6158:x1876645357028352:12345-192.168.201.52@tcp:502: Request processed in 178us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708535.606854:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:1.0:1789708535.609167:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708535.609220:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357028480 00000100:00100000:0.0:1789708535.609226:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357028480 00000100:00100000:0.0:1789708535.609283:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:0.0:1789708535.609292:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+8:6141:x1876645357028480:12345-192.168.201.52@tcp:101: 00010000:00010000:0.0:1789708535.609301:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708535.609322:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebec00/0xf45f43947e47cc28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715de39 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708535.609345:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebec00/0xf45f43947e47cc28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de39 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708535.609360:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebec00/0xf45f43947e47cc28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de39 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708535.609370:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebec00, rc 0) 00000100:00100000:0.0:1789708535.609398:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+9:6141:x1876645357028480:12345-192.168.201.52@tcp:101: Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708535.609404:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:3.0:1789708535.610864:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708535.610902:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357028608 00000100:00100000:2.0:1789708535.610915:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357028608 00000100:00100000:2.0:1789708535.610952:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:2.0:1789708535.610960:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+9:6141:x1876645357028608:12345-192.168.201.52@tcp:256: 20000000:01000000:2.0:1789708535.610978:0:6477:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789708535.610998:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789708535.611003:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789708535.611006:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789708535.611009:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789708535.611011:0:6477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789708535.611492:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+9:6141:x1876645357028608:12345-192.168.201.52@tcp:256: Request processed in 532us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708535.611501:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:1.0:1789708535.612448:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708535.612513:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357028736 00000100:00100000:0.0:1789708535.612518:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357028736 00000100:00100000:0.0:1789708535.612552:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:0.0:1789708535.612560:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+9:6141:x1876645357028736:12345-192.168.201.52@tcp:101: 00010000:00010000:0.0:1789708535.612570:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708535.612583:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebee00/0xf45f43947e47cc2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715de40 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708535.612605:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebee00/0xf45f43947e47cc2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de40 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708535.612614:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebee00/0xf45f43947e47cc2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de40 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708535.612622:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebee00, rc 0) 00000100:00100000:0.0:1789708535.612654:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6141:x1876645357028736:12345-192.168.201.52@tcp:101: Request processed in 94us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708535.612660:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:3.0:1789708535.613236:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708535.613302:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357028864 00000100:00100000:2.0:1789708535.613309:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357028864 00000100:00100000:2.0:1789708535.613341:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:2.0:1789708535.613347:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:6141:x1876645357028864:12345-192.168.201.52@tcp:501: 00000100:00100000:2.0:1789708535.613450:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:6141:x1876645357028864:12345-192.168.201.52@tcp:501: Request processed in 103us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708535.613455:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:3.0:1789708535.613961:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708535.613994:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357028992 00000100:00100000:0.0:1789708535.613998:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357028992 00000100:00100000:0.0:1789708535.614026:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:0.0:1789708535.614033:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6141:x1876645357028992:12345-192.168.201.52@tcp:503: 00000100:00100000:0.0:1789708535.614121:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6141:x1876645357028992:12345-192.168.201.52@tcp:503: Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708535.614126:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:1.0:1789708535.615197:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708535.615233:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357029120 00000100:00100000:2.0:1789708535.615238:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357029120 00000100:00100000:2.0:1789708535.615274:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:2.0:1789708535.615281:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:6162:x1876645357029120:12345-192.168.201.52@tcp:502: 00000100:00100000:2.0:1789708535.615344:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:6162:x1876645357029120:12345-192.168.201.52@tcp:502: Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708535.615350:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:3.0:1789708535.615901:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708535.615939:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357029248 00000100:00100000:0.0:1789708535.615945:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357029248 00000100:00100000:0.0:1789708535.615970:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:0.0:1789708535.615977:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6162:x1876645357029248:12345-192.168.201.52@tcp:502: 00000100:00100000:0.0:1789708535.616035:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6162:x1876645357029248:12345-192.168.201.52@tcp:502: Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708535.616044:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:3.0:1789708535.616809:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708535.616849:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357029376 00000100:00100000:2.0:1789708535.616858:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357029376 00000100:00100000:2.0:1789708535.616887:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789708535.616894:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1876645357029376:12345-192.168.201.52@tcp:38: 00010000:00080000:2.0:1789708535.616918:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp t0 exp 0000000000000000 cur 106 last 0 00000100:00100000:3.0:1789708535.616932:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708535.616963:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357029632 00000100:00100000:0.0:1789708535.616967:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357029632 00000020:00000080:2.0:1789708535.616974:0:6484:0:(genops.c:1384:class_connect()) connect: client 68824747-448a-469b-b2cf-e27bc037ded7, cookie 0xf45f43947e47cc36 00000100:00100000:0.0:1789708535.616991:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1789708535.616996:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1876645357029632:12345-192.168.201.52@tcp:38: 00000004:00100000:2.0:1789708535.617004:0:6484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00010000:00080000:0.0:1789708535.617013:0:8421:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:0.0:1789708535.617060:0:8421:0:(genops.c:1384:class_connect()) connect: client 68824747-448a-469b-b2cf-e27bc037ded7, cookie 0xf45f43947e47cc3d 00000004:00100000:0.0:1789708535.617076:0:8421:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789708535.617324:0:6484:0:(import.c:65:import_set_state_nolock()) ffff9bed09602800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789708535.617354:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa73000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708535.617362:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:2394:x1876645357029376:12345-192.168.201.52@tcp:38: Request processed in 466us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708535.617368:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789708535.617384:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+6:2394:x1876645357029632:12345-192.168.201.52@tcp:38: Request processed in 386us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708535.617391:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1789708535.654440:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee36089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365448960:0@lo:41: 00000100:00100000:3.0:1789708535.654516:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708535.654554:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365448960 00000100:00100000:0.0:1789708535.654563:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365448960 00000100:00100000:0.0:1789708535.654612:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708535.654636:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365448960:12345-0@lo:41: 00000004:00000024:0.0:1789708535.654673:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789708535.654716:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365448960:12345-0@lo:41: Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708535.654721:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789708535.654761:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee36089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365448960:0@lo:41: 00010000:00010000:2.0:1789708536.422397:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708536.618549:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708536.618608:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708536.618613:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357029760 00000100:00100000:3.0:1789708536.618628:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357029760 00000100:00100000:0.0:1789708536.618654:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708536.618685:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357029504 00000100:00100000:2.0:1789708536.618694:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357029504 00000100:00080000:1.0:1789708536.618700:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708536.618715:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357029888 00000100:00100000:3.0:1789708536.618720:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357029888 00000100:00080000:1.0:1789708536.618728:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708536.618729:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:0.0:1789708536.618749:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:0:x1876645357029760:12345-192.168.201.52@tcp:41: 00000100:00100000:3.0:1789708536.618761:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1789708536.618774:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:0:x1876645357029504:12345-192.168.201.52@tcp:41: 00000100:00100000:2.0:1789708536.618774:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000004:00000024:0.0:1789708536.618790:0:6483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789708536.618793:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:6141:x1876645357029888:12345-192.168.201.52@tcp:41: 00000004:00000024:3.0:1789708536.618810:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000004:00000024:2.0:1789708536.618815:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789708536.618865:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:0:x1876645357029760:12345-192.168.201.52@tcp:41: Request processed in 122us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708536.618873:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1789708536.618883:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:0:x1876645357029504:12345-192.168.201.52@tcp:41: Request processed in 106us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708536.618885:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:6141:x1876645357029888:12345-192.168.201.52@tcp:41: Request processed in 94us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708536.618895:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789708536.618909:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:1.0:1789708536.619592:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708536.619627:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357030016 00000100:00100000:2.0:1789708536.619632:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357030016 00000100:00100000:2.0:1789708536.619659:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:2.0:1789708536.619667:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:6141:x1876645357030016:12345-192.168.201.52@tcp:40: 00000100:00100000:2.0:1789708536.619711:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:6141:x1876645357030016:12345-192.168.201.52@tcp:40: Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708536.619718:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:1.0:1789708536.620599:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708536.620618:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708536.620645:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357030144 00000100:00100000:3.0:1789708536.620654:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357030144 00000100:00100000:1.0:1789708536.620660:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708536.620663:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357030400 00000100:00100000:0.0:1789708536.620670:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357030400 00000100:00100000:3.0:1789708536.620689:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1789708536.620697:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876645357030144:12345-192.168.201.52@tcp:8: 00000100:00100000:0.0:1789708536.620708:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789708536.620723:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708536.620730:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1876645357030400:12345-192.168.201.52@tcp:8: 00000100:00100000:2.0:1789708536.620733:0:8398:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00010000:00080000:3.0:1789708536.620747:0:9145:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp t0 exp 0000000000000000 cur 107 last 0 00000100:00100000:2.0:1789708536.620747:0:8398:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00080000:0.0:1789708536.620758:0:8397:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp t0 exp 0000000000000000 cur 107 last 0 00000100:00100000:1.0:1789708536.620776:0:9146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357030528 00000100:00100000:1.0:1789708536.620783:0:9146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357030528 00000020:00000080:3.0:1789708536.620786:0:9145:0:(genops.c:1384:class_connect()) connect: client 68824747-448a-469b-b2cf-e27bc037ded7, cookie 0xf45f43947e47cc44 00000100:00100000:2.0:1789708536.620786:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357030272 00000020:00000080:0.0:1789708536.620791:0:8397:0:(genops.c:1384:class_connect()) connect: client 68824747-448a-469b-b2cf-e27bc037ded7, cookie 0xf45f43947e47cc4b 00000100:00100000:2.0:1789708536.620798:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357030272 00002000:00100000:3.0:1789708536.620801:0:9145:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68824747-448a-469b-b2cf-e27bc037ded7/ffff9bed08bff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789708536.620807:0:8397:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 68824747-448a-469b-b2cf-e27bc037ded7/ffff9bee3fa70800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789708536.620829:0:8397:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:3.0:1789708536.620832:0:9145:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789708536.620844:0:9146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:1.0:1789708536.620862:0:9146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:68824747-448a-469b-b2cf-e27bc037ded7+6:6141:x1876645357030528:12345-192.168.201.52@tcp:900: 00000100:00100000:2.0:1789708536.620868:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 149 00000100:00100000:2.0:1789708536.620878:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:2398:x1876645357030272:12345-192.168.201.52@tcp:400: 00000100:00100000:1.0:1789708536.620933:0:9146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:68824747-448a-469b-b2cf-e27bc037ded7+6:6141:x1876645357030528:12345-192.168.201.52@tcp:900: Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708536.620940:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:2398:x1876645357030272:12345-192.168.201.52@tcp:400: Request processed in 51us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708536.620948:0:9146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:2.0:1789708536.620958:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 149 00002000:00080000:3.0:1789708536.621147:0:9145:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789708536.621176:0:9145:0:(import.c:65:import_set_state_nolock()) ffff9bed08bf8800 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1789708536.621208:0:8397:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1789708536.621222:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+6:2394:x1876645357030144:12345-192.168.201.52@tcp:8: Request processed in 525us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708536.621238:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00080000:0.0:1789708536.621241:0:8397:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa77000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708536.621359:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2394:x1876645357030400:12345-192.168.201.52@tcp:8: Request processed in 629us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708536.621379:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789708536.621670:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708536.621713:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357030656 00000100:00100000:0.0:1789708536.621718:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357030656 00000100:00100000:0.0:1789708536.621743:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:0.0:1789708536.621747:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:6141:x1876645357030656:12345-192.168.201.52@tcp:33: 00000004:00080000:0.0:1789708536.629471:0:6486:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7675us 00000004:00200000:3.0:1789708536.634239:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789708536.634388:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:6141:x1876645357030656:12345-192.168.201.52@tcp:33: Request processed in 12633us (12712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708536.634405:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1789708536.678483:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789708536.678512:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365449088:0@lo:400: 00000100:00100000:2.0:1789708536.678530:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365449344:0@lo:400: 00000100:00100000:0.0:1789708536.678530:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365449216:0@lo:400: 00000100:00100000:3.0:1789708536.678602:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708536.678611:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365449600:0@lo:400: 00000100:00100000:0.0:1789708536.678659:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708536.678660:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708536.678677:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365449472:0@lo:400: 00000100:00100000:1.0:1789708536.678692:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365449088 00000100:00100000:1.0:1789708536.678701:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365449088 00000100:00100000:3.0:1789708536.678729:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708536.678735:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365449856:0@lo:400: 00000100:00100000:0.0:1789708536.678737:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365449728:0@lo:400: 00000100:00100000:3.0:1789708536.678764:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365449984:0@lo:400: 00000100:00100000:1.0:1789708536.678772:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789708536.678789:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:3617:x1876645365449088:12345-0@lo:400: 00000100:00100000:2.0:1789708536.678791:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708536.678811:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708536.678829:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365449216 00000100:00100000:0.0:1789708536.678837:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365449216 00000100:00100000:2.0:1789708536.678846:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365450368:0@lo:400: 00000100:00100000:3.0:1789708536.678887:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365449344 00000100:00100000:3.0:1789708536.678894:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365449344 00000100:00100000:2.0:1789708536.678894:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708536.678918:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365449472 00000100:00100000:1.0:1789708536.678921:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:3617:x1876645365449088:12345-0@lo:400: Request processed in 134us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708536.678924:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365449472 00000100:00100000:1.0:1789708536.678945:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789708536.678958:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789708536.678974:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365449344:12345-0@lo:400: 00000100:00100000:0.0:1789708536.678981:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365449856 00000100:00100000:2.0:1789708536.678985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365450368 00000100:00100000:0.0:1789708536.678987:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365449856 00000100:00100000:2.0:1789708536.678993:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365450368 00000100:00100000:1.0:1789708536.679017:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708536.679057:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365450112:0@lo:400: 00000100:00100000:3.0:1789708536.679082:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365449344:12345-0@lo:400: Request processed in 103us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708536.679082:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708536.679103:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708536.679104:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708536.679106:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365449216:12345-0@lo:400: 00000100:00100000:3.0:1789708536.679107:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789708536.679126:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365449472:12345-0@lo:400: 00000100:00100000:3.0:1789708536.679155:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365449600 00000100:00100000:3.0:1789708536.679161:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365449600 00000100:00100000:1.0:1789708536.679180:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365449984 00000100:00100000:1.0:1789708536.679187:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365449984 00000100:00100000:2.0:1789708536.679190:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365449216:12345-0@lo:400: Request processed in 95us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708536.679199:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708536.679207:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365449472:12345-0@lo:400: Request processed in 80us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708536.679209:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789708536.679221:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708536.679240:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708536.679241:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365449600:12345-0@lo:400: 00000100:00100000:1.0:1789708536.679249:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365450112 00000100:00100000:1.0:1789708536.679254:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365450112 00000100:00100000:2.0:1789708536.679257:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365449856:12345-0@lo:400: 00000100:00100000:0.0:1789708536.679302:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708536.679313:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708536.679323:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365450368:12345-0@lo:400: 00000100:00100000:1.0:1789708536.679330:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365449984:12345-0@lo:400: 00000100:00100000:3.0:1789708536.679342:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365449600:12345-0@lo:400: Request processed in 118us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708536.679353:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789708536.679374:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365449856:12345-0@lo:400: Request processed in 124us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708536.679396:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708536.679405:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708536.679413:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365449984:12345-0@lo:400: Request processed in 83us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708536.679422:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365450368:12345-0@lo:400: Request processed in 97us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708536.679427:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365450112:12345-0@lo:400: 00000100:00100000:1.0:1789708536.679443:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708536.679454:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789708536.679503:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bd9c00 x1876645365449472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708536.679503:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708536.679505:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708536.679521:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365450112:12345-0@lo:400: Request processed in 93us (421us total) trans 0 rc 0/0 00000100:00080000:0.0:1789708536.679521:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708536.679535:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365449472:0@lo:400: 00000100:00100000:3.0:1789708536.679546:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708536.679546:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365450240:0@lo:400: 00010000:00080000:2.0:1789708536.679563:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bdb100 x1876645365449984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708536.679564:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365449728 00000100:00100000:0.0:1789708536.679573:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365449728 00000100:00100000:2.0:1789708536.679577:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365449984:0@lo:400: 00000100:00100000:1.0:1789708536.679584:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708536.679611:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365449088:0@lo:400: 00000100:00100000:3.0:1789708536.679632:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365449600:0@lo:400: 00000100:00100000:0.0:1789708536.679657:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365450240 00010000:00080000:1.0:1789708536.679664:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bd8a80 x1876645365449216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708536.679665:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365450240 00010000:00080000:3.0:1789708536.679672:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bdb800 x1876645365450112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789708536.679702:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bda300 x1876645365449856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708536.679717:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708536.679743:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365449216:0@lo:400: 00000100:00100000:0.0:1789708536.679743:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365449728:12345-0@lo:400: 00000100:00100000:3.0:1789708536.679746:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365450112:0@lo:400: 00000100:00100000:2.0:1789708536.679767:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365449856:0@lo:400: 00010000:00080000:2.0:1789708536.679804:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee18001f80 x1876645365450368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708536.679814:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365450368:0@lo:400: 00000100:00100000:1.0:1789708536.679832:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789708536.679850:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365450240:12345-0@lo:400: 00000100:00100000:2.0:1789708536.679855:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365449344:0@lo:400: 00000100:00100000:0.0:1789708536.679876:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365449728:12345-0@lo:400: Request processed in 135us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708536.679887:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789708536.679910:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bd9880 x1876645365449728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708536.679921:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365450240:12345-0@lo:400: Request processed in 76us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708536.679922:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365449728:0@lo:400: 00000100:00080000:0.0:1789708536.679923:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708536.679942:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789708536.679959:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bdaa00 x1876645365450240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708536.679967:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365450240:0@lo:400: 00000100:00100000:1.0:1789708536.686776:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708536.686831:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357030784 00000100:00100000:0.0:1789708536.686842:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357030784 00000100:00100000:0.0:1789708536.686886:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:0.0:1789708536.686894:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:6180:x1876645357030784:12345-192.168.201.52@tcp:101: 00010000:00010000:0.0:1789708536.686909:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708536.686964:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebe400/0xf45f43947e47cc52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715de71 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708536.687020:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebfc00/0xf45f43947e47cc59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708536.687032:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebfc00/0xf45f43947e47cc59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708536.687043:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebfc00/0xf45f43947e47cc59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708536.687075:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789708536.687087:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708536.687103:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebfc00/0xf45f43947e47cc59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708536.687121:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebe400/0xf45f43947e47cc52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de71 expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708536.687133:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebfc00/0xf45f43947e47cc59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de71 expref: 7 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708536.687139:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed097e1800) 00010000:00010000:0.0:1789708536.687141:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708536.687144:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebfc00, rc 0) 00000100:00100000:0.0:1789708536.687190:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:6180:x1876645357030784:12345-192.168.201.52@tcp:101: Request processed in 298us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708536.687194:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00010000:00010000:3.0:1789708537.446431:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708538.070001:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708538.070077:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357030912 00000100:00100000:2.0:1789708538.070088:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357030912 00000100:00080000:0.0:1789708538.070158:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708538.070180:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1789708538.070196:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:6232:x1876645357030912:12345-192.168.201.52@tcp:41: 00000004:00000024:2.0:1789708538.070237:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789708538.070334:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:6232:x1876645357030912:12345-192.168.201.52@tcp:41: Request processed in 143us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708538.070360:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1789708538.071888:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708538.071933:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357031040 00000100:00100000:0.0:1789708538.071938:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357031040 00000100:00100000:0.0:1789708538.071990:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:0.0:1789708538.071997:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68824747-448a-469b-b2cf-e27bc037ded7+6:6232:x1876645357031040:12345-192.168.201.52@tcp:13: 00000100:00080000:2.0:1789708538.072000:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789708538.072013:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708538.072044:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68824747-448a-469b-b2cf-e27bc037ded7+6:6232:x1876645357031040:12345-192.168.201.52@tcp:13: Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708538.072051:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1789708538.072839:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708538.072888:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357031168 00000100:00100000:3.0:1789708538.072895:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357031168 00000100:00100000:3.0:1789708538.072934:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789708538.072944:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68824747-448a-469b-b2cf-e27bc037ded7+6:6232:x1876645357031168:12345-192.168.201.52@tcp:13: 00000100:00080000:2.0:1789708538.072949:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789708538.072959:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923951616 avail 3692429312 00000100:00100000:3.0:1789708538.073006:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68824747-448a-469b-b2cf-e27bc037ded7+6:6232:x1876645357031168:12345-192.168.201.52@tcp:13: Request processed in 63us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708538.073014:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00010000:00010000:2.0:1789708538.470391:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708538.726439:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708538.726461:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365450496:0@lo:41: 00000100:00100000:3.0:1789708538.726520:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708538.726568:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365450496 00000100:00100000:1.0:1789708538.726576:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365450496 00000100:00100000:1.0:1789708538.726629:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708538.726642:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365450496:12345-0@lo:41: 00000004:00000024:1.0:1789708538.726675:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1789708538.726736:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365450496:12345-0@lo:41: Request processed in 97us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708538.726746:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789708538.726792:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365450496:0@lo:41: 00000001:02000400:3.0:1789708538.963138:0:10141:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789708539.494952:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789708539.750328:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789708539.750335:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee2f569800 from 39 10000000:01000000:0.0:1789708539.750339:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789708539.750377:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.750392:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.750403:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.750423:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365450624:0@lo:101: 00000100:00100000:0.0:1789708539.750482:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.750521:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365450624 00000100:00100000:0.0:1789708539.750524:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.750530:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365450624 00000100:00100000:2.0:1789708539.750580:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789708539.750590:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365450624:12345-0@lo:101: 00010000:00010000:2.0:1789708539.750605:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708539.750620:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47cc67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cc60 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.750647:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47cc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cc60 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.750660:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47cc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cc60 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.750670:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc400, rc 0) 00000100:00100000:2.0:1789708539.750718:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365450624:12345-0@lo:101: Request processed in 130us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.750724:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789708539.750757:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365450624:0@lo:101: 00010000:00010000:0.0:1789708539.750781:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.750789:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.750836:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365450752:0@lo:501: 00000100:00100000:0.0:1789708539.750858:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.750876:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.750900:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365450752 00000100:00100000:2.0:1789708539.750904:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365450752 00000100:00100000:2.0:1789708539.750934:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789708539.750940:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365450752:12345-0@lo:501: 00000100:00100000:2.0:1789708539.751042:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365450752:12345-0@lo:501: Request processed in 102us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.751055:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789708539.751067:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365450752:0@lo:501: 00000100:00100000:0.0:1789708539.751106:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365450880:0@lo:503: 00000100:00100000:0.0:1789708539.751152:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.751174:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.751183:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365450880 00000100:00100000:2.0:1789708539.751188:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365450880 00000100:00100000:2.0:1789708539.751215:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789708539.751222:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365450880:12345-0@lo:503: 00000100:00100000:2.0:1789708539.751334:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365450880:12345-0@lo:503: Request processed in 113us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.751341:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789708539.751363:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708539.751375:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365451008:0@lo:13: 00000100:00100000:3.0:1789708539.751380:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365451136:0@lo:13: 00000100:00100000:0.0:1789708539.751409:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.751454:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.751467:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365451008 00000100:00100000:2.0:1789708539.751473:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365451008 00000100:00100000:0.0:1789708539.751482:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365450880:0@lo:503: 00000100:00100000:3.0:1789708539.751508:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365451136 00000100:00100000:3.0:1789708539.751516:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365451136 00000100:00100000:2.0:1789708539.751523:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708539.751534:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365451008:12345-0@lo:13: 00002000:00000024:2.0:1789708539.751556:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708539.751596:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365451008:12345-0@lo:13: Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.751604:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789708539.751615:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09881c00 x1876645365451008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708539.751627:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708539.751638:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365451008:0@lo:13: 00000100:00100000:2.0:1789708539.751639:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365451136:12345-0@lo:13: 00002000:00000024:2.0:1789708539.751658:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708539.751706:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365451136:12345-0@lo:13: Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.751713:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789708539.751734:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789708539.751734:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0855d180 x1876645365451136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708539.751752:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365451136:0@lo:13: 00000100:00100000:3.0:1789708539.751816:0:10246:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10246:1876645365451264:0@lo:502: 00000100:00100000:3.0:1789708539.751869:0:10246:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.751908:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365451264 00000100:00100000:3.0:1789708539.751910:0:10246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.751913:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365451264 00000100:00100000:2.0:1789708539.751941:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789708539.751946:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:10246:x1876645365451264:12345-0@lo:502: 00000100:00100000:2.0:1789708539.752039:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:10246:x1876645365451264:12345-0@lo:502: Request processed in 92us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.752045:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789708539.752077:0:10246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10246:1876645365451264:0@lo:502: 00000100:00100000:3.0:1789708539.752130:0:10246:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10246:1876645365451392:0@lo:502: 00000100:00100000:3.0:1789708539.752178:0:10246:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.752201:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365451392 00000100:00100000:3.0:1789708539.752204:0:10246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.752206:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365451392 00000100:00100000:2.0:1789708539.752237:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789708539.752244:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:10246:x1876645365451392:12345-0@lo:502: 00000100:00100000:2.0:1789708539.752341:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:10246:x1876645365451392:12345-0@lo:502: Request processed in 98us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.752348:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789708539.752363:0:10246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10246:1876645365451392:0@lo:502: 00000040:00080000:3.0:1789708539.752404:0:10246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789708539.752486:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789708539.752514:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708539.752520:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.752528:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708539.752534:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789708539.752536:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789708539.752538:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789708539.752551:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.752557:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.752562:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.752572:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365451520:0@lo:101: 00000100:00100000:0.0:1789708539.752606:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.752641:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.752646:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365451520 00000100:00100000:2.0:1789708539.752652:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365451520 00000100:00100000:2.0:1789708539.752688:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789708539.752697:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365451520:12345-0@lo:101: 00010000:00010000:2.0:1789708539.752705:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708539.752714:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cc75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cc6e expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.752731:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cc6e expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.752738:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cc6e expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.752744:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd000, rc 0) 00000100:00100000:2.0:1789708539.752790:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365451520:12345-0@lo:101: Request processed in 93us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.752798:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789708539.752804:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365451520:0@lo:101: 00010000:00010000:0.0:1789708539.752819:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.752827:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.752862:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365451648:0@lo:501: 00000100:00100000:0.0:1789708539.752886:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.752901:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.752911:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365451648 00000100:00100000:2.0:1789708539.752916:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365451648 00000100:00100000:2.0:1789708539.752944:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789708539.752949:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365451648:12345-0@lo:501: 00000100:00100000:2.0:1789708539.753013:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365451648:12345-0@lo:501: Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.753019:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789708539.753032:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365451648:0@lo:501: 00000100:00100000:0.0:1789708539.753070:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365451776:0@lo:503: 00000100:00100000:0.0:1789708539.753111:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.753132:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365451776 00000100:00100000:0.0:1789708539.753132:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.753137:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365451776 00000100:00100000:2.0:1789708539.753161:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789708539.753168:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365451776:12345-0@lo:503: 00000100:00100000:2.0:1789708539.753251:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365451776:12345-0@lo:503: Request processed in 82us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.753256:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789708539.753284:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365451776:0@lo:503: 00000100:00100000:3.0:1789708539.753498:0:10247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10247:1876645365451904:0@lo:502: 00000100:00100000:3.0:1789708539.753549:0:10247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.753583:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365451904 00000100:00100000:2.0:1789708539.753587:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365451904 00000100:00100000:3.0:1789708539.753591:0:10247:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.753621:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789708539.753630:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:10247:x1876645365451904:12345-0@lo:502: 00000100:00100000:2.0:1789708539.753721:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:10247:x1876645365451904:12345-0@lo:502: Request processed in 93us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.753727:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789708539.753750:0:10247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10247:1876645365451904:0@lo:502: 00000020:01000000:3.0:1789708539.753796:0:10247:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708539.753813:0:10247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708539.753816:0:10247:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789708539.753823:0:10247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789708539.753826:0:10247:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789708539.753846:0:10247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10247:1876645365452032:0@lo:502: 00000100:00100000:3.0:1789708539.753900:0:10247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.753922:0:10247:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.753926:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365452032 00000100:00100000:2.0:1789708539.753931:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365452032 00000100:00100000:2.0:1789708539.753958:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789708539.753970:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:10247:x1876645365452032:12345-0@lo:502: 00000100:00100000:2.0:1789708539.754039:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:10247:x1876645365452032:12345-0@lo:502: Request processed in 71us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.754053:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789708539.754063:0:10247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10247:1876645365452032:0@lo:502: 00000020:01000000:3.0:1789708539.754089:0:10247:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708539.754094:0:10247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708539.754096:0:10247:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789708539.754101:0:10247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789708539.754166:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789708539.754194:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789708539.754200:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.754210:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708539.754220:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789708539.754222:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee36337800 from 39 10000000:01000000:0.0:1789708539.754232:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789708539.754246:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.754255:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.754289:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.754302:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365452160:0@lo:101: 00000100:00100000:0.0:1789708539.754330:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.754351:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365452160 00000100:00100000:2.0:1789708539.754355:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365452160 00000100:00100000:0.0:1789708539.754361:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.754385:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789708539.754392:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365452160:12345-0@lo:101: 00010000:00010000:2.0:1789708539.754398:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708539.754405:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cc83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cc7c expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.754416:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cc7c expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.754422:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cc7c expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.754427:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebdc00, rc 0) 00000100:00100000:2.0:1789708539.754458:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365452160:12345-0@lo:101: Request processed in 67us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.754463:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789708539.754479:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365452160:0@lo:101: 00010000:00010000:0.0:1789708539.754491:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.754501:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.754542:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365452288:0@lo:501: 00000100:00100000:0.0:1789708539.754572:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.754592:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365452288 00000100:00100000:0.0:1789708539.754593:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.754597:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365452288 00000100:00100000:2.0:1789708539.754629:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789708539.754637:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365452288:12345-0@lo:501: 00000100:00100000:2.0:1789708539.754719:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365452288:12345-0@lo:501: Request processed in 84us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.754725:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789708539.754734:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365452288:0@lo:501: 00000100:00100000:0.0:1789708539.754786:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365452416:0@lo:503: 00000100:00100000:0.0:1789708539.754825:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.754843:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.754847:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365452416 00000100:00100000:2.0:1789708539.754852:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365452416 00000100:00100000:2.0:1789708539.754892:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789708539.754901:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365452416:12345-0@lo:503: 00000100:00100000:2.0:1789708539.754969:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365452416:12345-0@lo:503: Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.754974:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789708539.754987:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365452416:0@lo:503: 00000100:00100000:3.0:1789708539.755196:0:10249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10249:1876645365452544:0@lo:502: 00000100:00100000:3.0:1789708539.755289:0:10249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.755321:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365452544 00000100:00100000:3.0:1789708539.755327:0:10249:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789708539.755327:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365452544 00000100:00100000:0.0:1789708539.755359:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789708539.755368:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:10249:x1876645365452544:12345-0@lo:502: 00000100:00100000:0.0:1789708539.755465:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:10249:x1876645365452544:12345-0@lo:502: Request processed in 96us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708539.755474:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789708539.755477:0:10249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10249:1876645365452544:0@lo:502: 00000100:00100000:3.0:1789708539.755524:0:10249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10249:1876645365452672:0@lo:502: 00000100:00100000:3.0:1789708539.755563:0:10249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.755583:0:10249:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.755595:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365452672 00000100:00100000:2.0:1789708539.755601:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365452672 00000100:00100000:2.0:1789708539.755632:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789708539.755641:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:10249:x1876645365452672:12345-0@lo:502: 00000100:00100000:2.0:1789708539.755728:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:10249:x1876645365452672:12345-0@lo:502: Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.755734:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789708539.755744:0:10249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10249:1876645365452672:0@lo:502: 00000040:00080000:3.0:1789708539.755793:0:10249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789708539.755858:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789708539.755884:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708539.755891:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.755900:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708539.755909:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789708539.755911:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee36337800 from 6 10000000:01000000:0.0:1789708539.755913:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789708539.755930:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.755939:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.755948:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.755961:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365452800:0@lo:101: 00000100:00100000:0.0:1789708539.755994:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.756022:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7633c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.756037:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365452800 00000100:00100000:2.0:1789708539.756041:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365452800 00000100:00100000:2.0:1789708539.756066:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789708539.756072:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365452800:12345-0@lo:101: 00010000:00010000:2.0:1789708539.756078:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708539.756085:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebca00/0xf45f43947e47cc91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cc8a expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.756098:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebca00/0xf45f43947e47cc91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cc8a expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.756104:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebca00/0xf45f43947e47cc91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cc8a expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.756109:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebca00, rc 0) 00000100:00100000:2.0:1789708539.756139:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365452800:12345-0@lo:101: Request processed in 68us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.756151:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789708539.756160:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365452800:0@lo:101: 00010000:00010000:0.0:1789708539.756175:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.756185:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.756228:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365452928:0@lo:256: 00000100:00100000:0.0:1789708539.756291:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.756319:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365452928 00000100:00100000:2.0:1789708539.756323:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365452928 00000100:00100000:0.0:1789708539.756326:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7633c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.756350:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789708539.756358:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365452928:12345-0@lo:256: 20000000:01000000:2.0:1789708539.756367:0:6477:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789708539.756381:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789708539.756384:0:6477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789708539.756463:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365452928:12345-0@lo:256: Request processed in 107us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.756469:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789708539.756482:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365452928:0@lo:256: 10000000:01000000:0.0:1789708539.756529:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789708539.756535:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.756544:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708539.756552:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789708539.756554:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1789708539.756556:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789708539.756571:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.756579:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.756588:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.756606:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365453056:0@lo:101: 00000100:00100000:0.0:1789708539.756631:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.756648:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.756665:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365453056 00000100:00100000:2.0:1789708539.756671:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365453056 00000100:00100000:2.0:1789708539.756704:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789708539.756712:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365453056:12345-0@lo:101: 00010000:00010000:2.0:1789708539.756717:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708539.756725:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47cc9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cc98 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.756737:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47cc9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cc98 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.756744:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47cc9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cc98 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.756749:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd800, rc 0) 00000100:00100000:2.0:1789708539.756806:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365453056:12345-0@lo:101: Request processed in 93us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.756826:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789708539.756827:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365453056:0@lo:101: 00010000:00010000:0.0:1789708539.756844:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708539.756854:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.756892:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365453184:0@lo:501: 00000100:00100000:0.0:1789708539.756919:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.756938:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.756943:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365453184 00000100:00100000:2.0:1789708539.756948:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365453184 00000100:00100000:2.0:1789708539.756974:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789708539.756980:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365453184:12345-0@lo:501: 00000100:00100000:2.0:1789708539.757054:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365453184:12345-0@lo:501: Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.757059:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789708539.757071:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365453184:0@lo:501: 00000100:00100000:0.0:1789708539.757107:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365453312:0@lo:503: 00000100:00100000:0.0:1789708539.757146:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.757165:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.757170:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365453312 00000100:00100000:2.0:1789708539.757173:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365453312 00000100:00100000:2.0:1789708539.757200:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789708539.757207:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365453312:12345-0@lo:503: 00000100:00100000:2.0:1789708539.757316:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365453312:12345-0@lo:503: Request processed in 110us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.757323:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789708539.757342:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365453312:0@lo:503: 00000100:00100000:3.0:1789708539.757521:0:10251:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10251:1876645365453440:0@lo:502: 00000100:00100000:3.0:1789708539.757559:0:10251:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.757581:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365453440 00000100:00100000:2.0:1789708539.757586:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365453440 00000100:00100000:3.0:1789708539.757587:0:10251:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.757620:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789708539.757631:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:10251:x1876645365453440:12345-0@lo:502: 00000100:00100000:2.0:1789708539.757729:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:10251:x1876645365453440:12345-0@lo:502: Request processed in 100us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.757735:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789708539.757751:0:10251:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10251:1876645365453440:0@lo:502: 00000020:01000000:3.0:1789708539.757786:0:10251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789708539.757790:0:10251:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789708539.757795:0:10251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708539.757796:0:10251:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789708539.757800:0:10251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789708539.757803:0:10251:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:3.0:1789708539.757819:0:10251:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789708539.757822:0:10251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789708539.757833:0:10251:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9bed08674d40) 00000020:00000080:3.0:1789708539.757848:0:10251:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1789708539.757853:0:10251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789708539.757923:0:10251:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789708539.757928:0:10251:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789708539.757934:0:10251:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47ccad 00010000:00080000:3.0:1789708539.757958:0:10251:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee3fa16000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789708539.758156:0:10251:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1789708539.758253:0:10251:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789708539.758321:0:10251:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789708539.758500:0:10251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708539.758628:0:10251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708539.758752:0:10251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789708539.758854:0:10251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789708539.759039:0:10252:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708539.759044:0:10252:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789708539.759418:0:10251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789708539.759424:0:10251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789708539.759451:0:10251:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789708539.759466:0:10251:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47ccb4 00000100:00080000:2.0:1789708539.759472:0:10251:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708539.759484:0:10251:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bee3fa16000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708539.759506:0:10251:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee363cc380 x1876645365453568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708539.759524:0:10251:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789708539.759537:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365453568:0@lo:8: 00000100:00100000:3.0:1789708539.759576:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789708539.759588:0:10251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708539.759594:0:10251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708539.759596:0:10251:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789708539.759602:0:10251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708539.759608:0:10251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708539.759610:0:10251:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789708539.759617:0:10251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789708539.759619:0:10251:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789708539.759646:0:10251:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10251:1876645365454208:0@lo:502: 00000100:00100000:0.0:1789708539.759681:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365453696:0@lo:400: 00000100:00100000:2.0:1789708539.759703:0:10251:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.759728:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365454208 00000100:00100000:2.0:1789708539.759731:0:10251:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6f900 going to sleep for 11 seconds 00000100:00100000:3.0:1789708539.759734:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365454208 00000100:00100000:0.0:1789708539.759735:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.759781:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789708539.759783:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876645365454336:0@lo:400: 00000100:00100000:3.0:1789708539.759794:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:10251:x1876645365454208:12345-0@lo:502: 00000100:00100000:0.0:1789708539.759813:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.759842:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365453696 00000100:00100000:0.0:1789708539.759846:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789708539.759847:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365453696 00000100:00100000:0.0:1789708539.759857:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365454080:0@lo:400: 00000100:00100000:3.0:1789708539.759890:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:10251:x1876645365454208:12345-0@lo:502: Request processed in 100us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.759896:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365454336 00000100:00100000:3.0:1789708539.759897:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789708539.759903:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365454336 00000100:00100000:0.0:1789708539.759905:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.759934:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365454720:0@lo:400: 00000100:00100000:2.0:1789708539.759949:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789708539.759958:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708539.759959:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365453696:12345-0@lo:400: 00000100:00100000:1.0:1789708539.759976:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876645365454336:12345-0@lo:400: 00000100:00100000:0.0:1789708539.759977:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.760008:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365454720 00000100:00100000:3.0:1789708539.760013:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365454720 00000100:00100000:2.0:1789708539.760017:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365453696:12345-0@lo:400: Request processed in 60us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.760024:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708539.760030:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365453696:0@lo:400: 00000100:00100000:1.0:1789708539.760039:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876645365454336:12345-0@lo:400: Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708539.760048:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708539.760053:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876645365454336:0@lo:400: 00000100:00100000:3.0:1789708539.760058:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365454720:12345-0@lo:400: 00000100:00100000:1.0:1789708539.760060:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789708539.760079:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708539.760084:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708539.760093:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365453568 00000100:00100000:0.0:1789708539.760099:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365453568 00000100:00100000:2.0:1789708539.760110:0:10251:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10251:1876645365454208:0@lo:502: 00000100:00100000:3.0:1789708539.760111:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365454720:12345-0@lo:400: Request processed in 54us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708539.760123:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708539.760136:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708539.760144:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876645365453568:12345-0@lo:8: 00000020:01000000:2.0:1789708539.760145:0:10251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708539.760151:0:10251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708539.760159:0:10251:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789708539.760162:0:10251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00010000:00080000:0.0:1789708539.760169:0:8397:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 110 last 0 00000020:00000080:0.0:1789708539.760194:0:8397:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47ccbb 00002000:00100000:0.0:1789708539.760208:0:8397:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9bee3fa71800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00000020:01000000:3.0:1789708539.760210:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 00002000:00080000:0.0:1789708539.760213:0:8397:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1789708539.760219:0:8397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:3.0:1789708539.760247:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789708539.760254:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1789708539.760284:0:8397:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:3.0:1789708539.760362:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708539.760370:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789708539.760373:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee02bf3800 from 39 10000000:01000000:3.0:1789708539.760375:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789708539.760391:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.760403:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.760411:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708539.760423:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365454848:0@lo:101: 00002000:00080000:0.0:1789708539.760448:0:8397:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:3.0:1789708539.760455:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789708539.760470:0:8397:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa70000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708539.760482:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.760487:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365454848 00000100:00100000:2.0:1789708539.760493:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365454848 00000100:00100000:2.0:1789708539.760520:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789708539.760527:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3614:x1876645365453568:12345-0@lo:8: Request processed in 380us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.760529:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365454848:12345-0@lo:101: 00010000:00080000:3.0:1789708539.760539:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee363cc380 x1876645365453568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1789708539.760542:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789708539.760546:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789708539.760552:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ccc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ccc2 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708539.760553:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789708539.760563:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789708539.760570:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00010000:00010000:2.0:1789708539.760572:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ccc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ccc2 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789708539.760575:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:0.0:1789708539.760581:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365453952:0@lo:400: 00000100:00080000:3.0:1789708539.760582:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa16000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:2.0:1789708539.760585:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ccc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ccc2 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708539.760597:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00010000:2.0:1789708539.760598:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc000, rc 0) 00000100:00100000:3.0:1789708539.760604:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365453568:0@lo:8: 00000100:00100000:0.0:1789708539.760622:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789708539.760625:0:10252:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789708539.760656:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876645365454592:0@lo:400: 00000004:00080000:3.0:1789708539.760658:0:10252:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 110570396616ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789708539.760658:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365454848:12345-0@lo:101: Request processed in 127us (199us total) trans 0 rc 0/0 00080000:00080000:3.0:1789708539.760667:0:10252:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789708539.760675:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789708539.760699:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.760716:0:10253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10253:1876645365454976:0@lo:700: 00000100:00100000:2.0:1789708539.760732:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365454848:0@lo:101: 00000100:00100000:0.0:1789708539.760734:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:2.0:1789708539.760747:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708539.760756:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365453824:0@lo:400: 00000100:00100000:3.0:1789708539.760774:0:10253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708539.760774:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708539.760800:0:10253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789708539.760820:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.760828:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365455104:0@lo:501: 00000100:00100000:3.0:1789708539.760851:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365454080 00000100:00100000:3.0:1789708539.760856:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365454080 00000100:00100000:0.0:1789708539.760861:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365454464:0@lo:400: 00000100:00100000:2.0:1789708539.760875:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.760895:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365453824 00000100:00100000:0.0:1789708539.760897:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708539.760905:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789708539.760907:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365453824 00000100:00100000:2.0:1789708539.760912:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708539.760920:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365454080:12345-0@lo:400: 00000100:00100000:3.0:1789708539.760937:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789708539.760939:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365454976 00000100:00100000:0.0:1789708539.760943:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365453952 00000100:00100000:2.0:1789708539.760944:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365454976 00000100:00100000:0.0:1789708539.760948:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365453952 00000100:00100000:3.0:1789708539.760949:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365453824:12345-0@lo:400: 00000100:00100000:1.0:1789708539.760965:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365454080:12345-0@lo:400: Request processed in 51us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708539.760973:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789708539.760983:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365454592 00000100:00100000:0.0:1789708539.760986:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365454592 00000100:00100000:2.0:1789708539.761000:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708539.761004:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365453824:12345-0@lo:400: Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708539.761013:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789708539.761014:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365454464 00000100:00100000:2.0:1789708539.761017:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10253:x1876645365454976:12345-0@lo:700: 00000100:00100000:0.0:1789708539.761020:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365454464 00000100:00100000:2.0:1789708539.761045:0:8406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8406:1876645365455232:0@lo:700: 00000100:00100000:0.0:1789708539.761058:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708539.761068:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365453952:12345-0@lo:400: 00000100:00100000:2.0:1789708539.761077:0:8406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.761102:0:8406:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708539.761107:0:9135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365455232 00000100:00100000:1.0:1789708539.761113:0:9135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365455232 00000100:00100000:0.0:1789708539.761113:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365453952:12345-0@lo:400: Request processed in 46us (491us total) trans 0 rc 0/0 00000100:00080000:2.0:1789708539.761116:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708539.761122:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708539.761126:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789708539.761127:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708539.761148:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365455104 00000100:00100000:0.0:1789708539.761151:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789708539.761154:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365455104 00000100:00100000:1.0:1789708539.761154:0:9135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708539.761162:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3618:x1876645365454592:12345-0@lo:400: 00000100:00100000:1.0:1789708539.761169:0:9135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0002:lustre-MDT0000-lwp-OST0001_UUID+6:8406:x1876645365455232:12345-0@lo:700: 00000100:00100000:2.0:1789708539.761191:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789708539.761195:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3618:x1876645365454592:12345-0@lo:400: Request processed in 36us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.761202:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365455104:12345-0@lo:501: 00000100:00100000:0.0:1789708539.761207:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708539.761223:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789708539.761231:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365454464:12345-0@lo:400: 00000100:00100000:0.0:1789708539.761283:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365454464:12345-0@lo:400: Request processed in 55us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708539.761288:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789708539.761320:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365455104:12345-0@lo:501: Request processed in 120us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.761330:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789708539.761377:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365455104:0@lo:501: 00000100:00100000:2.0:1789708539.761412:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365455360:0@lo:503: 00000100:00100000:2.0:1789708539.761456:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.761487:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365455360 00000100:00100000:2.0:1789708539.761491:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708539.761495:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365455360 00000100:00100000:3.0:1789708539.761537:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789708539.761548:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365453824:0@lo:400: 00000100:00100000:3.0:1789708539.761550:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365455360:12345-0@lo:503: 00010000:00080000:0.0:1789708539.761565:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09880000 x1876645365454464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708539.761580:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365454464:0@lo:400: 00000100:00100000:0.0:1789708539.761591:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365453952:0@lo:400: 00000100:00100000:0.0:1789708539.761599:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876645365454592:0@lo:400: 00000100:00100000:0.0:1789708539.761628:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365454080:0@lo:400: 00010000:00080000:0.0:1789708539.761639:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09882a00 x1876645365454720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708539.761646:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365454720:0@lo:400: 00000100:00100000:3.0:1789708539.761714:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365455360:12345-0@lo:503: Request processed in 166us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708539.761723:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789708539.761808:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365455360:0@lo:503: 00000100:00100000:0.0:1789708539.761998:0:10255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09882a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10255:1876645365455488:0@lo:502: 00000100:00100000:0.0:1789708539.762033:0:10255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.762054:0:10255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.762118:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365455488 00000100:00100000:2.0:1789708539.762123:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365455488 00000001:00100000:3.0:1789708539.762147:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000100:00100000:2.0:1789708539.762153:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789708539.762161:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10255:x1876645365455488:12345-0@lo:502: 40000000:02000000:1.0:1789708539.762179:0:9135:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000004:00080000:0.0:1789708539.762314:0:7415:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789708539.762320:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10255:x1876645365455488:12345-0@lo:502: Request processed in 157us (283us total) trans 0 rc 0/0 00000001:00100000:0.0:1789708539.762330:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000100:00100000:2.0:1789708539.762339:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789708539.762357:0:10255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09882a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10255:1876645365455488:0@lo:502: 00000100:00100000:0.0:1789708539.762391:0:10255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09882a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10255:1876645365455616:0@lo:502: 00000100:00100000:0.0:1789708539.762417:0:10255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.762440:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365455616 00000100:00100000:0.0:1789708539.762442:0:10255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708539.762445:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365455616 00000100:00100000:3.0:1789708539.762471:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789708539.762478:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10255:x1876645365455616:12345-0@lo:502: 00000100:00100000:3.0:1789708539.762546:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10255:x1876645365455616:12345-0@lo:502: Request processed in 69us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708539.762552:0:10255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09882a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10255:1876645365455616:0@lo:502: 00000100:00100000:3.0:1789708539.762554:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000040:00080000:0.0:1789708539.762581:0:10255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789708539.762621:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789708539.762646:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789708539.762651:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.762658:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708539.762671:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708539.762673:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee02bf3800 from 6 10000000:01000000:3.0:1789708539.762674:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708539.762685:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.762691:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.762696:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708539.762703:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365455744:0@lo:101: 00000100:00100000:3.0:1789708539.762721:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.762734:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.762759:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365455744 00000100:00100000:2.0:1789708539.762778:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365455744 00000100:00100000:2.0:1789708539.762808:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789708539.762818:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365455744:12345-0@lo:101: 00010000:00010000:2.0:1789708539.762826:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708539.762835:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc600/0xf45f43947e47ccd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ccd0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.762852:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc600/0xf45f43947e47ccd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ccd0 expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.762861:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc600/0xf45f43947e47ccd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ccd0 expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.762868:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc600, rc 0) 00000100:00100000:2.0:1789708539.762907:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365455744:12345-0@lo:101: Request processed in 91us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.762914:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789708539.762919:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365455744:0@lo:101: 00010000:00010000:3.0:1789708539.762931:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.762938:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708539.762968:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365455872:0@lo:256: 00000100:00100000:3.0:1789708539.762988:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.763006:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.763016:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365455872 00000100:00100000:2.0:1789708539.763022:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365455872 00000100:00100000:2.0:1789708539.763050:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789708539.763059:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365455872:12345-0@lo:256: 20000000:01000000:2.0:1789708539.763071:0:6479:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789708539.763085:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789708539.763089:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789708539.763184:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365455872:12345-0@lo:256: Request processed in 125us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708539.763191:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365455872:0@lo:256: 00000100:00100000:2.0:1789708539.763206:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 10000000:01000000:3.0:1789708539.763241:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708539.763253:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.763291:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708539.763300:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789708539.763302:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789708539.763306:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789708539.763323:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.763331:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.763340:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708539.763353:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365456000:0@lo:101: 00000100:00100000:3.0:1789708539.763383:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.763407:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365456000 00000100:00100000:3.0:1789708539.763414:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.763414:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365456000 00000100:00100000:2.0:1789708539.763449:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789708539.763458:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365456000:12345-0@lo:101: 00010000:00010000:2.0:1789708539.763465:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708539.763474:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc200/0xf45f43947e47cce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ccde expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.763489:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc200/0xf45f43947e47cce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ccde expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.763499:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc200/0xf45f43947e47cce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ccde expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.763507:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc200, rc 0) 00000100:00100000:2.0:1789708539.763540:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365456000:12345-0@lo:101: Request processed in 84us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.763547:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789708539.763555:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365456000:0@lo:101: 00010000:00010000:3.0:1789708539.763570:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.763579:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708539.763619:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365456128:0@lo:501: 00000100:00100000:3.0:1789708539.763654:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.763672:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.763677:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365456128 00000100:00100000:2.0:1789708539.763683:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365456128 00000100:00100000:2.0:1789708539.763710:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789708539.763718:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365456128:12345-0@lo:501: 00000100:00100000:2.0:1789708539.763810:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365456128:12345-0@lo:501: Request processed in 92us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.763819:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789708539.763822:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365456128:0@lo:501: 00000100:00100000:3.0:1789708539.763863:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365456256:0@lo:503: 00000100:00100000:3.0:1789708539.763901:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.763920:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.763924:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365456256 00000100:00100000:2.0:1789708539.763930:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365456256 00000100:00100000:2.0:1789708539.763968:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789708539.763976:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365456256:12345-0@lo:503: 00000100:00100000:2.0:1789708539.764073:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365456256:12345-0@lo:503: Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.764080:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789708539.764084:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365456256:0@lo:503: 00000100:00100000:2.0:1789708539.764283:0:10256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10256:1876645365456384:0@lo:502: 00000100:00100000:2.0:1789708539.764331:0:10256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.764355:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365456384 00000100:00100000:3.0:1789708539.764359:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365456384 00000100:00100000:2.0:1789708539.764364:0:10256:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0651f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789708539.764386:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789708539.764392:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10256:x1876645365456384:12345-0@lo:502: 00000100:00100000:3.0:1789708539.764470:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10256:x1876645365456384:12345-0@lo:502: Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708539.764476:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789708539.764490:0:10256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10256:1876645365456384:0@lo:502: 00000020:01000000:2.0:1789708539.764519:0:10256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789708539.764525:0:10256:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789708539.764532:0:10256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708539.764534:0:10256:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789708539.764539:0:10256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789708539.764543:0:10256:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:2.0:1789708539.764561:0:10256:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789708539.764566:0:10256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708539.764577:0:10256:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bed095f99c0) 00000020:00000080:2.0:1789708539.764595:0:10256:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1789708539.764603:0:10256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789708539.764702:0:10256:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789708539.764708:0:10256:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789708539.764715:0:10256:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47ccf3 00010000:00080000:2.0:1789708539.764778:0:10256:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee3fa16800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.152@tcp at head 00000100:00100000:1.0:1789708539.764836:0:9135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0002:lustre-MDT0000-lwp-OST0001_UUID+5:8406:x1876645365455232:12345-0@lo:700: Request processed in 3671us (3759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708539.764851:0:9135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708539.764862:0:8406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8406:1876645365455232:0@lo:700: 40000000:02000000:3.0:1789708539.764871:0:8406:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00010000:00010000:2.0:1789708539.765061:0:10256:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1789708539.765173:0:10256:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789708539.765182:0:10256:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789708539.765374:0:10256:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708539.765546:0:10256:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708539.765661:0:10256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789708539.765740:0:10256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789708539.765920:0:10257:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708539.765923:0:10257:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789708539.766406:0:10256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708539.766415:0:10256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789708539.766458:0:10256:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789708539.766472:0:10256:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ccfa 00000100:00080000:1.0:1789708539.766477:0:10256:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708539.766482:0:10256:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bee3fa16800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708539.766499:0:10256:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3e928700 x1876645365456512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708539.766518:0:10256:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789708539.766540:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365456512:0@lo:8: 00000020:01000000:1.0:1789708539.766570:0:10256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1789708539.766576:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1789708539.766576:0:10256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708539.766580:0:10256:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789708539.766583:0:10256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708539.766587:0:10256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708539.766588:0:10256:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789708539.766592:0:10256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789708539.766594:0:10256:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789708539.766612:0:10256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10256:1876645365456640:0@lo:502: 00000100:00100000:1.0:1789708539.766654:0:10256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708539.766672:0:10256:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1814a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.766684:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365456640 00000100:00100000:2.0:1789708539.766688:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365456640 00000100:00100000:1.0:1789708539.766702:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365456512 00000100:00100000:1.0:1789708539.766707:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365456512 00000100:00100000:2.0:1789708539.766718:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789708539.766726:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10256:x1876645365456640:12345-0@lo:502: 00000100:00100000:1.0:1789708539.766735:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708539.766741:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3614:x1876645365456512:12345-0@lo:8: 00010000:00080000:1.0:1789708539.766757:0:8398:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 110 last 0 00000020:00000080:1.0:1789708539.766790:0:8398:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47cd01 00002000:00100000:1.0:1789708539.766799:0:8398:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bee3f9f5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789708539.766807:0:8398:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789708539.766809:0:8398:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789708539.766842:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10256:x1876645365456640:12345-0@lo:502: Request processed in 116us (185us total) trans 0 rc 0/0 00002000:00080000:1.0:1789708539.766848:0:8398:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1789708539.766852:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:1.0:1789708539.766868:0:8398:0:(import.c:65:import_set_state_nolock()) ffff9bee3f9f3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708539.766910:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1876645365456512:12345-0@lo:8: Request processed in 167us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708539.766916:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789708539.766927:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3e928700 x1876645365456512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708539.766934:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789708539.766939:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789708539.766945:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789708539.766949:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:1.0:1789708539.766952:0:10256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10256:1876645365456640:0@lo:502: 00000100:00080000:2.0:1789708539.766954:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa16800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789708539.766969:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789708539.766973:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365456512:0@lo:8: 00000020:01000000:1.0:1789708539.766980:0:10256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708539.766984:0:10256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708539.766986:0:10256:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789708539.766989:0:10256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:2.0:1789708539.766993:0:10257:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789708539.767031:0:10257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 110576769643ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789708539.767039:0:10257:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:3.0:1789708539.767387:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789708539.767414:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789708539.767422:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.767432:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708539.767441:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789708539.767444:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bee18160000 from 1 10000000:01000000:3.0:1789708539.767452:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789708539.767467:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.767473:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.767480:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708539.767490:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365456768:0@lo:101: 00000100:00100000:3.0:1789708539.767517:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.767538:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365456768 00000100:00100000:2.0:1789708539.767544:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365456768 00000100:00100000:3.0:1789708539.767548:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.767583:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789708539.767593:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365456768:12345-0@lo:101: 00010000:00010000:2.0:1789708539.767600:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708539.767609:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee00030800/0xf45f43947e47cd0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cd08 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.767623:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee00030800/0xf45f43947e47cd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cd08 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.767630:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee00030800/0xf45f43947e47cd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd08 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708539.767636:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee00030800, rc 0) 00000100:00100000:2.0:1789708539.767669:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365456768:12345-0@lo:101: Request processed in 80us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.767674:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789708539.767682:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365456768:0@lo:101: 00010000:00010000:3.0:1789708539.767694:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.767701:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708539.767732:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365456896:0@lo:501: 00000100:00100000:3.0:1789708539.767758:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.767788:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708539.767810:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365456896 00000100:00100000:1.0:1789708539.767816:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365456896 00000100:00100000:1.0:1789708539.767846:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789708539.767854:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365456896:12345-0@lo:501: 00000100:00100000:1.0:1789708539.767911:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365456896:12345-0@lo:501: Request processed in 59us (152us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789708539.767918:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789708539.767926:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365456896:0@lo:501: 10000000:01000000:3.0:1789708539.767954:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789708539.767959:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708539.767965:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1789708539.768225:0:9480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789708539.768232:0:9480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789708539.768237:0:9480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000004:00080000:1.0:1789708539.768246:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789708539.768342:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10253:x1876645365454976:12345-0@lo:700: Request processed in 7331us (7586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708539.768349:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789708539.768360:0:10253:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0855d180 x1876645365454976/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789708555 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708539.768370:0:10253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10253:1876645365454976:0@lo:700: 00000004:00080000:3.0:1789708539.769005:0:10259:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789708539.769014:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365457024:0@lo:13: 00000100:00100000:3.0:1789708539.769021:0:10259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10259:1876645365457152:0@lo:7: 00000100:00100000:1.0:1789708539.769055:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708539.769062:0:10259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.769090:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365457024 00000100:00100000:3.0:1789708539.769094:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365457152 00000100:00100000:0.0:1789708539.769098:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365457024 00000100:00100000:3.0:1789708539.769100:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365457152 00000100:00100000:3.0:1789708539.769140:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789708539.769151:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10259:x1876645365457152:12345-0@lo:7: 00000100:00100000:0.0:1789708539.769156:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708539.769172:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876645365457024:12345-0@lo:13: 00002000:00000024:0.0:1789708539.769190:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1789708539.769235:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876645365457024:12345-0@lo:13: Request processed in 65us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708539.769241:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789708539.769248:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09945500 x1876645365457024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708539.769312:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708539.769325:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365457024:0@lo:13: 00000004:00080000:0.0:1789708539.770340:0:10253:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789708539.770352:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365457280:0@lo:13: 00000100:00100000:0.0:1789708539.770358:0:10253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09883100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10253:1876645365457408:0@lo:7: 00000100:00100000:1.0:1789708539.770404:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.770416:0:10253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.770446:0:10253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708539.770468:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365457280 00000100:00100000:0.0:1789708539.770469:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365457408 00000100:00100000:1.0:1789708539.770473:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365457280 00000100:00100000:0.0:1789708539.770474:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365457408 00000100:00100000:1.0:1789708539.770514:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708539.770518:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708539.770525:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1876645365457280:12345-0@lo:13: 00000100:00100000:0.0:1789708539.770531:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:10253:x1876645365457408:12345-0@lo:7: 00002000:00000024:1.0:1789708539.770538:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789708539.770576:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1876645365457280:12345-0@lo:13: Request processed in 56us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708539.770582:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789708539.770612:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09882a00 x1876645365457280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708539.770625:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365457280:0@lo:13: 00000100:00100000:1.0:1789708539.771304:0:10259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b180 going to sleep for 11 seconds 00002000:00080000:3.0:1789708539.772696:0:9145:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789708539.772701:0:9145:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789708539.772740:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10259:x1876645365457152:12345-0@lo:7: Request processed in 3592us (3680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708539.772747:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789708539.772772:0:10259:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09944a80 x1876645365457152/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789708555 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708539.772788:0:10259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10259:1876645365457152:0@lo:7: 00000004:00080000:2.0:1789708539.772802:0:10259:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789708539.772826:0:10259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10259:1876645365457536:0@lo:5: 00000100:00100000:2.0:1789708539.772865:0:10259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.772892:0:10259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee08376000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708539.772900:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365457536 00000100:00100000:1.0:1789708539.772905:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365457536 00000100:00100000:1.0:1789708539.772946:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708539.772957:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10259:x1876645365457536:12345-0@lo:5: 00002000:00080000:1.0:1789708539.772978:0:8399:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789708539.772982:0:8399:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789708539.776675:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10259:x1876645365457536:12345-0@lo:5: Request processed in 3720us (3809us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789708539.776683:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00080000:0.0:1789708539.776938:0:10054:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789708539.776942:0:10054:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789708539.776979:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:10253:x1876645365457408:12345-0@lo:7: Request processed in 6454us (6565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708539.776986:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789708539.777017:0:10253:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09883100 x1876645365457408/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789708555 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708539.777026:0:10253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09883100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10253:1876645365457408:0@lo:7: 00000004:00080000:0.0:1789708539.777034:0:10253:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789708539.777061:0:10253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09883100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10253:1876645365457664:0@lo:5: 00000100:00100000:0.0:1789708539.777103:0:10253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.777143:0:10253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708539.777159:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365457664 00000100:00100000:0.0:1789708539.777162:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365457664 00000100:00100000:0.0:1789708539.777192:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708539.777199:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10253:x1876645365457664:12345-0@lo:5: 00002000:00080000:0.0:1789708539.777213:0:8398:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789708539.777247:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10253:x1876645365457664:12345-0@lo:5: Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708539.777253:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789708539.777363:0:10253:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09883100 x1876645365457664/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708555 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708539.777371:0:10253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09883100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10253:1876645365457664:0@lo:5: 00000004:00080000:0.0:1789708539.777381:0:10253:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789708539.777403:0:10253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09883100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10253:1876645365457792:0@lo:5: 00000100:00100000:0.0:1789708539.777430:0:10253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789708539.777450:0:10259:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee363cf100 x1876645365457536/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708555 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708539.777451:0:10253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.777470:0:10259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10259:1876645365457536:0@lo:5: 00000100:00100000:0.0:1789708539.777471:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365457792 00000100:00100000:0.0:1789708539.777477:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365457792 00000004:00080000:2.0:1789708539.777487:0:10259:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789708539.777511:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708539.777515:0:10259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10259:1876645365457920:0@lo:700: 00000100:00100000:0.0:1789708539.777524:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10253:x1876645365457792:12345-0@lo:5: 00002000:00080000:0.0:1789708539.777550:0:8397:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1789708539.777551:0:10259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708539.777589:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365457920 00000100:00100000:2.0:1789708539.777594:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365457920 00000100:00100000:2.0:1789708539.777643:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708539.777655:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10259:x1876645365457920:12345-0@lo:700: 00000100:00100000:2.0:1789708539.779163:0:10259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee08376000 going to sleep for 11 seconds 00000001:00080000:2.0:1789708539.780311:0:9480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1789708539.780369:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10259:x1876645365457920:12345-0@lo:700: Request processed in 2717us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.780377:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789708539.780406:0:10259:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee363ced80 x1876645365457920/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789708555 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708539.780414:0:10259:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789708539.780423:0:10259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10259:1876645365457920:0@lo:700: 00000100:00100000:0.0:1789708539.780695:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:10253:x1876645365457792:12345-0@lo:5: Request processed in 3174us (3264us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789708539.780702:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789708539.780929:0:10253:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09883100 x1876645365457792/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708555 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708539.780943:0:10253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09883100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10253:1876645365457792:0@lo:5: 00000004:00080000:0.0:1789708539.780950:0:10253:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789708539.780971:0:10253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10253:1876645365458048:0@lo:900: 00000100:00100000:0.0:1789708539.780993:0:10253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708539.781021:0:10253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708539.781045:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365458048 00000100:00100000:2.0:1789708539.781050:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365458048 00000100:00100000:2.0:1789708539.781080:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708539.781086:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10253:x1876645365458048:12345-0@lo:900: 00000100:00100000:2.0:1789708539.781132:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10253:x1876645365458048:12345-0@lo:900: Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708539.781139:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:02000040:1.0:1789708539.781188:0:10259:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1789708539.781214:0:10253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10253:1876645365458048:0@lo:900: 00000100:00100000:1.0:1789708539.783905:0:10259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10259:1876645365458176:0@lo:5: 00000100:00100000:1.0:1789708539.783934:0:10259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708539.783968:0:10259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1814a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789708539.783979:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365458176 00000100:00100000:0.0:1789708539.783985:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365458176 00000100:00100000:0.0:1789708539.784015:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708539.784022:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10259:x1876645365458176:12345-0@lo:5: 00002000:00080000:0.0:1789708539.787023:0:8398:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789708539.787036:0:8398:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789708539.788896:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10259:x1876645365458176:12345-0@lo:5: Request processed in 4873us (4961us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789708539.788902:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789708539.788950:0:10259:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3e928a80 x1876645365458176/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708555 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708539.788966:0:10259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10259:1876645365458176:0@lo:5: 00000004:00080000:2.0:1789708539.788980:0:10259:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000080:3.0:1789708540.107787:0:10298:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7a24a930 20000000:00000080:3.0:1789708540.107805:0:10298:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bed09a05c00 uarg=0000000000000000 20000000:01000000:3.0:1789708540.107858:0:10298:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789708540.107861:0:10298:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789708540.107864:0:10298:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789708540.107869:0:10298:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789708540.107874:0:10298:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789708540.107936:0:10298:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789708540.107938:0:10298:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789708540.108300:0:10299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1789708540.108699:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1789708540.108734:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1789708540.108768:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1789708540.108791:0:10298:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789708540.108800:0:10298:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789708540.109108:0:10300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1789708540.109533:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1789708540.109556:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1789708540.109572:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1789708540.109582:0:10298:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789708540.109584:0:10298:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789708540.109809:0:10301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1789708540.109965:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1789708540.109991:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1789708540.110008:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1789708540.110025:0:10298:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789708540.110027:0:10298:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789708540.110297:0:10302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1789708540.110415:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1789708540.110429:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1789708540.110437:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1789708540.110446:0:10298:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789708540.110448:0:10298:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789708540.110653:0:10303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1789708540.111115:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1789708540.111145:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1789708540.111165:0:10298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:1.0:1789708540.111184:0:10298:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789708540.111204:0:10298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111223:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01508e00/0xf45f43947e47cbb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cbaa expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111232:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebe200/0xf45f43947e47cbdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cbd4 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111243:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47cc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de01 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111251:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cc21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de08 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111289:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47cc67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cc60 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111298:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cc6e expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111317:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cc7c expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111324:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47cc9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cc98 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111331:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ccc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ccc2 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111339:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebc200/0xf45f43947e47cce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ccde expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111346:0:10298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee00030800/0xf45f43947e47cd0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd08 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111354:0:10298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111395:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee00030800/0xf45f43947e47cd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cd08 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111409:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee00030800/0xf45f43947e47cd0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cd08 expref: 23 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.111425:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e929c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365458304:0@lo:104: 00000100:00100000:1.0:1789708540.111490:0:10298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708540.111537:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365458304 00000100:00100000:0.0:1789708540.111547:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365458304 00010000:00010000:1.0:1789708540.111556:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebc200/0xf45f43947e47cce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ccde expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111568:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebc200/0xf45f43947e47cce5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ccde expref: 23 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.111586:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e929880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365458432:0@lo:104: 00000100:00100000:0.0:1789708540.111609:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789708540.111618:0:10298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708540.111624:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:10298:x1876645365458304:12345-0@lo:104: 00010000:00010000:0.0:1789708540.111640:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708540.111653:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365458432 00010000:00010000:1.0:1789708540.111660:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ccc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ccc2 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708540.111661:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365458432 00010000:00010000:1.0:1789708540.111675:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ccc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ccc2 expref: 23 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.111687:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365458560:0@lo:104: 00000100:00100000:2.0:1789708540.111718:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789708540.111719:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789708540.111735:0:10298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708540.111735:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10298:x1876645365458304:12345-0@lo:104: Request processed in 109us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708540.111742:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10298:x1876645365458432:12345-0@lo:104: 00000100:00100000:0.0:1789708540.111752:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789708540.111770:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.111775:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365458560 00000100:00100000:3.0:1789708540.111789:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365458560 00010000:00010000:1.0:1789708540.111796:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47cc9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cc98 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.111809:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47cc9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cc98 expref: 23 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.111819:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789708540.111823:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365458688:0@lo:104: 00010000:00010000:0.0:1789708540.111828:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.111840:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1789708540.111843:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789708540.111844:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509e00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708540.111851:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.111865:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10298:x1876645365458560:12345-0@lo:104: 00000100:00100000:2.0:1789708540.111867:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10298:x1876645365458432:12345-0@lo:104: Request processed in 127us (238us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708540.111871:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.111888:0:10298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708540.111896:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708540.111898:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 10000000:00010000:0.0:1789708540.111899:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708540.111927:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365458688 10000000:01000000:0.0:1789708540.111928:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708540.111929:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cc7c expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708540.111935:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365458688 00010000:00010000:1.0:1789708540.111948:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cc83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cc7c expref: 23 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.111968:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365458816:0@lo:104: 00000100:00100000:2.0:1789708540.111970:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789708540.111972:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.111984:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708540.111989:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789708540.111990:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10298:x1876645365458688:12345-0@lo:104: 00000100:00100000:3.0:1789708540.112002:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10298:x1876645365458560:12345-0@lo:104: Request processed in 147us (269us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708540.112010:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112016:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.112017:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708540.112029:0:10298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708540.112043:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365458816 00010000:00010000:0.0:1789708540.112044:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47cd08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cd0f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.112048:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365458816 00010000:00010000:1.0:1789708540.112069:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cc6e expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112076:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708540.112083:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112091:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789708540.112093:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789708540.112115:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed07ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10298:x1876645365458816:12345-0@lo:104: 00000100:00100000:2.0:1789708540.112118:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10298:x1876645365458688:12345-0@lo:104: Request processed in 126us (238us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708540.112123:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508200 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:1.0:1789708540.112124:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cc75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cc6e expref: 23 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708540.112128:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708540.112131:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708540.112168:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789708540.112182:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.112183:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365459072:0@lo:104: 00010000:00010000:3.0:1789708540.112192:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1789708540.112206:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1789708540.112208:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed07ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:10298:x1876645365458816:12345-0@lo:104: Request processed in 99us (191us total) trans 0 rc 0/0 10000000:00010000:0.0:1789708540.112208:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112215:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708540.112238:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789708540.112244:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789708540.112249:0:10298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708540.112291:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509000 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708540.112297:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112311:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112312:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112332:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789708540.112345:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708540.112354:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708540.112363:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.112367:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365459072 00000100:00100000:3.0:1789708540.112376:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365459072 00010000:00010000:0.0:1789708540.112378:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01508200/0xf45f43947e47ccde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cce5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.112391:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47cc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cc60 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112396:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112398:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708540.112407:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.112412:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47cc67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cc60 expref: 23 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112413:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789708540.112414:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1789708540.112427:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.112437:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:10298:x1876645365459072:12345-0@lo:104: 00010000:00010000:0.0:1789708540.112439:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebe800 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708540.112452:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.112459:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09adb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365459456:0@lo:104: 00010000:00010000:3.0:1789708540.112469:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112470:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47ccc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ccc9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112476:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.112506:0:10298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1789708540.112517:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112520:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708540.112527:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708540.112540:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:0.0:1789708540.112550:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708540.112552:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de08 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.112556:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:10298:x1876645365459072:12345-0@lo:104: Request processed in 125us (317us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708540.112580:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.112587:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1789708540.112608:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebe000 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:0.0:1789708540.112608:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789708540.112612:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365459456 00010000:00010000:1.0:1789708540.112614:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cc21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de08 expref: 9 pid: 6477 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.112617:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365459456 10000000:00010000:2.0:1789708540.112617:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112621:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.112643:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1789708540.112651:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cc98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112655:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.112655:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365459584:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708540.112664:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:10298:x1876645365459456:12345-0@lo:104: 00010000:00010000:0.0:1789708540.112682:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708540.112697:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708540.112700:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112700:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708540.112733:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708540.112734:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47cc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de01 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112735:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebe600 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708540.112745:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.112770:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47cc1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de01 expref: 9 pid: 6477 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112771:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112781:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112799:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789708540.112800:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708540.112803:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789708540.112804:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09adbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365459840:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708540.112809:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.112826:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:10298:x1876645365459456:12345-0@lo:104: Request processed in 162us (326us total) trans 0 rc 0/0 10000000:01000000:0.0:1789708540.112833:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708540.112854:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cc7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc83 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.112857:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1789708540.112866:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebe200/0xf45f43947e47cbdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cbd4 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112875:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112880:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708540.112889:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.112897:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708540.112898:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebe200/0xf45f43947e47cbdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cbd4 expref: 23 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112906:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebfe00 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:0.0:1789708540.112915:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708540.112916:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.112920:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09adaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365460096:0@lo:104: 00010000:00010000:0.0:1789708540.112941:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cc6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.112966:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.112966:0:10298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708540.112967:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708540.112972:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708540.112978:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789708540.112980:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708540.112988:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789708540.112997:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365458944:0@lo:103: 00010000:00010000:1.0:1789708540.113005:0:10298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01508e00/0xf45f43947e47cbb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cbaa expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.113020:0:10298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee01508e00/0xf45f43947e47cbb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cbaa expref: 23 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.113024:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.113037:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789708540.113039:0:10298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365460352:0@lo:104: 00010000:00010000:2.0:1789708540.113047:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.113055:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708540.113060:0:9489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365460096 00010000:00010000:2.0:1789708540.113063:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cc60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cc67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.113068:0:9489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365460096 00010000:00010000:2.0:1789708540.113081:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708540.113084:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708540.113089:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708540.113090:0:10298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708540.113094:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365459968:0@lo:103: 00010000:00010000:2.0:1789708540.113101:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708540.113109:0:10298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20d12e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708540.113118:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365459200:0@lo:103: 00000100:00100000:0.0:1789708540.113132:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708540.113137:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e929c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365458304:0@lo:104: 00000100:00100000:1.0:1789708540.113154:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e929880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365458432:0@lo:104: 00000100:00100000:2.0:1789708540.113164:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708540.113176:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708540.113177:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365458560:0@lo:104: 00000100:00100000:0.0:1789708540.113194:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365459712:0@lo:103: 00000100:00100000:3.0:1789708540.113196:0:9489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365460352 00000100:00100000:1.0:1789708540.113201:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365458688:0@lo:104: 00000100:00100000:3.0:1789708540.113204:0:9489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365460352 00000100:00100000:2.0:1789708540.113206:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365460224:0@lo:103: 00000100:00100000:1.0:1789708540.113220:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365458816:0@lo:104: 00000100:00100000:1.0:1789708540.113240:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365459072:0@lo:104: 00000100:00100000:3.0:1789708540.113249:0:9489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789708540.113252:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708540.113255:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09adb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365459456:0@lo:104: 00000100:00100000:3.0:1789708540.113311:0:9489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10298:x1876645365460096:12345-0@lo:104: 00000100:00100000:2.0:1789708540.113318:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708540.113333:0:9489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.113352:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365459328:0@lo:103: 00000100:00100000:1.0:1789708540.113358:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365458944 00000100:00100000:1.0:1789708540.113367:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365458944 00000100:00100000:2.0:1789708540.113376:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365459968 00000100:00100000:2.0:1789708540.113383:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365459968 00010000:00010000:1.0:1789708540.113395:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee00030800/0xf45f43947e47cd0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cd08 expref: 25 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.113404:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cc83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cc7c expref: 25 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.113444:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365459200 00000100:00100000:2.0:1789708540.113447:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365459712 00000100:00100000:1.0:1789708540.113450:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365459200 00000100:00100000:2.0:1789708540.113454:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365459712 00010000:00010000:1.0:1789708540.113474:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebc200/0xf45f43947e47cce5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ccde expref: 27 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.113480:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47cc9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cc98 expref: 27 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.113500:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365460224 00000100:00100000:0.0:1789708540.113501:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708540.113505:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365460224 00000100:00100000:2.0:1789708540.113509:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365459328 00000100:00100000:2.0:1789708540.113516:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365459328 00010000:00010000:1.0:1789708540.113525:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cc75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cc6e expref: 29 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708540.113527:0:9489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708540.113533:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365460480:0@lo:103: 00010000:00010000:2.0:1789708540.113538:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ccc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ccc2 expref: 29 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.113547:0:9489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10298:x1876645365460096:12345-0@lo:104: Request processed in 237us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708540.113567:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708540.113581:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708540.113583:0:9489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708540.113587:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+29:3618:x1876645365458944:12345-0@lo:103: 00000100:00100000:2.0:1789708540.113593:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789708540.113604:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789708540.113615:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08574850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+29:3618:x1876645365459968:12345-0@lo:103: 00010000:00010000:1.0:1789708540.113615:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee00030800/0xf45f43947e47cd0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cd08 expref: 29 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.113628:0:9489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789708540.113632:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365460480 00010000:00010000:2.0:1789708540.113637:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789708540.113642:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365460480 00010000:00010000:2.0:1789708540.113648:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cc83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cc7c expref: 29 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.113656:0:9489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:10298:x1876645365460352:12345-0@lo:104: 00010000:00010000:1.0:1789708540.113658:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee00030800/0xf45f43947e47cd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cd08 expref: 30 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.113668:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47cc67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cc60 expref: 30 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708540.113680:0:9489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.113695:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cc7c expref: 30 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.113718:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789708540.113734:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee00030800/0xf45f43947e47cd0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cd08 expref: 30 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.113735:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+30:3615:x1876645365459200:12345-0@lo:103: 00010000:00010000:2.0:1789708540.113739:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cc83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cc7c expref: 30 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.113770:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708540.113783:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708540.113784:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708540.113785:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebc200/0xf45f43947e47cce5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ccde expref: 28 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708540.113799:0:9489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789708540.113801:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebc200/0xf45f43947e47cce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ccde expref: 28 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.113813:0:9489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:10298:x1876645365460352:12345-0@lo:104: Request processed in 164us (720us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708540.113828:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebc200/0xf45f43947e47cce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ccde expref: 28 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.113829:0:9489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789708540.113844:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+28:3618:x1876645365458944:12345-0@lo:103: Request processed in 259us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708540.113845:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08574850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+28:3618:x1876645365459968:12345-0@lo:103: Request processed in 238us (711us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708540.113855:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708540.113866:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789708540.113874:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789708540.113896:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708540.113911:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3618:x1876645365459712:12345-0@lo:103: 00000100:00100000:0.0:1789708540.113913:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3615:x1876645365459200:12345-0@lo:103: Request processed in 181us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708540.113928:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789708540.113939:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789708540.113943:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789708540.113951:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47cc9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cc98 expref: 24 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708540.113959:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3615:x1876645365460224:12345-0@lo:103: 00000100:00100000:0.0:1789708540.113960:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1789708540.113970:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47cc9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cc98 expref: 24 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.113979:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3616:x1876645365459328:12345-0@lo:103: 00010000:00010000:2.0:1789708540.113991:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708540.113996:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47cc9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cc98 expref: 24 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.113997:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708540.114000:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cc75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cc6e expref: 24 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.114009:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ccc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ccc2 expref: 24 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.114021:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708540.114030:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cc6e expref: 23 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.114047:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ccc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ccc2 expref: 23 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114067:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebd000/0xf45f43947e47cc75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cc6e expref: 23 pid: 6478 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.114074:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ccc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ccc2 expref: 23 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.114076:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:3618:x1876645365459712:12345-0@lo:103: Request processed in 165us (822us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708540.114089:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708540.114095:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789708540.114104:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708540.114129:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789708540.114142:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:3616:x1876645365460480:12345-0@lo:103: 00000100:00100000:2.0:1789708540.114148:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:3615:x1876645365460224:12345-0@lo:103: Request processed in 192us (832us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708540.114154:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789708540.114160:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789708540.114163:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47cc67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cc60 expref: 20 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.114166:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:3616:x1876645365459328:12345-0@lo:103: Request processed in 191us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708540.114183:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1789708540.114187:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47cc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cc60 expref: 19 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.114204:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47cc67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cc60 expref: 18 pid: 6477 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114214:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708540.114219:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708540.114222:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114233:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd600 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708540.114238:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114249:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708540.114289:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708540.114297:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789708540.114320:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:3616:x1876645365460480:12345-0@lo:103: Request processed in 181us (750us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708540.114327:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.114345:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789708540.114348:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708540.114366:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114375:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd600/0xf45f43947e47cbd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cbdb expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114387:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708540.114391:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114398:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ad400 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708540.114401:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114409:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708540.114415:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708540.114421:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708540.114436:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114443:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708540.114450:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114458:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee188ad400/0xf45f43947e47cbaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cbb1 expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114487:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708540.114490:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708540.114494:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708540.114510:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365460608:0@lo:103: 00000100:00100000:1.0:1789708540.114513:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365459584:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708540.114584:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708540.114584:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09adbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365459840:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708540.114618:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357031296 00000100:00100000:1.0:1789708540.114618:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09adaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365460096:0@lo:104: 00000100:00100000:2.0:1789708540.114626:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357031296 00000100:00100000:1.0:1789708540.114642:0:10298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10298:1876645365460352:0@lo:104: 00010000:00010000:2.0:1789708540.114652:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cc21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de08 expref: 10 pid: 6477 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708540.114698:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:3.0:1789708540.114699:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708540.114717:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:098f9bc4-0284-4f29-9497-0447ce008685+10:2396:x1876645357031296:12345-192.168.201.52@tcp:103: 00010000:00010000:1.0:1789708540.114723:0:10298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114728:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708540.114737:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cc21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de08 expref: 10 pid: 6477 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114752:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de08 expref: 10 pid: 6477 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.114786:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cc21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de08 expref: 10 pid: 6477 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.114799:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365459200:0@lo:103: 00010000:00010000:2.0:1789708540.114803:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708540.114839:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365459328:0@lo:103: 00000100:00100000:0.0:1789708540.114840:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365460224:0@lo:103: 00000100:00100000:2.0:1789708540.114858:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:098f9bc4-0284-4f29-9497-0447ce008685+9:2396:x1876645357031296:12345-192.168.201.52@tcp:103: Request processed in 141us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708540.114870:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:3.0:1789708540.114879:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365460480:0@lo:103: 00000100:00100000:2.0:1789708540.114896:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357031424 00000100:00100000:2.0:1789708540.114903:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357031424 00000100:00100000:0.0:1789708540.114909:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365460736:0@lo:103: 00010000:00010000:2.0:1789708540.114937:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47cc1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de01 expref: 9 pid: 6477 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.114952:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708540.114972:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365460736 00000100:00100000:2.0:1789708540.114977:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365460736 00010000:00010000:2.0:1789708540.114998:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01508e00/0xf45f43947e47cbb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cbaa expref: 17 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.115013:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365459712:0@lo:103: 00000100:00100000:2.0:1789708540.115032:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:0.0:1789708540.115034:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365458944:0@lo:103: 00000100:00100000:3.0:1789708540.115048:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789708540.115055:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:098f9bc4-0284-4f29-9497-0447ce008685+9:2395:x1876645357031424:12345-192.168.201.52@tcp:103: 00000100:00100000:0.0:1789708540.115055:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365459968:0@lo:103: 00000100:00100000:3.0:1789708540.115071:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08beb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:3618:x1876645365460736:12345-0@lo:103: 00010000:00010000:2.0:1789708540.115074:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708540.115084:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47cc1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de01 expref: 9 pid: 6477 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708540.115088:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708540.115101:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01508e00/0xf45f43947e47cbb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cbaa expref: 17 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708540.115101:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708540.115108:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47cc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de01 expref: 9 pid: 6477 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.115140:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708540.115148:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47cc1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de01 expref: 9 pid: 6477 timeout: 210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708540.115180:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01508e00/0xf45f43947e47cbb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cbaa expref: 17 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.115181:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365460608 00000100:00100000:1.0:1789708540.115189:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365460608 00010000:00010000:2.0:1789708540.115196:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708540.115206:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01508e00/0xf45f43947e47cbb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cbaa expref: 18 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.115214:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebe200/0xf45f43947e47cbdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cbd4 expref: 18 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708540.115227:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708540.115240:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:098f9bc4-0284-4f29-9497-0447ce008685+8:2395:x1876645357031424:12345-192.168.201.52@tcp:103: Request processed in 194us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708540.115245:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789708540.115289:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:1.0:1789708540.115290:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08577450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:3617:x1876645365460608:12345-0@lo:103: 00010000:00010000:1.0:1789708540.115304:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708540.115311:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebe200/0xf45f43947e47cbdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cbd4 expref: 17 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.115322:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08beb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:3618:x1876645365460736:12345-0@lo:103: Request processed in 258us (370us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708540.115329:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebe200/0xf45f43947e47cbdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cbd4 expref: 17 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708540.115341:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789708540.115355:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebe200/0xf45f43947e47cbdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cbd4 expref: 17 pid: 6479 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.115374:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.115397:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708540.115403:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365460736:0@lo:103: 00010000:00010000:1.0:1789708540.115415:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.115426:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.115435:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.115442:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.115449:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ac000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708540.115453:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.115461:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.115484:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708540.115496:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708540.115514:0:10298:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708540.115525:0:10298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.115543:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08577450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:3617:x1876645365460608:12345-0@lo:103: Request processed in 284us (406us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708540.115548:0:10298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708540.115557:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789708540.115574:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365460608:0@lo:103: 00010000:00010000:0.0:1789708540.518406:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708540.774443:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708540.774468:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365460864:0@lo:41: 00000100:00100000:3.0:1789708540.774541:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708540.774630:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365460864 00000100:00100000:1.0:1789708540.774652:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365460864 00000100:00100000:1.0:1789708540.774722:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789708540.774734:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365460864:12345-0@lo:41: 00000004:00000024:1.0:1789708540.774804:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789708540.774850:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365460864:12345-0@lo:41: Request processed in 118us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708540.774855:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789708540.774889:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365460864:0@lo:41: 10000000:01000000:3.0:1789708541.414389:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789708541.414398:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bed08a9c000 from 48 10000000:01000000:3.0:1789708541.414404:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789708541.414458:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.414471:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.414484:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708541.414510:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365460992:0@lo:101: 00000100:00100000:3.0:1789708541.414580:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.414672:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.414679:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365460992 00000100:00100000:2.0:1789708541.414690:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365460992 00000100:00100000:2.0:1789708541.414777:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789708541.414789:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+15:6481:x1876645365460992:12345-0@lo:101: 00010000:00010000:2.0:1789708541.414804:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708541.414819:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee00031200/0xf45f43947e47cd24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cd1d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.414845:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee00031200/0xf45f43947e47cd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cd1d expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.414858:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee00031200/0xf45f43947e47cd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd1d expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.414868:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee00031200, rc 0) 00000100:00100000:2.0:1789708541.414918:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365460992:12345-0@lo:101: Request processed in 132us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.414927:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789708541.414962:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365460992:0@lo:101: 00010000:00010000:3.0:1789708541.414980:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.414991:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708541.415067:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365461120:0@lo:501: 00000100:00100000:3.0:1789708541.415096:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.415118:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.415140:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365461120 00000100:00100000:1.0:1789708541.415146:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365461120 00000100:00100000:1.0:1789708541.415174:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789708541.415180:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365461120:12345-0@lo:501: 00000100:00100000:1.0:1789708541.415307:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365461120:12345-0@lo:501: Request processed in 127us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.415312:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789708541.415351:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365461120:0@lo:501: 00000100:00100000:3.0:1789708541.415393:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365461248:0@lo:503: 00000100:00100000:3.0:1789708541.415439:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.415467:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.415499:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365461248 00000100:00100000:2.0:1789708541.415506:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365461248 00000100:00100000:2.0:1789708541.415537:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789708541.415546:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365461248:12345-0@lo:503: 00000100:00100000:2.0:1789708541.415657:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365461248:12345-0@lo:503: Request processed in 112us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.415675:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789708541.415697:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365461248:0@lo:503: 00000100:00100000:3.0:1789708541.416016:0:10315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10315:1876645365461376:0@lo:502: 00000100:00100000:3.0:1789708541.416057:0:10315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.416075:0:10315:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.416104:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365461376 00000100:00100000:1.0:1789708541.416110:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365461376 00000100:00100000:1.0:1789708541.416133:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789708541.416140:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:10315:x1876645365461376:12345-0@lo:502: 00000100:00100000:1.0:1789708541.416221:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:10315:x1876645365461376:12345-0@lo:502: Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.416228:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789708541.416243:0:10315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10315:1876645365461376:0@lo:502: 00000100:00100000:3.0:1789708541.416304:0:10315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10315:1876645365461504:0@lo:502: 00000100:00100000:3.0:1789708541.416341:0:10315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.416366:0:10315:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.416406:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365461504 00000100:00100000:2.0:1789708541.416413:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365461504 00000100:00100000:2.0:1789708541.416444:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789708541.416454:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:10315:x1876645365461504:12345-0@lo:502: 00000100:00100000:2.0:1789708541.416549:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:10315:x1876645365461504:12345-0@lo:502: Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.416558:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789708541.416564:0:10315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10315:1876645365461504:0@lo:502: 00000040:00080000:3.0:1789708541.416594:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789708541.416688:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789708541.416716:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708541.416726:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.416750:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708541.416759:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789708541.416761:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789708541.416763:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789708541.416779:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.416784:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.416795:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.416805:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365461632:0@lo:101: 00000100:00100000:0.0:1789708541.416829:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.416846:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee03339780 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.416868:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365461632 00000100:00100000:1.0:1789708541.416873:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365461632 00000100:00100000:1.0:1789708541.416911:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789708541.416920:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+16:6481:x1876645365461632:12345-0@lo:101: 00010000:00010000:1.0:1789708541.416929:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708541.416939:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188ad200/0xf45f43947e47cd32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cd2b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708541.416959:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ad200/0xf45f43947e47cd32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cd2b expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708541.416966:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188ad200/0xf45f43947e47cd32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd2b expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708541.416972:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ad200, rc 0) 00000100:00100000:1.0:1789708541.417001:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365461632:12345-0@lo:101: Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.417005:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789708541.417032:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365461632:0@lo:101: 00010000:00010000:0.0:1789708541.417048:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.417058:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.417107:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365461760:0@lo:501: 00000100:00100000:0.0:1789708541.417129:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.417143:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee03339780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.417185:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365461760 00000100:00100000:2.0:1789708541.417191:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365461760 00000100:00100000:2.0:1789708541.417223:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789708541.417231:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365461760:12345-0@lo:501: 00000100:00100000:2.0:1789708541.417384:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365461760:12345-0@lo:501: Request processed in 152us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.417393:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789708541.417434:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365461760:0@lo:501: 00000100:00100000:0.0:1789708541.417475:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365461888:0@lo:503: 00000100:00100000:0.0:1789708541.417515:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.417540:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee03339780 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.417564:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365461888 00000100:00100000:1.0:1789708541.417570:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365461888 00000100:00100000:1.0:1789708541.417600:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789708541.417607:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365461888:12345-0@lo:503: 00000100:00100000:1.0:1789708541.417709:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365461888:12345-0@lo:503: Request processed in 102us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.417718:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789708541.417756:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365461888:0@lo:503: 00000100:00100000:3.0:1789708541.418001:0:10316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10316:1876645365462016:0@lo:502: 00000100:00100000:3.0:1789708541.418045:0:10316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.418066:0:10316:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.418100:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365462016 00000100:00100000:2.0:1789708541.418106:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365462016 00000100:00100000:2.0:1789708541.418135:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789708541.418144:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:10316:x1876645365462016:12345-0@lo:502: 00000100:00100000:2.0:1789708541.418240:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:10316:x1876645365462016:12345-0@lo:502: Request processed in 96us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.418249:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789708541.418257:0:10316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10316:1876645365462016:0@lo:502: 00000020:01000000:3.0:1789708541.418324:0:10316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708541.418333:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708541.418336:0:10316:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789708541.418343:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789708541.418365:0:10316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10316:1876645365462144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708541.418406:0:10316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.418434:0:10316:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.418458:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365462144 00000100:00100000:1.0:1789708541.418463:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365462144 00000100:00100000:1.0:1789708541.418492:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789708541.418500:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:10316:x1876645365462144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708541.418585:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:10316:x1876645365462144:12345-0@lo:502:llog_process_th.0 Request processed in 84us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.418594:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789708541.418600:0:10316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10316:1876645365462144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708541.418631:0:10316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708541.418637:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708541.418639:0:10316:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789708541.418643:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1789708541.418711:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789708541.418754:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789708541.418761:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.418783:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708541.418792:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789708541.418794:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee2f569800 from 48 10000000:01000000:0.0:1789708541.418797:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789708541.418813:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.418821:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.418830:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.418843:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365462272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.418869:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.418888:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.418927:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365462272 00000100:00100000:2.0:1789708541.418935:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365462272 00000100:00100000:2.0:1789708541.418966:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789708541.418975:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+17:6481:x1876645365462272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708541.418991:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708541.418999:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee00031600/0xf45f43947e47cd40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cd39 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.419013:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee00031600/0xf45f43947e47cd40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cd39 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.419019:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee00031600/0xf45f43947e47cd40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd39 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.419025:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee00031600, rc 0) 00000100:00100000:2.0:1789708541.419062:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365462272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.419068:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789708541.419090:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365462272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708541.419102:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.419112:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.419150:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365462400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.419175:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.419200:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.419221:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365462400 00000100:00100000:1.0:1789708541.419225:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365462400 00000100:00100000:1.0:1789708541.419254:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789708541.419275:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365462400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708541.419338:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365462400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.419345:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789708541.419361:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365462400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.419395:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365462528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.419429:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.419456:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.419478:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365462528 00000100:00100000:2.0:1789708541.419483:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365462528 00000100:00100000:2.0:1789708541.419507:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789708541.419513:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365462528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708541.419580:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365462528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.419586:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789708541.419611:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365462528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708541.419882:0:10317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10317:1876645365462656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.419921:0:10317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708541.419941:0:10317:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee08376f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.419959:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365462656 00000100:00100000:1.0:1789708541.419964:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365462656 00000100:00100000:1.0:1789708541.419985:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789708541.419990:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:10317:x1876645365462656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708541.420069:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:10317:x1876645365462656:12345-0@lo:502:llog_process_th.0 Request processed in 78us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.420075:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789708541.420129:0:10317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10317:1876645365462656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.420186:0:10317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10317:1876645365462784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.420237:0:10317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708541.420295:0:10317:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee08376f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.420304:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365462784 00000100:00100000:3.0:1789708541.420311:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365462784 00000100:00100000:3.0:1789708541.420344:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789708541.420353:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:10317:x1876645365462784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708541.420439:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:10317:x1876645365462784:12345-0@lo:502:llog_process_th.0 Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.420448:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789708541.420474:0:10317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10317:1876645365462784:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789708541.420501:0:10317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789708541.420597:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789708541.420619:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708541.420624:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.420631:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708541.420637:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789708541.420638:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789708541.420640:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789708541.420653:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.420658:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.420664:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.420673:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365462912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.420695:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.420715:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.420745:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365462912 00000100:00100000:1.0:1789708541.420750:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365462912 00000100:00100000:1.0:1789708541.420771:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789708541.420776:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+18:6481:x1876645365462912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708541.420781:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708541.420789:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cd47 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708541.420801:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cd47 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708541.420808:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd47 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708541.420813:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ac000, rc 0) 00000100:00100000:1.0:1789708541.420839:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365462912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.420849:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789708541.420871:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365462912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708541.420881:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.420887:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.420919:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365463040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.420944:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.420964:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.420982:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365463040 00000100:00100000:3.0:1789708541.420989:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365463040 00000100:00100000:3.0:1789708541.421019:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789708541.421026:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365463040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708541.421126:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365463040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.421134:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789708541.421195:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365463040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.421223:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365463168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.421250:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.421280:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.421328:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365463168 00000100:00100000:1.0:1789708541.421334:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365463168 00000100:00100000:1.0:1789708541.421374:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789708541.421383:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365463168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708541.421469:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365463168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.421477:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789708541.421495:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365463168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708541.421723:0:10318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10318:1876645365463296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.421765:0:10318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708541.421785:0:10318:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee08376600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.421805:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365463296 00000100:00100000:3.0:1789708541.421810:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365463296 00000100:00100000:3.0:1789708541.421838:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789708541.421847:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:10318:x1876645365463296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708541.421926:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:10318:x1876645365463296:12345-0@lo:502:llog_process_th.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.421935:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789708541.421950:0:10318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10318:1876645365463296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708541.421978:0:10318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708541.421986:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708541.421988:0:10318:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789708541.421994:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789708541.422016:0:10318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10318:1876645365463424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.422051:0:10318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708541.422071:0:10318:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee08376600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.422100:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365463424 00000100:00100000:1.0:1789708541.422105:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365463424 00000100:00100000:1.0:1789708541.422131:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789708541.422138:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:10318:x1876645365463424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708541.422216:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:10318:x1876645365463424:12345-0@lo:502:llog_process_th.0 Request processed in 77us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.422224:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789708541.422226:0:10318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10318:1876645365463424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708541.422244:0:10318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708541.422248:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708541.422250:0:10318:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789708541.422254:0:10318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1789708541.422342:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789708541.422368:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789708541.422375:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.422385:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708541.422394:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789708541.422396:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee36337800 from 48 10000000:01000000:0.0:1789708541.422399:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789708541.422422:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.422431:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.422440:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.422454:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365463552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.422487:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.422513:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.422518:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365463552 00000100:00100000:3.0:1789708541.422522:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365463552 00000100:00100000:3.0:1789708541.422549:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789708541.422554:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:6481:x1876645365463552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708541.422559:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708541.422567:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509800/0xf45f43947e47cd5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cd55 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.422580:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509800/0xf45f43947e47cd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cd55 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.422587:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509800/0xf45f43947e47cd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd55 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.422592:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509800, rc 0) 00000100:00100000:3.0:1789708541.422618:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365463552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.422629:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789708541.422649:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365463552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708541.422662:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.422671:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.422711:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365463680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.422754:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.422775:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708541.422802:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365463680 00000100:00100000:1.0:1789708541.422807:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365463680 00000100:00100000:1.0:1789708541.422833:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789708541.422842:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365463680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708541.422916:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365463680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.422922:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789708541.422962:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365463680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.422993:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365463808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.423032:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.423058:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.423070:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365463808 00000100:00100000:3.0:1789708541.423076:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365463808 00000100:00100000:3.0:1789708541.423114:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789708541.423124:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365463808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708541.423215:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365463808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.423224:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789708541.423236:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365463808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708541.423512:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10319:1876645365463936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708541.423548:0:10319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708541.423567:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.423590:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365463936 00000100:00100000:2.0:1789708541.423597:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365463936 00000100:00100000:2.0:1789708541.423632:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789708541.423641:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:10319:x1876645365463936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.423758:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:10319:x1876645365463936:12345-0@lo:502:llog_process_th.0 Request processed in 118us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.423774:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10319:1876645365463936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.423780:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789708541.423811:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10319:1876645365464064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708541.423841:0:10319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708541.423858:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.423874:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365464064 00000100:00100000:3.0:1789708541.423879:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365464064 00000100:00100000:3.0:1789708541.423906:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789708541.423912:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:10319:x1876645365464064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708541.423984:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:10319:x1876645365464064:12345-0@lo:502:llog_process_th.0 Request processed in 71us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.423992:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789708541.424017:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10319:1876645365464064:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789708541.424038:0:10319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789708541.424118:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789708541.424146:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708541.424154:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.424164:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708541.424172:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789708541.424174:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789708541.424177:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789708541.424194:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.424202:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.424211:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.424226:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365464192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.424255:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.424318:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.424322:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365464192 00000100:00100000:2.0:1789708541.424329:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365464192 00000100:00100000:2.0:1789708541.424363:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789708541.424382:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365464192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708541.424390:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708541.424400:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee00031800/0xf45f43947e47cd6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cd63 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.424418:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee00031800/0xf45f43947e47cd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cd63 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.424429:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee00031800/0xf45f43947e47cd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd63 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.424437:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee00031800, rc 0) 00000100:00100000:2.0:1789708541.424476:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365464192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.424484:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789708541.424516:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365464192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708541.424528:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.424537:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.424590:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365464320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.424620:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.424642:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.424650:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365464320 00000100:00100000:3.0:1789708541.424655:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365464320 00000100:00100000:3.0:1789708541.424679:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789708541.424683:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365464320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708541.424757:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365464320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.424763:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789708541.424787:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365464320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.424822:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365464448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.424859:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.424879:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.424900:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365464448 00000100:00100000:2.0:1789708541.424906:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365464448 00000100:00100000:2.0:1789708541.424941:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789708541.424949:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365464448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708541.425039:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365464448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.425061:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789708541.425061:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365464448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.425300:0:10320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10320:1876645365464576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708541.425342:0:10320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.425369:0:10320:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.425374:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365464576 00000100:00100000:3.0:1789708541.425380:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365464576 00000100:00100000:3.0:1789708541.425409:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789708541.425416:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10320:x1876645365464576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708541.425490:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10320:x1876645365464576:12345-0@lo:502:llog_process_th.0 Request processed in 75us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.425496:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789708541.425518:0:10320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10320:1876645365464576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789708541.425543:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708541.425551:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708541.425553:0:10320:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789708541.425559:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789708541.425580:0:10320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10320:1876645365464704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708541.425617:0:10320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.425639:0:10320:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.425654:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365464704 00000100:00100000:2.0:1789708541.425666:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365464704 00000100:00100000:2.0:1789708541.425697:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789708541.425706:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10320:x1876645365464704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.425803:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10320:x1876645365464704:12345-0@lo:502:llog_process_th.0 Request processed in 97us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.425811:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789708541.425829:0:10320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10320:1876645365464704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789708541.425853:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708541.425858:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708541.425859:0:10320:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789708541.425867:0:10320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1789708541.425948:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1789708541.425976:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789708541.425984:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.425995:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708541.426005:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789708541.426007:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee02bf3800 from 48 10000000:01000000:3.0:1789708541.426010:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789708541.426028:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.426036:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.426044:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708541.426054:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365464832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708541.426077:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.426094:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.426113:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365464832 00000100:00100000:2.0:1789708541.426117:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365464832 00000100:00100000:2.0:1789708541.426138:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789708541.426144:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365464832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708541.426149:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708541.426157:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee00031c00/0xf45f43947e47cd78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cd71 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.426168:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee00031c00/0xf45f43947e47cd78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cd71 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.426175:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee00031c00/0xf45f43947e47cd78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd71 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.426180:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee00031c00, rc 0) 00000100:00100000:2.0:1789708541.426208:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365464832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.426213:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789708541.426218:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365464832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708541.426229:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.426242:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708541.426323:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365464960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708541.426342:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.426369:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.426370:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365464960 00000100:00100000:2.0:1789708541.426375:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365464960 00000100:00100000:2.0:1789708541.426397:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789708541.426402:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365464960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708541.426490:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365464960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.426497:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789708541.426503:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365464960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708541.426544:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365465088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708541.426581:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.426599:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.426606:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365465088 00000100:00100000:2.0:1789708541.426612:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365465088 00000100:00100000:2.0:1789708541.426641:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789708541.426650:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365465088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708541.426753:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365465088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.426761:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789708541.426763:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365465088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708541.426997:0:10321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10321:1876645365465216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708541.427025:0:10321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.427039:0:10321:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.427064:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365465216 00000100:00100000:2.0:1789708541.427069:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365465216 00000100:00100000:2.0:1789708541.427098:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789708541.427106:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:10321:x1876645365465216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.427196:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:10321:x1876645365465216:12345-0@lo:502:llog_process_th.0 Request processed in 89us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.427199:0:10321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10321:1876645365465216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.427211:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789708541.427239:0:10321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10321:1876645365465344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708541.427293:0:10321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708541.427321:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365465344 00000100:00100000:2.0:1789708541.427327:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365465344 00000100:00100000:3.0:1789708541.427330:0:10321:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e893900 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.427358:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789708541.427363:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:10321:x1876645365465344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.427437:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:10321:x1876645365465344:12345-0@lo:502:llog_process_th.0 Request processed in 71us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.427446:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789708541.427454:0:10321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10321:1876645365465344:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789708541.427481:0:10321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789708541.427549:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789708541.427577:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708541.427584:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.427595:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708541.427603:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789708541.427605:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789708541.427608:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789708541.427625:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.427634:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.427643:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.427658:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365465472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.427691:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.427713:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.427741:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365465472 00000100:00100000:2.0:1789708541.427746:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365465472 00000100:00100000:2.0:1789708541.427780:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789708541.427788:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365465472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708541.427796:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708541.427805:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee00031400/0xf45f43947e47cd86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cd7f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.427819:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee00031400/0xf45f43947e47cd86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cd7f expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.427826:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee00031400/0xf45f43947e47cd86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd7f expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.427831:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee00031400, rc 0) 00000100:00100000:2.0:1789708541.427856:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365465472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.427861:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789708541.427882:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365465472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708541.427896:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.427905:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.427971:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365465600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.427999:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.428017:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.428039:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365465600 00000100:00100000:2.0:1789708541.428044:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365465600 00000100:00100000:2.0:1789708541.428072:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789708541.428079:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365465600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708541.428154:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365465600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.428162:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789708541.428167:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365465600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.428206:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365465728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.428243:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.428298:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708541.428471:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365465728 00000100:00100000:2.0:1789708541.428476:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365465728 00000100:00100000:2.0:1789708541.428504:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789708541.428513:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365465728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708541.428633:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365465728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.428649:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789708541.428666:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365465728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708541.428913:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10322:1876645365465856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.428951:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708541.428973:0:10322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.428996:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365465856 00000100:00100000:3.0:1789708541.429001:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365465856 00000100:00100000:3.0:1789708541.429034:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789708541.429050:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10322:x1876645365465856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708541.429150:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10322:x1876645365465856:12345-0@lo:502:llog_process_th.0 Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.429160:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789708541.429169:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10322:1876645365465856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708541.429203:0:10322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708541.429211:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708541.429213:0:10322:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789708541.429220:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789708541.429242:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10322:1876645365465984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708541.429307:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708541.429342:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365465984 00000100:00100000:2.0:1789708541.429346:0:10322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.429348:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365465984 00000100:00100000:3.0:1789708541.429382:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789708541.429390:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10322:x1876645365465984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708541.429471:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10322:x1876645365465984:12345-0@lo:502:llog_process_th.0 Request processed in 81us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708541.429481:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789708541.429489:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10322:1876645365465984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708541.429516:0:10322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708541.429521:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708541.429523:0:10322:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789708541.429527:0:10322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789708541.429582:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789708541.429620:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789708541.429629:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.429640:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708541.429650:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789708541.429652:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bee18160000 from 1 10000000:01000000:0.0:1789708541.429655:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789708541.429674:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cd8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.429682:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cd8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.429691:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cd8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.429712:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365466112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.429759:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.429778:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.429806:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365466112 00000100:00100000:3.0:1789708541.429812:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365466112 00000100:00100000:3.0:1789708541.429840:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789708541.429848:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365466112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708541.429857:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708541.429867:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509400/0xf45f43947e47cd94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cd8d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.429885:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509400/0xf45f43947e47cd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cd8d expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.429895:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509400/0xf45f43947e47cd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cd8d expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708541.429903:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509400, rc 0) 00000100:00100000:3.0:1789708541.429940:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365466112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708541.429954:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365466112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708541.429957:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00010000:0.0:1789708541.429971:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cd8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.429983:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cd8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708541.430024:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365466240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708541.430052:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708541.430072:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708541.430090:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365466240 00000100:00100000:3.0:1789708541.430096:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365466240 00000100:00100000:3.0:1789708541.430122:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789708541.430131:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365466240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708541.430191:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365466240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (137us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708541.430200:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789708541.430203:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365466240:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789708541.430231:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789708541.430237:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cd8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708541.430245:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708541.542442:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708541.663298:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708541.663331:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708541.663344:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357031552 00000100:00100000:3.0:1789708541.663357:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708541.663359:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357031552 00000100:00100000:0.0:1789708541.663390:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357031680 00000100:00100000:3.0:1789708541.663395:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708541.663397:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357031680 00000100:00100000:1.0:1789708541.663429:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357031936 00000100:00100000:2.0:1789708541.663436:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 229 00000100:00100000:1.0:1789708541.663436:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357031936 00000100:00100000:3.0:1789708541.663442:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708541.663449:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357031808 00000100:00100000:2.0:1789708541.663456:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+8:2396:x1876645357031552:12345-192.168.201.52@tcp:400: 00000100:00100000:0.0:1789708541.663456:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357031808 00000100:00080000:3.0:1789708541.663487:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789708541.663488:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357032064 00000100:00100000:1.0:1789708541.663493:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357032064 00000100:00080000:3.0:1789708541.663494:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789708541.663498:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708541.663498:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:3.0:1789708541.663521:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:2.0:1789708541.663527:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+8:2396:x1876645357031552:12345-192.168.201.52@tcp:400: Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708541.663530:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357031680:12345-192.168.201.52@tcp:400: 00000100:00100000:1.0:1789708541.663537:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1789708541.663538:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2396:x1876645357031808:12345-192.168.201.52@tcp:400: 00000100:00100000:2.0:1789708541.663543:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 229 00000100:00100000:1.0:1789708541.663552:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357031936:12345-192.168.201.52@tcp:400: 00000100:00100000:0.0:1789708541.663592:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357031680:12345-192.168.201.52@tcp:400: Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00080000:2.0:1789708541.663595:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708541.663603:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2396:x1876645357031808:12345-192.168.201.52@tcp:400: Request processed in 68us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708541.663603:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357031936:12345-192.168.201.52@tcp:400: Request processed in 49us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708541.663610:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:3.0:1789708541.663620:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:1.0:1789708541.663620:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:2.0:1789708541.663638:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789708541.663651:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2396:x1876645357032064:12345-192.168.201.52@tcp:400: 00000100:00100000:2.0:1789708541.663694:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2396:x1876645357032064:12345-192.168.201.52@tcp:400: Request processed in 47us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708541.663700:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000001:00100000:0.0:1789708542.311162:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00010000:00010000:0.0:1789708542.566433:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708543.590443:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708543.846565:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365466368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789708543.846659:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708543.846754:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365466368 00000100:00100000:0.0:1789708543.846771:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365466368 00000100:00100000:0.0:1789708543.846842:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789708543.846858:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365466368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789708543.846900:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789708543.846993:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365466368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708543.847003:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789708543.847056:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365466368:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789708544.614435:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708544.870423:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365466752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708544.870434:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365466496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708544.870507:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708544.870543:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365466880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708544.870571:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365466496 00000100:00100000:1.0:1789708544.870580:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365466496 00000100:00100000:0.0:1789708544.870580:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708544.870592:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365466624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708544.870604:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708544.870626:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708544.870638:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365466880 00000100:00100000:1.0:1789708544.870642:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365466880 00000100:00100000:1.0:1789708544.870695:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365466624 00000100:00100000:1.0:1789708544.870699:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365466624 00000100:00100000:2.0:1789708544.870704:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789708544.870720:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365466496:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789708544.870754:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789708544.870757:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789708544.870760:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708544.870814:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365466496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708544.870824:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789708544.870834:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08be8700 x1876645365466496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708544.870853:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708544.870855:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365466496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708544.870869:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876645365466880:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708544.870877:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365467008:0@lo:400:kworker.0 00002000:00000024:2.0:1789708544.870897:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789708544.870901:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365467136:0@lo:400:kworker.0 00000100:00100000:0.0:1789708544.870912:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708544.870961:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876645365466880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708544.870961:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708544.870963:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365467520:0@lo:400:kworker.0 00000100:00100000:2.0:1789708544.870977:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708544.871007:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365467648:0@lo:400:kworker.0 00000100:00100000:2.0:1789708544.871008:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708544.871017:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708544.871026:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365466624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789708544.871041:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789708544.871049:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708544.871055:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365468032:0@lo:400:kworker.0 00000100:00100000:1.0:1789708544.871092:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365468160:0@lo:400:kworker.0 00000100:00100000:0.0:1789708544.871105:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708544.871106:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365466624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708544.871119:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708544.871129:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789708544.871143:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09946a00 x1876645365466624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708544.871156:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708544.871160:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365466624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708544.871199:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365467520 00000100:00100000:0.0:1789708544.871200:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365468160 00000100:00100000:2.0:1789708544.871203:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365467264:0@lo:400:kworker.0 00000100:00100000:1.0:1789708544.871207:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365467520 00000100:00100000:0.0:1789708544.871207:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365468160 00000100:00100000:2.0:1789708544.871249:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708544.871255:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789708544.871284:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708544.871294:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365467520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708544.871296:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365468160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708544.871307:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365467776:0@lo:400:kworker.0 00000100:00100000:0.0:1789708544.871353:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365468160:12345-0@lo:400:kworker.0 Request processed in 62us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708544.871360:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708544.871365:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708544.871366:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365467520:12345-0@lo:400:kworker.0 Request processed in 72us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708544.871391:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789708544.871393:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365467136 00000100:00100000:0.0:1789708544.871397:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365467136 00000100:00100000:2.0:1789708544.871399:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789708544.871413:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365467392:0@lo:400:kworker.0 00000100:00100000:1.0:1789708544.871417:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365467264 00000100:00100000:1.0:1789708544.871423:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365467264 00000100:00100000:0.0:1789708544.871436:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365467648 00000100:00100000:0.0:1789708544.871443:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365467648 00000100:00100000:1.0:1789708544.871453:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789708544.871460:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708544.871467:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365467264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708544.871477:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365468032 00000100:00100000:0.0:1789708544.871481:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365468032 00000100:00100000:2.0:1789708544.871483:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365467904:0@lo:400:kworker.0 00000100:00100000:0.0:1789708544.871508:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365467776 00000100:00100000:0.0:1789708544.871512:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365467776 00000100:00100000:1.0:1789708544.871517:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365467264:12345-0@lo:400:kworker.0 Request processed in 53us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708544.871531:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365467392 00000100:00100000:1.0:1789708544.871532:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708544.871536:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365467392 00000100:00100000:2.0:1789708544.871537:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708544.871558:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365467904 00000100:00100000:0.0:1789708544.871561:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365467904 00000100:00100000:1.0:1789708544.871570:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708544.871577:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365467264:0@lo:400:kworker.0 00000100:00100000:1.0:1789708544.871585:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365467136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708544.871585:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789708544.871600:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365467648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708544.871614:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365466752 00000100:00100000:2.0:1789708544.871621:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365466752 00000100:00100000:1.0:1789708544.871636:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365467136:12345-0@lo:400:kworker.0 Request processed in 56us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708544.871645:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708544.871649:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365467648:12345-0@lo:400:kworker.0 Request processed in 52us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708544.871661:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708544.871681:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789708544.871689:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789708544.871694:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365466752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708544.871705:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365468032:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789708544.871710:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708544.871711:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789708544.871728:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365467776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708544.871729:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365467008 00000100:00100000:3.0:1789708544.871743:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365467008 00000100:00100000:1.0:1789708544.871763:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365468032:12345-0@lo:400:kworker.0 Request processed in 64us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708544.871772:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365466752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708544.871776:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789708544.871780:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365467776:12345-0@lo:400:kworker.0 Request processed in 56us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708544.871791:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789708544.871792:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708544.871798:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789708544.871810:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365467008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708544.871814:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789708544.871827:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789708544.871831:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365467392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708544.871842:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365467904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708544.871867:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365467008:12345-0@lo:400:kworker.0 Request processed in 63us (953us total) trans 0 rc 0/0 00010000:00080000:2.0:1789708544.871891:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09944a80 x1876645365467776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708544.871897:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365467904:12345-0@lo:400:kworker.0 Request processed in 58us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708544.871902:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365467392:12345-0@lo:400:kworker.0 Request processed in 74us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708544.871918:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789708544.871929:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789708544.871930:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365467776:0@lo:400:kworker.0 00000100:00080000:0.0:1789708544.871946:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789708544.871951:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789708544.871954:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789708544.871971:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09adaa00 x1876645365466752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708544.871986:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365467648:0@lo:400:kworker.0 00000100:00100000:2.0:1789708544.871994:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365466752:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789708544.872006:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3e92b100 x1876645365468160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708544.872016:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365468160:0@lo:400:kworker.0 00000100:00100000:2.0:1789708544.872040:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365467392:0@lo:400:kworker.0 00000100:00100000:0.0:1789708544.872041:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365467136:0@lo:400:kworker.0 00010000:00080000:1.0:1789708544.872071:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3e928380 x1876645365468032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708544.872074:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365467904:0@lo:400:kworker.0 00000100:00100000:1.0:1789708544.872093:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365468032:0@lo:400:kworker.0 00010000:00080000:0.0:1789708544.872101:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09adbb80 x1876645365466880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708544.872114:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365467520:0@lo:400:kworker.0 00000100:00100000:0.0:1789708544.872116:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365466880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708544.872132:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789708544.872144:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365467008:0@lo:400:kworker.0 00000001:00080000:2.0:1789708545.384556:0:9480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1789708545.384571:0:9480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1789708545.638496:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708545.759153:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708545.759226:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357032192 00000100:00100000:2.0:1789708545.759238:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357032192 00000100:00100000:2.0:1789708545.759330:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 231 00000100:00100000:2.0:1789708545.759340:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+8:6155:x1876645357032192:12345-192.168.201.52@tcp:101: 00010000:00010000:2.0:1789708545.759356:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708545.759371:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee00030e00/0xf45f43947e47cd9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715de78 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708545.759396:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee00030e00/0xf45f43947e47cd9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de78 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708545.759408:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee00030e00/0xf45f43947e47cd9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de78 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708545.759418:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee00030e00, rc 0) 00000100:00100000:2.0:1789708545.759489:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+9:6155:x1876645357032192:12345-192.168.201.52@tcp:101: Request processed in 149us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708545.759497:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 231 00000100:00100000:0.0:1789708545.760490:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708545.760546:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357032320 00000100:00100000:3.0:1789708545.760553:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357032320 00000100:00100000:3.0:1789708545.760588:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 232 00000100:00100000:3.0:1789708545.760600:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+9:6155:x1876645357032320:12345-192.168.201.52@tcp:501: 00000100:00100000:3.0:1789708545.760733:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+9:6155:x1876645357032320:12345-192.168.201.52@tcp:501: Request processed in 136us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708545.760741:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 232 00000100:00100000:3.0:1789708545.761506:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708545.761554:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357032448 00000100:00100000:2.0:1789708545.761577:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357032448 00000100:00100000:2.0:1789708545.761606:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 233 00000100:00100000:2.0:1789708545.761611:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+9:6155:x1876645357032448:12345-192.168.201.52@tcp:503: 00000100:00100000:2.0:1789708545.761709:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+9:6155:x1876645357032448:12345-192.168.201.52@tcp:503: Request processed in 97us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708545.761715:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 233 00000100:00100000:0.0:1789708545.763101:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708545.763139:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357032576 00000100:00100000:3.0:1789708545.763143:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357032576 00000100:00100000:3.0:1789708545.763216:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 234 00000100:00100000:3.0:1789708545.763224:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+9:6658:x1876645357032576:12345-192.168.201.52@tcp:502: 00000100:00100000:3.0:1789708545.763336:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+9:6658:x1876645357032576:12345-192.168.201.52@tcp:502: Request processed in 113us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708545.763342:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 234 00000100:00100000:0.0:1789708545.764237:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708545.764293:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357032704 00000100:00100000:2.0:1789708545.764300:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357032704 00000100:00100000:2.0:1789708545.764329:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 235 00000100:00100000:2.0:1789708545.764339:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+9:6658:x1876645357032704:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708545.764423:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+9:6658:x1876645357032704:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708545.764433:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 235 00000100:00100000:1.0:1789708545.765463:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708545.765558:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357032832 00000100:00100000:3.0:1789708545.765563:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357032832 00000100:00100000:3.0:1789708545.765589:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 236 00000100:00100000:3.0:1789708545.765594:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+9:6155:x1876645357032832:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708545.765603:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708545.765624:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01508200/0xf45f43947e47cda2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715de7f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708545.765644:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01508200/0xf45f43947e47cda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de7f expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708545.765670:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01508200/0xf45f43947e47cda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de7f expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708545.765678:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508200, rc 0) 00000100:00100000:3.0:1789708545.765705:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6155:x1876645357032832:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 111us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708545.765711:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 236 00000100:00100000:0.0:1789708545.766411:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708545.766458:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357032960 00000100:00100000:2.0:1789708545.766464:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357032960 00000100:00100000:2.0:1789708545.766495:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 237 00000100:00100000:2.0:1789708545.766503:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:6155:x1876645357032960:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708545.766575:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:6155:x1876645357032960:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 69us (160us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708545.766583:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 237 00000100:00100000:1.0:1789708545.894433:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365468288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708545.894521:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708545.894576:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365468288 00000100:00100000:2.0:1789708545.894588:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365468288 00000100:00100000:2.0:1789708545.894642:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789708545.894668:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365468288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789708545.894706:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789708545.894778:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365468288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708545.894795:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789708545.894838:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365468288:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1789708546.596586:0:10360:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1f329180 20000000:00000080:2.0:1789708546.596605:0:10360:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bee20269400 uarg=0000000000000000 20000000:01000000:2.0:1789708546.596668:0:10360:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789708546.596675:0:10360:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789708546.596679:0:10360:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789708546.597101:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789708546.597202:0:10360:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789708546.600626:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789708546.600677:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789708546.600696:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789708546.600717:0:10360:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789708546.600738:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.600757:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01509200/0xf45f43947e47ca8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ca84 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.600767:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47cb1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb17 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.600781:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cb72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cb6b expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.600789:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cbcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cbc6 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.600801:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebee00/0xf45f43947e47cc2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de40 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.600811:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.600853:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebee00/0xf45f43947e47cc2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de40 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.600869:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee40ebee00/0xf45f43947e47cc2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de40 expref: 9 pid: 6479 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708546.600886:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1876645365468416:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708546.600994:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cbcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cbc6 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.601005:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cbcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cbc6 expref: 23 pid: 6477 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708546.601017:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1876645365468544:0@lo:104: 00000100:00100000:1.0:1789708546.601078:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708546.601111:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cb72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cb6b expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.601125:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cb72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cb6b expref: 23 pid: 6479 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708546.601129:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365468544 00000100:00100000:1.0:1789708546.601134:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1876645365468672:0@lo:104: 00000100:00100000:3.0:1789708546.601140:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365468544 00000100:00100000:1.0:1789708546.601156:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708546.601190:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47cb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cb17 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708546.601198:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365468672 00010000:00010000:1.0:1789708546.601200:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47cb1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cb17 expref: 23 pid: 6478 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708546.601205:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365468672 00000100:00100000:1.0:1789708546.601215:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ada680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1876645365468800:0@lo:104: 00000100:00100000:0.0:1789708546.601219:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789708546.601234:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10360:x1876645365468544:12345-0@lo:104: 00000100:00100000:2.0:1789708546.601249:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1789708546.601254:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708546.601256:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708546.601292:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10360:x1876645365468672:12345-0@lo:104: 00010000:00010000:2.0:1789708546.601302:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708546.601313:0:7425:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789708546.601324:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01509200/0xf45f43947e47ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ca84 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708546.601332:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365468800 00010000:00010000:1.0:1789708546.601333:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee01509200/0xf45f43947e47ca8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ca84 expref: 23 pid: 6478 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708546.601340:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365468800 00010000:00010000:0.0:1789708546.601343:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789708546.601345:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09adbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1876645365468928:0@lo:104: 00010000:00010000:2.0:1789708546.601350:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708546.601354:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+5:10360:x1876645365468544:12345-0@lo:104: Request processed in 124us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708546.601356:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+5:10360:x1876645365468672:12345-0@lo:104: Request processed in 99us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708546.601364:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789708546.601376:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789708546.601377:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708546.601388:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365468928 00000100:00100000:3.0:1789708546.601393:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789708546.601395:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365468928 00000100:00100000:1.0:1789708546.601398:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f51b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708546.601412:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10360:x1876645365468800:12345-0@lo:104: 00010000:00010000:2.0:1789708546.601414:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708546.601425:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708546.601426:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708546.601428:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1876645365468544:0@lo:104: 00000100:00100000:0.0:1789708546.601428:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789708546.601443:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10360:x1876645365468928:12345-0@lo:104: 00010000:00010000:2.0:1789708546.601449:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc13d2d20) 00000100:00100000:1.0:1789708546.601451:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1876645365468672:0@lo:104: 10000000:00010000:2.0:1789708546.601455:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.601458:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebcc00/0xf45f43947e47ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708546.601467:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708546.601488:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.601490:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708546.601499:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708546.601500:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789708546.601522:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789708546.601522:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789708546.601523:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188acc00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:1.0:1789708546.601530:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708546.601539:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10360:x1876645365468800:12345-0@lo:104: Request processed in 127us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708546.601540:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:10360:x1876645365468928:12345-0@lo:104: Request processed in 95us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708546.601542:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708546.601545:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708546.601562:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 10000000:00010000:1.0:1789708546.601565:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708546.601567:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789708546.601574:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 10000000:01000000:1.0:1789708546.601579:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789708546.601596:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.601602:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.601620:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708546.601625:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01508000/0xf45f43947e47cbc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cbcd expref: -99 pid: 9478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708546.601647:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708546.601657:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708546.601657:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708546.601665:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebcc00/0xf45f43947e47ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.601668:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee188acc00/0xf45f43947e47cb6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb72 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708546.601676:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365469056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708546.601688:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebcc00 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:1.0:1789708546.601692:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789708546.601693:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebcc00/0xf45f43947e47ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.601695:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708546.601699:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708546.601706:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebcc00/0xf45f43947e47ca84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708546.601714:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365469184:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789708546.601715:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebcc00/0xf45f43947e47ca84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708546.601728:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789708546.601731:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789708546.601766:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebcc00/0xf45f43947e47ca84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708546.601767:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ada680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1876645365468800:0@lo:104: 00010000:00010000:2.0:1789708546.601779:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789708546.601786:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09adbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1876645365468928:0@lo:104: 00010000:00010000:2.0:1789708546.601790:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebcc00/0xf45f43947e47ca84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708546.601799:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebcc00/0xf45f43947e47ca84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ca8b expref: -99 pid: 8390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708546.601813:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708546.601816:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708546.601819:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708546.601824:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365469056 00000100:00100000:1.0:1789708546.601836:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365469056 00000100:00100000:0.0:1789708546.601846:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365469312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708546.601847:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708546.601861:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cbcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cbc6 expref: 24 pid: 6477 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708546.601883:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708546.601896:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365469184 00000100:00100000:1.0:1789708546.601900:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365469184 00000100:00100000:2.0:1789708546.601902:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365469312 00000100:00100000:2.0:1789708546.601908:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365469312 00010000:00010000:1.0:1789708546.601919:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cb72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb6b expref: 26 pid: 6479 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708546.601928:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1789708546.601931:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01509200/0xf45f43947e47ca8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ca84 expref: 26 pid: 6478 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708546.601945:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+26:3616:x1876645365469056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708546.601949:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708546.601955:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1789708546.601958:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708546.601961:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708546.601968:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1789708546.601968:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cbcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cbc6 expref: 26 pid: 6477 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708546.601970:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+26:3617:x1876645365469184:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708546.601983:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+26:3618:x1876645365469312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708546.601987:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:1.0:1789708546.601992:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708546.601993:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cbcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cbc6 expref: 26 pid: 6477 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708546.601994:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:3.0:1789708546.601995:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708546.602007:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01509200/0xf45f43947e47ca8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ca84 expref: 26 pid: 6478 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.602007:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cb72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb6b expref: 26 pid: 6479 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.602022:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cbcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cbc6 expref: 26 pid: 6477 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708546.602024:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708546.602040:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01509200/0xf45f43947e47ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ca84 expref: 26 pid: 6478 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708546.602048:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.602058:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cb72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cb6b expref: 25 pid: 6479 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708546.602059:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789708546.602073:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708546.602081:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509200/0xf45f43947e47ca8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ca84 expref: 25 pid: 6478 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.602088:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cb72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cb6b expref: 25 pid: 6479 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708546.602091:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.602112:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708546.602113:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789708546.602114:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3616:x1876645365469056:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (389us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708546.602121:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708546.602125:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1789708546.602133:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708546.602142:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd400/0xf45f43947e47cb17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cb1e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708546.602163:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708546.602167:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708546.602168:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:3617:x1876645365469184:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (319us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708546.602172:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708546.602175:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365469056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708546.602177:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:3618:x1876645365469312:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (292us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708546.602185:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708546.602185:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1789708546.602192:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708546.602195:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708546.602198:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708546.602207:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365469440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708546.602237:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365469184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708546.602239:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708546.602290:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365469440 00000100:00100000:1.0:1789708546.602290:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365469312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789708546.602297:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365469440 00010000:00010000:3.0:1789708546.602319:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47cb1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb17 expref: 21 pid: 6478 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708546.602352:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789708546.602361:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:3616:x1876645365469440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708546.602370:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708546.602375:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47cb1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cb17 expref: 21 pid: 6478 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708546.602385:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47cb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cb17 expref: 21 pid: 6478 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708546.602397:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47cb1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cb17 expref: 21 pid: 6478 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708546.602408:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708546.602442:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:3616:x1876645365469440:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708546.602451:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789708546.602458:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365469440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708546.603550:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1876645365468416:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708546.603571:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708546.603818:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708546.603857:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357033088 00000100:00100000:0.0:1789708546.603864:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357033088 00010000:00010000:0.0:1789708546.603884:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebee00/0xf45f43947e47cc2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de40 expref: 10 pid: 6479 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708546.603907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:0.0:1789708546.603913:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08576c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:098f9bc4-0284-4f29-9497-0447ce008685+10:2395:x1876645357033088:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708546.603928:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708546.603937:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebee00/0xf45f43947e47cc2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de40 expref: 10 pid: 6479 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.603945:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebee00/0xf45f43947e47cc2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de40 expref: 10 pid: 6479 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.603954:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebee00/0xf45f43947e47cc2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de40 expref: 10 pid: 6479 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.603963:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.603969:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.603978:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.603983:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.603988:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.603992:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.603996:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188adc00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708546.603999:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.604011:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.604024:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.604033:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708546.604046:0:10360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.604058:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708546.604066:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188adc00/0xf45f43947e47cda9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708546.604089:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08576c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:098f9bc4-0284-4f29-9497-0447ce008685+9:2395:x1876645357033088:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 174us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708546.604097:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00010000:00010000:1.0:1789708546.662366:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708546.782949:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708546.782973:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708546.782999:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708546.783020:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357033344 00000100:00100000:1.0:1789708546.783025:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357033216 00000100:00100000:0.0:1789708546.783027:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708546.783032:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357033344 00000100:00100000:1.0:1789708546.783032:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357033216 00000100:00100000:0.0:1789708546.783049:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357033600 00000100:00100000:0.0:1789708546.783053:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357033600 00000100:00100000:0.0:1789708546.783087:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357033472 00000100:00100000:0.0:1789708546.783090:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357033472 00000100:00100000:1.0:1789708546.783091:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1789708546.783101:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:2396:x1876645357033216:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708546.783104:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:0.0:1789708546.783115:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789708546.783121:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2395:x1876645357033344:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708546.783128:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2395:x1876645357033600:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708546.783172:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:2396:x1876645357033216:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708546.783175:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2395:x1876645357033344:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 58us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708546.783176:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2395:x1876645357033600:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 50us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708546.783183:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:0.0:1789708546.783190:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789708546.783195:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:0.0:1789708546.783203:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1789708546.783210:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2396:x1876645357033472:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:1.0:1789708546.783215:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708546.783218:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708546.783221:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789708546.783223:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708546.783233:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2396:x1876645357033472:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 24us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708546.783249:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:2.0:1789708546.895023:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708546.895085:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357033728 00000100:00100000:0.0:1789708546.895096:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357033728 00000100:00100000:0.0:1789708546.895153:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 238 00000100:00100000:0.0:1789708546.895165:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+9:6155:x1876645357033728:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708546.895180:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708546.895199:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee0165a600/0xf45f43947e47cdb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715de86 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.895227:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee0165a600/0xf45f43947e47cdb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de86 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.895238:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee0165a600/0xf45f43947e47cdb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de86 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708546.895248:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee0165a600, rc 0) 00000100:00100000:0.0:1789708546.895335:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6155:x1876645357033728:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 172us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708546.895343:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 238 00000100:00100000:1.0:1789708546.896142:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708546.896195:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357033856 00000100:00100000:2.0:1789708546.896199:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357033856 00000100:00100000:2.0:1789708546.896225:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:2.0:1789708546.896232:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:6155:x1876645357033856:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708546.896353:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:6155:x1876645357033856:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 121us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708546.896360:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:1.0:1789708546.897006:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708546.897063:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357033984 00000100:00100000:0.0:1789708546.897069:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357033984 00000100:00100000:0.0:1789708546.897102:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 240 00000100:00100000:0.0:1789708546.897111:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6155:x1876645357033984:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708546.897204:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6155:x1876645357033984:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708546.897213:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 240 00000100:00100000:0.0:1789708546.898182:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708546.898226:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357034112 00000100:00100000:2.0:1789708546.898232:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357034112 00000100:00100000:2.0:1789708546.898284:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:2.0:1789708546.898295:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:6715:x1876645357034112:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708546.898384:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:6715:x1876645357034112:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708546.898392:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:1.0:1789708546.899102:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708546.899137:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357034240 00000100:00100000:0.0:1789708546.899143:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357034240 00000100:00100000:0.0:1789708546.899173:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 242 00000100:00100000:0.0:1789708546.899183:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6715:x1876645357034240:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789708546.899308:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+10:6715:x1876645357034240:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 79us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708546.899317:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 242 00010000:00010000:2.0:1789708547.686396:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789708547.750323:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708547.750330:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed08a9c000 from 4 10000000:01000000:3.0:1789708547.750338:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708547.750384:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.750393:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.750401:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708547.750430:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365469568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.750495:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708547.750531:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365469568 00000100:00100000:1.0:1789708547.750538:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365469568 00000100:00100000:3.0:1789708547.750540:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708547.750595:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789708547.750628:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365469568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708547.750644:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708547.750659:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cdbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cdb7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708547.750682:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cdbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cdb7 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708547.750691:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cdbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cdb7 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708547.750698:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ada00, rc 0) 00000100:00100000:1.0:1789708547.750744:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365469568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708547.750751:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789708547.750772:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365469568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708547.750787:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.750797:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708547.750857:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365469696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.750880:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708547.750900:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708547.750914:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365469696 00000100:00100000:1.0:1789708547.750918:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365469696 00000100:00100000:1.0:1789708547.750943:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789708547.750953:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365469696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708547.751061:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365469696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708547.751066:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789708547.751094:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365469696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.751150:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365469824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.751196:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708547.751217:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708547.751225:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365469824 00000100:00100000:1.0:1789708547.751229:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365469824 00000100:00100000:1.0:1789708547.751249:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789708547.751254:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365469824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708547.751519:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365469824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 264us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708547.751532:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789708547.751549:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365469824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.751816:0:10501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10501:1876645365469952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708547.751859:0:10501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708547.751882:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365469952 00000100:00100000:1.0:1789708547.751886:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365469952 00000100:00100000:3.0:1789708547.751908:0:10501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708547.751919:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789708547.751927:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10501:x1876645365469952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708547.751994:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10501:x1876645365469952:12345-0@lo:502:llog_process_th.0 Request processed in 68us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708547.751999:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789708547.752015:0:10501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10501:1876645365469952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708547.752042:0:10501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708547.752055:0:10501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708547.752058:0:10501:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789708547.752064:0:10501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bed08a9c000 00000020:00000080:3.0:1789708547.752066:0:10501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789708547.752132:0:10501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10501:1876645365470080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708547.752162:0:10501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708547.752174:0:10501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708547.752441:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365470080 00000100:00100000:2.0:1789708547.752447:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365470080 00000100:00100000:2.0:1789708547.752486:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789708547.752498:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10501:x1876645365470080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708547.752604:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:10501:x1876645365470080:12345-0@lo:502:llog_process_th.0 Request processed in 109us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708547.752613:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789708547.752636:0:10501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10501:1876645365470080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708547.752662:0:10501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708547.752667:0:10501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708547.752670:0:10501:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789708547.752674:0:10501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789708547.752743:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789708547.752773:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708547.752781:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708547.752793:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708547.752802:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789708547.752805:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee2f569800 from 4 10000000:01000000:2.0:1789708547.752808:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708547.752827:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708547.752835:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708547.752843:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708547.752863:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365470208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708547.752903:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708547.752928:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365470208 00000100:00100000:3.0:1789708547.752932:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365470208 00000100:00100000:2.0:1789708547.752938:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708547.752959:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789708547.752967:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365470208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708547.752973:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708547.752982:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509e00/0xf45f43947e47cdcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cdc5 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.752995:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509e00/0xf45f43947e47cdcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cdc5 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.753002:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509e00/0xf45f43947e47cdcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cdc5 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.753008:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509e00, rc 0) 00000100:00100000:3.0:1789708547.753042:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365470208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708547.753055:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789708547.753063:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365470208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708547.753075:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708547.753082:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708547.753125:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365470336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708547.753151:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708547.753167:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708547.753168:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365470336 00000100:00100000:3.0:1789708547.753172:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365470336 00000100:00100000:3.0:1789708547.753199:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789708547.753205:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365470336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.753291:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365470336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708547.753299:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789708547.753303:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365470336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708547.753334:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365470464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708547.753370:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708547.753391:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365470464 00000100:00100000:3.0:1789708547.753396:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365470464 00000100:00100000:0.0:1789708547.753398:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708547.753428:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789708547.753436:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365470464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.753517:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365470464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708547.753522:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789708547.753545:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365470464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.753695:0:10503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10503:1876645365470592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708547.753731:0:10503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708547.753747:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365470592 00000100:00100000:3.0:1789708547.753749:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365470592 00000100:00100000:3.0:1789708547.753769:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789708547.753774:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:10503:x1876645365470592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708547.753849:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:10503:x1876645365470592:12345-0@lo:502:llog_process_th.0 Request processed in 74us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708547.753856:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789708547.753885:0:10503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708547.753902:0:10503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10503:1876645365470592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708547.753917:0:10503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708547.753922:0:10503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708547.753924:0:10503:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789708547.753927:0:10503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee2f569800 00000020:00000080:3.0:1789708547.753929:0:10503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789708547.753967:0:10503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10503:1876645365470720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708547.753999:0:10503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708547.754014:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365470720 00000100:00100000:3.0:1789708547.754017:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365470720 00000100:00100000:3.0:1789708547.754034:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789708547.754041:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:10503:x1876645365470720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708547.754114:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:10503:x1876645365470720:12345-0@lo:502:llog_process_th.0 Request processed in 73us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708547.754122:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789708547.754154:0:10503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708547.754167:0:10503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10503:1876645365470720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708547.754186:0:10503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708547.754191:0:10503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708547.754193:0:10503:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789708547.754196:0:10503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789708547.754234:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789708547.754292:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708547.754299:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.754307:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708547.754326:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708547.754328:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee36337800 from 4 10000000:01000000:3.0:1789708547.754331:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708547.754346:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.754353:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.754361:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708547.754374:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365470848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.754407:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708547.754441:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708547.754459:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365470848 00000100:00100000:3.0:1789708547.754464:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365470848 00000100:00100000:3.0:1789708547.754494:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789708547.754503:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365470848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708547.754509:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708547.754520:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509c00/0xf45f43947e47cdda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cdd3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.754535:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509c00/0xf45f43947e47cdda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cdd3 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.754545:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509c00/0xf45f43947e47cdda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cdd3 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.754564:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509c00, rc 0) 00000100:00100000:3.0:1789708547.754595:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365470848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708547.754602:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789708547.754611:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365470848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708547.754635:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708547.754643:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708547.754685:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365470976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708547.754710:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708547.754724:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708547.754734:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365470976 00000100:00100000:3.0:1789708547.754740:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365470976 00000100:00100000:3.0:1789708547.754772:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789708547.754781:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365470976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.754854:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365470976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708547.754858:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365470976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.754867:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789708547.754894:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365471104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708547.754922:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708547.754934:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708547.754943:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365471104 00000100:00100000:3.0:1789708547.754948:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365471104 00000100:00100000:3.0:1789708547.754976:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789708547.754985:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365471104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.755066:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365471104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708547.755074:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789708547.755077:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365471104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708547.755279:0:10504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10504:1876645365471232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708547.755324:0:10504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708547.755341:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365471232 00000100:00100000:3.0:1789708547.755345:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365471232 00000100:00100000:1.0:1789708547.755347:0:10504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708547.755371:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789708547.755377:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10504:x1876645365471232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708547.755450:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10504:x1876645365471232:12345-0@lo:502:llog_process_th.0 Request processed in 72us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708547.755457:0:10504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10504:1876645365471232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708547.755460:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000020:01000000:1.0:1789708547.755478:0:10504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708547.755483:0:10504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708547.755485:0:10504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789708547.755495:0:10504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee36337800 00000020:00000080:1.0:1789708547.755498:0:10504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789708547.755543:0:10504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10504:1876645365471360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708547.755581:0:10504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708547.755596:0:10504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708547.755754:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365471360 00000100:00100000:3.0:1789708547.755759:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365471360 00000100:00100000:3.0:1789708547.755789:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789708547.755797:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10504:x1876645365471360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708547.755882:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:10504:x1876645365471360:12345-0@lo:502:llog_process_th.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708547.755890:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789708547.755908:0:10504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10504:1876645365471360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708547.755929:0:10504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708547.755933:0:10504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708547.755934:0:10504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789708547.755938:0:10504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789708547.755986:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789708547.756015:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708547.756021:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.756029:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708547.756038:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708547.756040:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee02bf3800 from 4 10000000:01000000:3.0:1789708547.756043:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708547.756061:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.756068:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708547.756076:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708547.756090:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365471488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708547.756122:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708547.756150:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708547.756163:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365471488 00000100:00100000:2.0:1789708547.756169:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365471488 00000100:00100000:2.0:1789708547.756203:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789708547.756212:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365471488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708547.756220:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708547.756229:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee00030a00/0xf45f43947e47cde8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cde1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708547.756246:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee00030a00/0xf45f43947e47cde8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cde1 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708547.756255:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee00030a00/0xf45f43947e47cde8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cde1 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708547.756293:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee00030a00, rc 0) 00000100:00100000:2.0:1789708547.756323:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365471488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708547.756327:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789708547.756365:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365471488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708547.756383:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708547.756392:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708547.756440:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365471616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708547.756460:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708547.756480:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708547.756491:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365471616 00000100:00100000:0.0:1789708547.756496:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365471616 00000100:00100000:0.0:1789708547.756526:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789708547.756533:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365471616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708547.756593:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365471616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708547.756599:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789708547.756612:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365471616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708547.756655:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365471744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708547.756685:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708547.756700:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708547.756706:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365471744 00000100:00100000:0.0:1789708547.756711:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365471744 00000100:00100000:0.0:1789708547.756732:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789708547.756738:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365471744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708547.756802:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365471744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708547.756809:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789708547.756812:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365471744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708547.756974:0:10508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10508:1876645365471872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708547.757017:0:10508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708547.757037:0:10508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708547.757039:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365471872 00000100:00100000:0.0:1789708547.757043:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365471872 00000100:00100000:0.0:1789708547.757065:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789708547.757072:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:10508:x1876645365471872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708547.757135:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:10508:x1876645365471872:12345-0@lo:502:llog_process_th.0 Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708547.757141:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789708547.757155:0:10508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10508:1876645365471872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708547.757181:0:10508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708547.757187:0:10508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708547.757189:0:10508:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789708547.757196:0:10508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee02bf3800 00000020:00000080:2.0:1789708547.757200:0:10508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789708547.757574:0:10508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10508:1876645365472000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708547.757630:0:10508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708547.757669:0:10508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708547.757735:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365472000 00000100:00100000:0.0:1789708547.757738:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365472000 00000100:00100000:0.0:1789708547.757765:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789708547.757772:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:10508:x1876645365472000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708547.757856:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:10508:x1876645365472000:12345-0@lo:502:llog_process_th.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708547.757862:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789708547.757871:0:10508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:10508:1876645365472000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708547.757903:0:10508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708547.757908:0:10508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708547.757910:0:10508:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789708547.757915:0:10508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789708547.757990:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789708547.758021:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708547.758028:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708547.758035:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1789708548.438756:0:10660:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789708548.710428:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708548.966427:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708548.966457:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365472128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789708548.966549:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708548.966610:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365472128 00000100:00100000:2.0:1789708548.966624:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365472128 00000100:00100000:2.0:1789708548.966682:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789708548.966692:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365472128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789708548.966726:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789708548.966808:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365472128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708548.966816:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789708548.966861:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365472128:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789708549.734377:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789708549.828488:0:10903:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing yml_node 00000100:00100000:0.0:1789708549.990425:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365472640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708549.990426:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365472256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708549.990502:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708549.990506:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365472384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708549.990544:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708549.990570:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708549.990592:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365472512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708549.990626:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708549.990669:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365472640 00000100:00100000:0.0:1789708549.990677:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365472640 00000100:00080000:1.0:1789708549.990718:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708549.990737:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365472384 00000100:00100000:0.0:1789708549.990743:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365472384 00000100:00080000:1.0:1789708549.990766:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708549.990771:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365473024:0@lo:400:kworker.0 00000100:00100000:0.0:1789708549.990775:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365472512 00000100:00100000:0.0:1789708549.990780:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365472512 00000100:00080000:1.0:1789708549.990798:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708549.990815:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708549.990820:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708549.990829:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365472640:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708549.990847:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365473536:0@lo:400:kworker.0 00002000:00000024:0.0:1789708549.990858:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708549.990875:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708549.990900:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789708549.990909:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365472640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708549.990910:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365473152:0@lo:400:kworker.0 00000100:00100000:0.0:1789708549.990925:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708549.990927:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365473024 00000100:00100000:1.0:1789708549.990932:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365473024 00000100:00100000:3.0:1789708549.990942:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708549.990950:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708549.990961:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365472384:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708549.990965:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789708549.990978:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365473664:0@lo:400:kworker.0 00000100:00100000:1.0:1789708549.990981:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365473024:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789708549.990996:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708549.991011:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708549.991049:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365473024:12345-0@lo:400:kworker.0 Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708549.991053:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365473024:0@lo:400:kworker.0 00000100:00100000:0.0:1789708549.991053:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365472384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708549.991061:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789708549.991070:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708549.991095:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789708549.991104:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365472512:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708549.991105:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365473536 00000100:00100000:3.0:1789708549.991113:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365473536 00002000:00000024:0.0:1789708549.991116:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1789708549.991127:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3e929c00 x1876645365472640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708549.991143:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365472640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708549.991153:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365472512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708549.991160:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365473152 00000100:00100000:0.0:1789708549.991161:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789708549.991164:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bea300 x1876645365472512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708549.991167:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365473152 00000100:00100000:1.0:1789708549.991178:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365472512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708549.991197:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365473664 00000100:00100000:3.0:1789708549.991202:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365473664 00000100:00100000:0.0:1789708549.991204:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789708549.991216:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365473536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708549.991222:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789708549.991232:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365473152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708549.991238:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789708549.991250:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365473664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708549.991286:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365473536:12345-0@lo:400:kworker.0 Request processed in 72us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708549.991291:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365473152:12345-0@lo:400:kworker.0 Request processed in 60us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708549.991297:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789708549.991306:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789708549.991328:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365473664:12345-0@lo:400:kworker.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708549.991337:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708549.991341:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365472896:0@lo:400:kworker.0 00000100:00100000:3.0:1789708549.991343:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789708549.991374:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708549.991374:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365472768:0@lo:400:kworker.0 00000100:00080000:3.0:1789708549.991381:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708549.991386:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708549.991405:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365472896 00000100:00100000:3.0:1789708549.991411:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365472896 00000100:00100000:1.0:1789708549.991411:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708549.991417:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365473408:0@lo:400:kworker.0 00000100:00100000:1.0:1789708549.991441:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365473280:0@lo:400:kworker.0 00000100:00100000:3.0:1789708549.991446:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708549.991454:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708549.991458:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365472896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708549.991467:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708549.991485:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365473920:0@lo:400:kworker.0 00000100:00100000:1.0:1789708549.991492:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365473792:0@lo:400:kworker.0 00000100:00100000:3.0:1789708549.991507:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365472896:12345-0@lo:400:kworker.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708549.991514:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708549.991525:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708549.991529:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365473408 00000100:00100000:1.0:1789708549.991534:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708549.991536:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365473408 00010000:00080000:0.0:1789708549.991563:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08be9880 x1876645365472384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708549.991565:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365473792 00000100:00100000:3.0:1789708549.991570:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365473792 00000100:00100000:0.0:1789708549.991591:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789708549.991595:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365473280 00000100:00100000:1.0:1789708549.991601:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365473280 00000100:00100000:3.0:1789708549.991605:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789708549.991614:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365473408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708549.991620:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365472384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708549.991640:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789708549.991652:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365472896:0@lo:400:kworker.0 00000100:00100000:3.0:1789708549.991653:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365473408:12345-0@lo:400:kworker.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708549.991653:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365473280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708549.991669:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789708549.991676:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365473408:0@lo:400:kworker.0 00000100:00100000:3.0:1789708549.991687:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708549.991699:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365473792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708549.991710:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365472768 00000100:00100000:1.0:1789708549.991714:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365473280:12345-0@lo:400:kworker.0 Request processed in 64us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708549.991715:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365472768 00000100:00100000:1.0:1789708549.991725:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708549.991741:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365473792:12345-0@lo:400:kworker.0 Request processed in 46us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708549.991752:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365472256 00000100:00100000:3.0:1789708549.991756:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789708549.991758:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365472256 00000100:00100000:0.0:1789708549.991760:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789708549.991774:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365472768:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789708549.991788:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789708549.991793:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708549.991797:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708549.991798:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708549.991810:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365472256:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708549.991816:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365472768:12345-0@lo:400:kworker.0 Request processed in 44us (403us total) trans 0 rc 0/0 00002000:00000024:1.0:1789708549.991825:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708549.991826:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789708549.991835:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365473152:0@lo:400:kworker.0 00000100:00100000:3.0:1789708549.991845:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365473664:0@lo:400:kworker.0 00010000:00080000:3.0:1789708549.991855:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09b83800 x1876645365473536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708549.991862:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365473536:0@lo:400:kworker.0 00000100:00100000:0.0:1789708549.991864:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365473920 00000100:00100000:0.0:1789708549.991869:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365473920 00000100:00100000:1.0:1789708549.991874:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365472256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708549.991890:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708549.991902:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708549.991911:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365473920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708549.991928:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365472768:0@lo:400:kworker.0 00000100:00100000:1.0:1789708549.991941:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365473280:0@lo:400:kworker.0 00010000:00080000:1.0:1789708549.991954:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09b83b80 x1876645365473792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708549.991960:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365473920:12345-0@lo:400:kworker.0 Request processed in 49us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708549.991978:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365473792:0@lo:400:kworker.0 00000100:00100000:0.0:1789708549.991978:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789708549.991984:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09b82a00 x1876645365473920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708549.991994:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00010000:00080000:1.0:1789708549.992003:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3e92a300 x1876645365472256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708549.992006:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365473920:0@lo:400:kworker.0 00000100:00100000:1.0:1789708549.992024:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365472256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789708550.758444:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708551.015433:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365474048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789708551.015534:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708551.016341:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365474048 00000100:00100000:3.0:1789708551.016352:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365474048 00000100:00100000:3.0:1789708551.016416:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789708551.016430:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365474048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789708551.016485:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789708551.016583:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365474048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708551.016592:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789708551.016653:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365474048:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1789708551.140066:0:11086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:2.0:1789708551.782394:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708551.903112:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708551.903149:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708551.903162:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357034368 00000100:00100000:1.0:1789708551.903170:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708551.903172:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357034368 00000100:00100000:2.0:1789708551.903194:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357034624 00000100:00100000:1.0:1789708551.903194:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708551.903201:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357034624 00000100:00100000:0.0:1789708551.903220:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 264 00000100:00100000:1.0:1789708551.903230:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708551.903234:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:2397:x1876645357034368:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708551.903256:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357034880 00000100:00100000:1.0:1789708551.903277:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357034880 00000100:00100000:2.0:1789708551.903296:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357034496 00000100:00100000:2.0:1789708551.903302:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357034496 00000100:00100000:1.0:1789708551.903308:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357034752 00000100:00100000:1.0:1789708551.903312:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357034752 00000100:00100000:1.0:1789708551.903345:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789708551.903350:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:1.0:1789708551.903355:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357034880:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708551.903366:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357034624:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708551.903401:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357034880:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 48us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708551.903418:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:0.0:1789708551.903419:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:2397:x1876645357034368:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 187us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708551.903424:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357034624:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 48us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708551.903434:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 264 00000100:00100000:1.0:1789708551.903439:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1789708551.903440:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:1.0:1789708551.903449:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357034752:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708551.903466:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:1.0:1789708551.903475:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357034752:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 28us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708551.903481:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1789708551.903486:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+6:2397:x1876645357034496:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:1.0:1789708551.903512:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708551.903517:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789708551.903522:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708551.903523:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+6:2397:x1876645357034496:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 39us (326us total) trans 0 rc 0/0 00000100:00080000:1.0:1789708551.903525:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708551.903533:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000001:02000400:1.0:1789708551.921926:0:11183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000001:02000400:3.0:1789708552.729823:0:11281:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:3.0:1789708552.806351:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789708553.224929:0:11329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 18 01:15:52 EDT 2026 00010000:00010000:3.0:1789708553.830324:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708554.086387:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708554.086409:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365474176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708554.086478:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708554.086526:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365474176 00000100:00100000:3.0:1789708554.086534:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365474176 00000100:00100000:3.0:1789708554.086580:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789708554.086589:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365474176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789708554.086620:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789708554.086673:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365474176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708554.086681:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789708554.086718:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365474176:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789708554.854339:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708555.110428:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365474304:0@lo:400:kworker.0 00000100:00100000:3.0:1789708555.110434:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365474688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708555.110515:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708555.110527:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365474560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708555.110535:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365474432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708555.110552:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708555.110576:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365474816:0@lo:400:kworker.0 00000100:00100000:0.0:1789708555.110594:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708555.110608:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365475200:0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.110611:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708555.110613:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365474688 00000100:00100000:2.0:1789708555.110624:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365474688 00000100:00100000:1.0:1789708555.110646:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365475328:0@lo:400:kworker.0 00000100:00100000:0.0:1789708555.110655:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365475072:0@lo:400:kworker.0 00000100:00100000:2.0:1789708555.110668:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365474560 00000100:00100000:2.0:1789708555.110672:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365474560 00000100:00100000:3.0:1789708555.110674:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708555.110683:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708555.110702:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789708555.110710:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365474688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708555.110722:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365475840:0@lo:400:kworker.0 00002000:00000024:2.0:1789708555.110741:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708555.110746:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365475584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708555.110759:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708555.110796:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365474688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708555.110802:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789708555.110813:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365476352:0@lo:400:kworker.0 00000100:00100000:3.0:1789708555.110816:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708555.110822:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789708555.110830:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365474560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789708555.110840:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708555.110851:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365476224:0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.110859:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708555.110868:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365474560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708555.110873:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789708555.110887:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365475584 00000100:00100000:2.0:1789708555.110891:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365475584 00000100:00100000:3.0:1789708555.110906:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708555.110916:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365474816 00000100:00100000:2.0:1789708555.110921:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789708555.110921:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365474816 00000100:00100000:2.0:1789708555.110935:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365475584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708555.110950:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789708555.110976:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365475328 00010000:00080000:3.0:1789708555.110977:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09b83800 x1876645365474688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708555.110982:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365475328 00000100:00100000:2.0:1789708555.110993:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365475584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708555.111009:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789708555.111013:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789708555.111019:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365474816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708555.111030:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365474688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708555.111043:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365474304 00000100:00100000:2.0:1789708555.111047:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365474304 00000100:00100000:2.0:1789708555.111087:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00010000:00080000:3.0:1789708555.111088:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bea300 x1876645365475584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708555.111088:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365474816:12345-0@lo:400:kworker.0 Request processed in 62us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708555.111099:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365474304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.111124:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789708555.111142:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365475584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708555.111148:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789708555.111155:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365474304:12345-0@lo:400:kworker.0 Request processed in 60us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708555.111161:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789708555.111164:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365475328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.111206:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365475328:12345-0@lo:400:kworker.0 Request processed in 51us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708555.111213:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789708555.111222:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708555.111225:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365475200 00000100:00100000:3.0:1789708555.111232:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365475200 00000100:00080000:1.0:1789708555.111238:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708555.111243:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365474944:0@lo:400:kworker.0 00000100:00080000:1.0:1789708555.111244:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708555.111248:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708555.111291:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365475840 00000100:00100000:1.0:1789708555.111295:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365475840 00000100:00100000:2.0:1789708555.111304:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708555.111331:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365476352 00000100:00100000:1.0:1789708555.111335:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365476352 00000100:00100000:2.0:1789708555.111342:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365475456:0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.111359:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365476224 00000100:00100000:1.0:1789708555.111362:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365476224 00000100:00100000:2.0:1789708555.111371:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708555.111382:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365474944 00000100:00100000:1.0:1789708555.111389:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708555.111393:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876645365475968:0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.111400:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365475840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708555.111404:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365474944 00000100:00100000:2.0:1789708555.111416:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708555.111456:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789708555.111457:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365475840:12345-0@lo:400:kworker.0 Request processed in 57us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708555.111465:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365475456 00000100:00100000:2.0:1789708555.111474:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365475456 00000100:00100000:3.0:1789708555.111499:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365475200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.111506:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708555.111524:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365475968 00000100:00100000:2.0:1789708555.111529:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365475968 00000100:00100000:1.0:1789708555.111533:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708555.111542:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365476352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708555.111567:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789708555.111580:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365475456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708555.111596:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365475200:12345-0@lo:400:kworker.0 Request processed in 117us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708555.111601:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365476352:12345-0@lo:400:kworker.0 Request processed in 60us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708555.111631:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708555.111632:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789708555.111638:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365475456:12345-0@lo:400:kworker.0 Request processed in 61us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708555.111643:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708555.111651:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789708555.111656:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365476224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708555.111665:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789708555.111681:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708555.111682:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365474944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.111688:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365476224:12345-0@lo:400:kworker.0 Request processed in 36us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708555.111700:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708555.111709:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876645365475968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.111735:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365474432 00000100:00100000:1.0:1789708555.111739:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365474432 00000100:00100000:1.0:1789708555.111775:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789708555.111779:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365474944:12345-0@lo:400:kworker.0 Request processed in 93us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708555.111779:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876645365475968:12345-0@lo:400:kworker.0 Request processed in 68us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708555.111785:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365474432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789708555.111807:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708555.111818:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708555.111821:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789708555.111852:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708555.111853:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365474432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (638us total) trans 0 rc 0/0 00000100:00080000:2.0:1789708555.111856:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708555.111860:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789708555.111860:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789708555.111901:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bd8a80 x1876645365476224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789708555.111903:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ada300 x1876645365474432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708555.111929:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708555.111959:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365475712:0@lo:400:kworker.0 00000100:00100000:3.0:1789708555.111966:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365476224:0@lo:400:kworker.0 00000100:00100000:2.0:1789708555.111974:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365474432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708555.111995:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365475200:0@lo:400:kworker.0 00000100:00100000:2.0:1789708555.112004:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365474944:0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.112011:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789708555.112038:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bd9880 x1876645365475456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708555.112048:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365475456:0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.112049:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365476096:0@lo:400:kworker.0 00000100:00100000:2.0:1789708555.112062:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876645365475968:0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.112077:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708555.112106:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365475072 00000100:00100000:2.0:1789708555.112110:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365475072 00010000:00080000:1.0:1789708555.112112:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08be9880 x1876645365474560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708555.112125:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365476096 00000100:00100000:3.0:1789708555.112133:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365476096 00000100:00100000:1.0:1789708555.112133:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365474560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708555.112141:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789708555.112154:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365475072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.112171:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365475712 00000100:00100000:1.0:1789708555.112175:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365475712 00000100:00100000:2.0:1789708555.112204:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365475072:12345-0@lo:400:kworker.0 Request processed in 54us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708555.112214:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789708555.112218:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708555.112223:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789708555.112229:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365475712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708555.112242:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365476096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708555.112250:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365475328:0@lo:400:kworker.0 00010000:00080000:2.0:1789708555.112291:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bda300 x1876645365475840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708555.112296:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365475712:12345-0@lo:400:kworker.0 Request processed in 71us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708555.112309:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708555.112313:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365475840:0@lo:400:kworker.0 00010000:00080000:2.0:1789708555.112337:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bd9500 x1876645365476352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708555.112344:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365476352:0@lo:400:kworker.0 00000100:00100000:1.0:1789708555.112355:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365475072:0@lo:400:kworker.0 00000100:00100000:3.0:1789708555.112363:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365476096:12345-0@lo:400:kworker.0 Request processed in 120us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708555.112364:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365474304:0@lo:400:kworker.0 00010000:00080000:1.0:1789708555.112373:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bda680 x1876645365475712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708555.112390:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365474816:0@lo:400:kworker.0 00000100:00100000:3.0:1789708555.112403:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789708555.112408:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365475712:0@lo:400:kworker.0 00010000:00080000:1.0:1789708555.112428:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bd9180 x1876645365476096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708555.112434:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365476096:0@lo:400:kworker.0 00000100:00080000:3.0:1789708555.112453:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789708555.878423:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708556.134521:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365476480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789708556.134601:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708556.134647:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365476480 00000100:00100000:1.0:1789708556.134657:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365476480 00000100:00100000:1.0:1789708556.134720:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789708556.134733:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365476480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789708556.134792:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789708556.134860:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365476480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708556.134867:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789708556.134899:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365476480:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789708556.902372:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708557.023060:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708557.023105:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708557.023117:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357035008 00000100:00100000:2.0:1789708557.023127:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357035008 00000100:00100000:0.0:1789708557.023132:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708557.023155:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.023157:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357035136 00000100:00100000:3.0:1789708557.023164:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357035136 00000100:00100000:2.0:1789708557.023186:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 266 00000100:00100000:0.0:1789708557.023186:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708557.023202:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+10:2398:x1876645357035008:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708557.023222:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357035264 00000100:00100000:0.0:1789708557.023224:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357035392 00000100:00100000:0.0:1789708557.023229:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357035392 00000100:00100000:3.0:1789708557.023234:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357035264 00000100:00100000:0.0:1789708557.023284:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357035520 00000100:00100000:0.0:1789708557.023287:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357035520 00000100:00100000:2.0:1789708557.023293:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+10:2398:x1876645357035008:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708557.023302:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 266 00000100:00100000:0.0:1789708557.023315:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:3.0:1789708557.023327:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:0.0:1789708557.023327:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357035392:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708557.023343:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:2397:x1876645357035136:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708557.023360:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357035392:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 36us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708557.023361:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:0.0:1789708557.023370:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:2.0:1789708557.023377:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357035264:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708557.023385:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789708557.023389:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:2397:x1876645357035136:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 48us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708557.023396:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357035520:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708557.023403:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:2.0:1789708557.023414:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357035264:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 41us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708557.023422:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357035520:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 29us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708557.023424:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:0.0:1789708557.023428:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00080000:3.0:1789708557.023438:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789708557.023459:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708557.023463:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789708557.023465:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1789708557.717818:0:11956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:15:57 (1789708557) === 00000100:00100000:2.0:1789708557.858312:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.858363:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357035648 00000100:00100000:3.0:1789708557.858373:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357035648 00000100:00100000:3.0:1789708557.858415:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 267 00000100:00100000:3.0:1789708557.858423:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+10:8725:x1876645357035648:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789708557.858447:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708557.858462:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47cdef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715de8d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708557.858485:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47cdef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de8d expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708557.858492:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47cdef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de8d expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708557.858499:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8a00, rc 0) 00000100:00100000:3.0:1789708557.858537:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+11:8725:x1876645357035648:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 116us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.858542:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 267 00000100:00100000:0.0:1789708557.859223:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708557.859273:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357035776 00000100:00100000:2.0:1789708557.859278:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357035776 00000100:00100000:2.0:1789708557.859301:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 268 00000100:00100000:2.0:1789708557.859307:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+11:8725:x1876645357035776:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789708557.859400:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+11:8725:x1876645357035776:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 93us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708557.859405:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 268 00000100:00100000:0.0:1789708557.859967:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.859996:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357035904 00000100:00100000:3.0:1789708557.860000:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357035904 00000100:00100000:3.0:1789708557.860020:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 269 00000100:00100000:3.0:1789708557.860025:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+11:8725:x1876645357035904:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789708557.860112:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+11:8725:x1876645357035904:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 85us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.860120:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 269 00000100:00100000:1.0:1789708557.861859:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708557.861897:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357036032 00000100:00100000:2.0:1789708557.861901:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357036032 00000100:00100000:2.0:1789708557.861928:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 270 00000100:00100000:2.0:1789708557.861933:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+11:8728:x1876645357036032:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708557.862017:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+11:8728:x1876645357036032:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 83us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708557.862024:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 270 00000100:00100000:0.0:1789708557.868483:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.868521:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357036160 00000100:00100000:3.0:1789708557.868530:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357036160 00000100:00100000:3.0:1789708557.868569:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 271 00000100:00100000:3.0:1789708557.868577:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+11:8728:x1876645357036160:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708557.868703:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+11:8728:x1876645357036160:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 127us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.868709:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 271 00000100:00100000:0.0:1789708557.869475:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708557.869532:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357036288 00000100:00100000:2.0:1789708557.869536:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357036288 00000100:00100000:2.0:1789708557.869563:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 272 00000100:00100000:2.0:1789708557.869571:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+11:8728:x1876645357036288:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708557.869651:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+11:8728:x1876645357036288:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708557.869658:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 272 00000100:00100000:1.0:1789708557.870504:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.870529:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357036416 00000100:00100000:3.0:1789708557.870533:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357036416 00000100:00100000:3.0:1789708557.870554:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 273 00000100:00100000:3.0:1789708557.870559:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+11:8725:x1876645357036416:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789708557.870566:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708557.870579:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee029c9c00/0xf45f43947e47cdf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715debe expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708557.870598:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c9c00/0xf45f43947e47cdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715debe expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708557.870605:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee029c9c00/0xf45f43947e47cdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715debe expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708557.870619:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9c00, rc 0) 00000100:00100000:3.0:1789708557.870643:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+12:8725:x1876645357036416:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 84us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.870647:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 273 00000100:00100000:0.0:1789708557.872000:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708557.872053:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357036544 00000100:00100000:2.0:1789708557.872058:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357036544 00000100:00100000:2.0:1789708557.872084:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 274 00000100:00100000:2.0:1789708557.872089:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+12:8725:x1876645357036544:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789708557.872109:0:6479:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789708557.872123:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789708557.872125:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789708557.872127:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789708557.872129:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789708557.872131:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789708557.872772:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+12:8725:x1876645357036544:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 680us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708557.872778:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 274 00000100:00100000:1.0:1789708557.874256:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.874319:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357036672 00000100:00100000:3.0:1789708557.874324:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357036672 00000100:00100000:3.0:1789708557.874355:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 275 00000100:00100000:3.0:1789708557.874363:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+12:8725:x1876645357036672:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789708557.874373:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708557.874386:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee029c9600/0xf45f43947e47cdfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dec5 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708557.874409:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c9600/0xf45f43947e47cdfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dec5 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708557.874419:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee029c9600/0xf45f43947e47cdfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dec5 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708557.874440:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9600, rc 0) 00000100:00100000:3.0:1789708557.874472:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:8725:x1876645357036672:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 110us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.874480:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 275 00000100:00100000:0.0:1789708557.875071:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708557.875107:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357036800 00000100:00100000:2.0:1789708557.875111:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357036800 00000100:00100000:2.0:1789708557.875131:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 276 00000100:00100000:2.0:1789708557.875137:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:8725:x1876645357036800:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789708557.875229:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:8725:x1876645357036800:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 92us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708557.875236:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 276 00000100:00100000:0.0:1789708557.875803:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.875843:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357036928 00000100:00100000:3.0:1789708557.875848:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357036928 00000100:00100000:3.0:1789708557.875870:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 277 00000100:00100000:3.0:1789708557.875876:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:8725:x1876645357036928:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789708557.875947:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:8725:x1876645357036928:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 71us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.875953:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 277 00000100:00100000:1.0:1789708557.876742:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708557.876778:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357037056 00000100:00100000:2.0:1789708557.876783:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357037056 00000100:00100000:2.0:1789708557.876809:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 278 00000100:00100000:2.0:1789708557.876817:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:8731:x1876645357037056:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708557.876908:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:8731:x1876645357037056:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 91us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708557.876917:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 278 00000100:00100000:0.0:1789708557.877609:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.877643:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357037184 00000100:00100000:3.0:1789708557.877648:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357037184 00000100:00100000:3.0:1789708557.877673:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 279 00000100:00100000:3.0:1789708557.877681:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:8731:x1876645357037184:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708557.877748:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:8731:x1876645357037184:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 68us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.877755:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 279 00000100:00100000:0.0:1789708557.881173:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708557.881206:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.881225:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357037312 00000100:00100000:3.0:1789708557.881232:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357037312 00000100:00100000:0.0:1789708557.881253:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.881285:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357037952 00000100:00100000:3.0:1789708557.881290:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357037952 00000100:00100000:1.0:1789708557.881298:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1789708557.881305:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1876645357037312:12345-192.168.201.52@tcp:38:mount.lustre.0 00000100:00100000:0.0:1789708557.881314:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708557.881315:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:2.0:1789708557.881323:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1876645357037952:12345-192.168.201.52@tcp:38:mount.lustre.0 00000100:00100000:3.0:1789708557.881327:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357037440 00010000:00080000:1.0:1789708557.881330:0:6485:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0bd23bbf-17fc-4232-922d-5f674c08c0de@192.168.201.52@tcp t0 exp 0000000000000000 cur 128 last 0 00000100:00100000:3.0:1789708557.881332:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357037440 00000100:00100000:0.0:1789708557.881349:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00080000:2.0:1789708557.881353:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 0bd23bbf-17fc-4232-922d-5f674c08c0de@192.168.201.52@tcp t0 exp 0000000000000000 cur 128 last 0 00000100:00100000:3.0:1789708557.881368:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000020:00000080:1.0:1789708557.881373:0:6485:0:(genops.c:1384:class_connect()) connect: client 0bd23bbf-17fc-4232-922d-5f674c08c0de, cookie 0xf45f43947e47ce04 00000100:00100000:3.0:1789708557.881378:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2397:x1876645357037440:12345-192.168.201.52@tcp:400:kworker.0 00000020:00000080:2.0:1789708557.881385:0:6484:0:(genops.c:1384:class_connect()) connect: client 0bd23bbf-17fc-4232-922d-5f674c08c0de, cookie 0xf45f43947e47ce0b 00000100:00100000:0.0:1789708557.881387:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000004:00100000:1.0:1789708557.881396:0:6485:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:2.0:1789708557.881402:0:6484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789708557.881413:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357037696 00000100:00100000:0.0:1789708557.881418:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357037696 00000100:00100000:3.0:1789708557.881428:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2397:x1876645357037440:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 53us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.881446:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1789708557.881461:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357037568 00000100:00100000:3.0:1789708557.881464:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357037568 00000100:00100000:0.0:1789708557.881471:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357038080 00000100:00100000:0.0:1789708557.881476:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357038080 00000100:00100000:3.0:1789708557.881486:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:3.0:1789708557.881495:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357037568:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708557.881526:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357037568:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 30us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708557.881526:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00080000:2.0:1789708557.881532:0:6484:0:(import.c:65:import_set_state_nolock()) ffff9bee3f9f0000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789708557.881532:0:6485:0:(import.c:65:import_set_state_nolock()) ffff9bed08561800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708557.881541:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+5:2394:x1876645357037696:12345-192.168.201.52@tcp:9:kworker.0 00000100:00100000:3.0:1789708557.881549:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:1.0:1789708557.881569:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2394:x1876645357037312:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 263us (403us total) trans 0 rc 0/0 00000020:00000080:0.0:1789708557.881570:0:9145:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cc44 00000100:00100000:2.0:1789708557.881579:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2394:x1876645357037952:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 253us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708557.881579:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00080000:0.0:1789708557.881583:0:9145:0:(import.c:65:import_set_state_nolock()) ffff9bed08bf8800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789708557.881594:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1789708557.881607:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:1.0:1789708557.881617:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2394:x1876645357038080:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:1.0:1789708557.881633:0:10054:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cc4b 00000001:00000004:0.0:1789708557.881634:0:9145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:1.0:1789708557.881639:0:10054:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa77000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789708557.881671:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789708557.881676:0:10054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1789708557.881686:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708557.881766:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+2:2394:x1876645357038080:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 148us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708557.881767:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+2:2394:x1876645357037696:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 227us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708557.881777:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1789708557.881783:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:0.0:1789708557.882349:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.882374:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357038208 00000100:00100000:3.0:1789708557.882379:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357038208 00000100:00100000:3.0:1789708557.882420:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789708557.882428:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:0:x1876645357038208:12345-192.168.201.52@tcp:41:mount.lustre.0 00000100:00080000:0.0:1789708557.882445:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1789708557.882460:0:6483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789708557.882511:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:0:x1876645357038208:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.882517:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:2.0:1789708557.882665:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708557.882696:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357038336 00000100:00100000:1.0:1789708557.882700:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357038336 00000100:00100000:2.0:1789708557.882711:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708557.882742:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357037824 00000100:00080000:0.0:1789708557.882745:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708557.882747:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357037824 00000100:00100000:3.0:1789708557.882750:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1789708557.882765:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+7:8725:x1876645357038336:12345-192.168.201.52@tcp:41:mount.lustre.0 00000100:00100000:1.0:1789708557.882783:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000004:00000024:3.0:1789708557.882784:0:6484:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789708557.882790:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+7:0:x1876645357037824:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789708557.882803:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789708557.882834:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+7:8725:x1876645357038336:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708557.882839:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+7:0:x1876645357037824:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 47us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.882846:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:1.0:1789708557.882854:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1789708557.883416:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.883451:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357038464 00000100:00100000:3.0:1789708557.883455:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357038464 00000100:00100000:3.0:1789708557.883478:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1789708557.883482:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:8725:x1876645357038464:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789708557.883515:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:8725:x1876645357038464:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 31us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.883521:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:0.0:1789708557.884168:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708557.884195:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708557.884211:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357038592 00000100:00100000:2.0:1789708557.884216:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357038592 00000100:00100000:3.0:1789708557.884229:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357038720 00000100:00100000:0.0:1789708557.884238:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.884240:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357038720 00000100:00100000:2.0:1789708557.884249:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1789708557.884257:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2394:x1876645357038592:12345-192.168.201.52@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789708557.884278:0:9146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357038848 00000100:00100000:0.0:1789708557.884284:0:9146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357038848 00000100:00100000:1.0:1789708557.884304:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00010000:00080000:2.0:1789708557.884311:0:8399:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0bd23bbf-17fc-4232-922d-5f674c08c0de@192.168.201.52@tcp t0 exp 0000000000000000 cur 128 last 0 00000100:00100000:1.0:1789708557.884314:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1876645357038720:12345-192.168.201.52@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789708557.884321:0:9146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1789708557.884333:0:9146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:8725:x1876645357038848:12345-192.168.201.52@tcp:900:mount.lustre.0 00000020:00000080:2.0:1789708557.884339:0:8399:0:(genops.c:1384:class_connect()) connect: client 0bd23bbf-17fc-4232-922d-5f674c08c0de, cookie 0xf45f43947e47ce12 00010000:00080000:1.0:1789708557.884341:0:8397:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0bd23bbf-17fc-4232-922d-5f674c08c0de@192.168.201.52@tcp t0 exp 0000000000000000 cur 128 last 0 00002000:00100000:2.0:1789708557.884349:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0bd23bbf-17fc-4232-922d-5f674c08c0de/ffff9bee3f9f1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789708557.884362:0:8399:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:1.0:1789708557.884368:0:8397:0:(genops.c:1384:class_connect()) connect: client 0bd23bbf-17fc-4232-922d-5f674c08c0de, cookie 0xf45f43947e47ce19 00002000:00100000:1.0:1789708557.884376:0:8397:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0bd23bbf-17fc-4232-922d-5f674c08c0de/ffff9bed08565000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1789708557.884381:0:9146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:8725:x1876645357038848:12345-192.168.201.52@tcp:900:mount.lustre.0 Request processed in 49us (141us total) trans 0 rc 0/0 00002000:00100000:1.0:1789708557.884390:0:8397:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789708557.884393:0:9146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00002000:00080000:2.0:1789708557.884415:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:1.0:1789708557.884449:0:8397:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789708557.884453:0:8399:0:(import.c:65:import_set_state_nolock()) ffff9bee3f9f3800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789708557.884473:0:8397:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa12000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708557.884500:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2394:x1876645357038592:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 241us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708557.884510:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:1.0:1789708557.884513:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2394:x1876645357038720:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 197us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708557.884521:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1789708557.885126:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708557.885151:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357038976 00000100:00100000:3.0:1789708557.885155:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357038976 00000100:00100000:3.0:1789708557.885193:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:3.0:1789708557.885201:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:8725:x1876645357038976:12345-192.168.201.52@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789708557.885254:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789708557.885309:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:8725:x1876645357038976:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 108us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708557.885317:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00010000:00010000:0.0:1789708557.926396:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708558.950436:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708559.206427:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365476608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708559.206491:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708559.206530:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365476608 00000100:00100000:3.0:1789708559.206540:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365476608 00000100:00100000:3.0:1789708559.206609:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708559.206622:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365476608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789708559.206712:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789708559.206763:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365476608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708559.206769:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789708559.206811:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365476608:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1789708559.547134:0:12149:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789708559.974364:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708560.230399:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365476736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708560.230467:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708560.230508:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365476736 00000100:00100000:1.0:1789708560.230516:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365476736 00000100:00080000:3.0:1789708560.230549:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708560.230567:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789708560.230577:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365476736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789708560.230616:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789708560.230672:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365476736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708560.230680:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789708560.230708:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3622fb80 x1876645365476736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708560.230727:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365476736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708560.231339:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365476864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708560.231370:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708560.231374:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365476992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708560.231414:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365477376:0@lo:400:kworker.0 00000100:00100000:0.0:1789708560.231429:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708560.231449:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708560.231471:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365477504:0@lo:400:kworker.0 00000100:00100000:2.0:1789708560.231475:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365477248:0@lo:400:kworker.0 00000100:00100000:1.0:1789708560.231481:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365477888:0@lo:400:kworker.0 00000100:00100000:0.0:1789708560.231510:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708560.231520:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708560.231535:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708560.231538:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365478016:0@lo:400:kworker.0 00000100:00100000:3.0:1789708560.231548:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365477376 00000100:00100000:1.0:1789708560.231548:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876645365478400:0@lo:400:kworker.0 00000100:00100000:3.0:1789708560.231554:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365477376 00000100:00100000:2.0:1789708560.231573:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365477760:0@lo:400:kworker.0 00000100:00100000:0.0:1789708560.231576:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708560.231590:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365477888 00000100:00100000:3.0:1789708560.231593:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365477888 00000100:00100000:1.0:1789708560.231608:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365477120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708560.231618:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365478528:0@lo:400:kworker.0 00000100:00100000:2.0:1789708560.231619:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708560.231625:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365478016 00000100:00100000:3.0:1789708560.231629:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365478016 00000100:00100000:1.0:1789708560.231648:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708560.231649:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365478272:0@lo:400:kworker.0 00000100:00100000:3.0:1789708560.231653:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789708560.231658:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708560.231667:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365477376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708560.231673:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365477632:0@lo:400:kworker.0 00000100:00100000:2.0:1789708560.231685:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708560.231701:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365478528 00000100:00100000:0.0:1789708560.231706:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365478528 00000100:00100000:1.0:1789708560.231712:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708560.231719:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365477376:12345-0@lo:400:kworker.0 Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708560.231728:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789708560.231729:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365477248 00000100:00100000:2.0:1789708560.231735:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365477248 00000100:00100000:1.0:1789708560.231735:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365478144:0@lo:400:kworker.0 00000100:00100000:0.0:1789708560.231745:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365477632 00000100:00100000:3.0:1789708560.231750:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789708560.231751:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365477632 00000100:00100000:3.0:1789708560.231764:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365477888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708560.231765:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708560.231783:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789708560.231792:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789708560.231798:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365478016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708560.231804:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365476864 00000100:00100000:2.0:1789708560.231806:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3616:x1876645365477248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708560.231810:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365476864 00000100:00100000:3.0:1789708560.231821:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365477888:12345-0@lo:400:kworker.0 Request processed in 62us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708560.231835:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789708560.231840:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365476992 00000100:00100000:1.0:1789708560.231844:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365476992 00000100:00100000:0.0:1789708560.231856:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365478016:12345-0@lo:400:kworker.0 Request processed in 63us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708560.231860:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365477120 00000100:00100000:3.0:1789708560.231861:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789708560.231863:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3616:x1876645365477248:12345-0@lo:400:kworker.0 Request processed in 59us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708560.231865:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365477120 00000100:00100000:0.0:1789708560.231874:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789708560.231878:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789708560.231880:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365478528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708560.231886:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789708560.231894:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365476864:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708560.231896:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789708560.231906:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365477632:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789708560.231912:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708560.231922:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365478528:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708560.231924:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365477504 00000100:00100000:3.0:1789708560.231929:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789708560.231931:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365477504 00000100:00100000:1.0:1789708560.231955:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365476864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (584us total) trans 0 rc 0/0 00000100:00080000:3.0:1789708560.231956:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789708560.231961:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708560.231962:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365477632:12345-0@lo:400:kworker.0 Request processed in 57us (249us total) trans 0 rc 0/0 00000100:00080000:3.0:1789708560.231965:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708560.231967:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365477760 00000100:00100000:1.0:1789708560.231967:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789708560.231970:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708560.231972:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365477760 00000100:00100000:0.0:1789708560.231979:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789708560.231988:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365478272 00000100:00100000:3.0:1789708560.231993:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365478272 00000100:00100000:1.0:1789708560.231993:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789708560.231999:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789708560.232009:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365476992:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708560.232014:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365477504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708560.232017:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789708560.232024:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365478144 00000100:00100000:3.0:1789708560.232027:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365478144 00000100:00100000:0.0:1789708560.232031:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365477760:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789708560.232041:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708560.232049:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789708560.232062:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365477504:12345-0@lo:400:kworker.0 Request processed in 52us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708560.232063:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876645365478272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708560.232077:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789708560.232088:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365477760:12345-0@lo:400:kworker.0 Request processed in 59us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708560.232090:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365476992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708560.232101:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789708560.232106:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789708560.232107:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789708560.232112:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3615:x1876645365478144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708560.232125:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365478272:12345-0@lo:400:kworker.0 Request processed in 67us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708560.232128:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708560.232139:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789708560.232143:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3615:x1876645365477120:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708560.232152:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3615:x1876645365478144:12345-0@lo:400:kworker.0 Request processed in 43us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708560.232155:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365477632:0@lo:400:kworker.0 00002000:00000024:1.0:1789708560.232157:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708560.232160:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789708560.232178:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab1c00 x1876645365478144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708560.232189:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365478144:0@lo:400:kworker.0 00000100:00100000:1.0:1789708560.232201:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365477120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708560.232208:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789708560.232213:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365477248:0@lo:400:kworker.0 00010000:00080000:0.0:1789708560.232225:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3622c000 x1876645365477120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708560.232228:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365477760:0@lo:400:kworker.0 00010000:00080000:2.0:1789708560.232245:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab1180 x1876645365478272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708560.232245:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708560.232249:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365477120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708560.232281:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365478272:0@lo:400:kworker.0 00000100:00100000:2.0:1789708560.232318:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365478400 00000100:00100000:2.0:1789708560.232321:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365478400 00000100:00100000:0.0:1789708560.232327:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365477504:0@lo:400:kworker.0 00010000:00080000:0.0:1789708560.232355:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab2680 x1876645365478016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708560.232356:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708560.232367:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365478016:0@lo:400:kworker.0 00000100:00100000:2.0:1789708560.232368:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876645365478400:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789708560.232382:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab2300 x1876645365478528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708560.232403:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365478528:0@lo:400:kworker.0 00010000:00080000:0.0:1789708560.232418:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09883100 x1876645365476992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708560.232432:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365476992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708560.232457:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876645365478400:12345-0@lo:400:kworker.0 Request processed in 91us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708560.232461:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876645365478400:0@lo:400:kworker.0 00000100:00100000:2.0:1789708560.232465:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789708560.232478:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708560.232487:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365477376:0@lo:400:kworker.0 00010000:00080000:1.0:1789708560.232499:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09a1bb80 x1876645365476864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708560.232513:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365476864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708560.232538:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365477888:0@lo:400:kworker.0 00010000:00010000:3.0:1789708560.998358:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708561.254393:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365478656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789708561.254451:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708561.254491:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365478656 00000100:00100000:2.0:1789708561.254501:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365478656 00000100:00100000:2.0:1789708561.254552:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789708561.254563:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365478656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789708561.254596:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789708561.254662:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365478656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708561.254670:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789708561.254691:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365478656:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1789708561.696286:0:12463:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708561.696452:0:12463:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708562.022420:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789708562.290023:0:12560:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708562.290151:0:12560:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1789708562.870052:0:12658:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708562.870185:0:12658:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708563.047553:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708563.166877:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708563.166914:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357039104 00000100:00100000:1.0:1789708563.166919:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708563.166925:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357039104 00000100:00100000:1.0:1789708563.166951:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708563.166964:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357039232 00000100:00100000:3.0:1789708563.166970:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 281 00000100:00100000:2.0:1789708563.166970:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357039232 00000100:00100000:3.0:1789708563.166980:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:2397:x1876645357039104:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708563.166997:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708563.167022:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357039488 00000100:00100000:2.0:1789708563.167032:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357039488 00000100:00100000:1.0:1789708563.167037:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708563.167042:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:2397:x1876645357039104:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708563.167048:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 281 00000100:00100000:2.0:1789708563.167061:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357039360 00000100:00100000:2.0:1789708563.167064:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357039360 00000100:00100000:2.0:1789708563.167085:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1789708563.167092:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:2398:x1876645357039232:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708563.167128:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:2398:x1876645357039232:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 36us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708563.167136:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1789708563.167154:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1789708563.167162:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2398:x1876645357039488:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708563.167174:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:1.0:1789708563.167187:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357039360:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708563.167193:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2398:x1876645357039488:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 32us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708563.167198:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00080000:2.0:1789708563.167218:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708563.167222:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708563.167228:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357039360:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 44us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708563.167238:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:1.0:1789708563.167384:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357039744 00000100:00100000:1.0:1789708563.167389:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357039744 00000100:00080000:2.0:1789708563.167422:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708563.167445:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:1.0:1789708563.167456:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2398:x1876645357039744:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708563.167510:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2398:x1876645357039744:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 53us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708563.167518:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1789708563.167536:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708563.167556:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357039616 00000100:00100000:2.0:1789708563.167560:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357039616 00000100:00100000:2.0:1789708563.167591:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00080000:1.0:1789708563.167593:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708563.167599:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2397:x1876645357039616:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708563.167609:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708563.167631:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2397:x1876645357039616:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708563.167633:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357039872 00000100:00100000:1.0:1789708563.167639:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357039872 00000100:00100000:2.0:1789708563.167640:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:1.0:1789708563.167681:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1789708563.167688:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2397:x1876645357039872:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708563.167719:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2397:x1876645357039872:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 32us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708563.167733:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00080000:1.0:1789708563.167751:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1789708563.303077:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0bd23bbf-17fc-4232-922d-5f674c08c0de 00000001:00100000:1.0:1789708563.303105:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0bd23bbf-17fc-4232-922d-5f674c08c0de 00000001:00100000:2.0:1789708563.303121:0:9480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0bd23bbf-17fc-4232-922d-5f674c08c0de 00000001:00100000:2.0:1789708563.303129:0:9480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000020:00000080:2.0:1789708563.303132:0:9480:0:(genops.c:885:class_export_put()) final put ffff9bee3fa70800/68824747-448a-469b-b2cf-e27bc037ded7 00000020:00000080:1.0:1789708563.303165:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa70800/68824747-448a-469b-b2cf-e27bc037ded7 for lustre-OST0001 00000020:00000080:1.0:1789708563.303205:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3fa77000 for lustre-OST0001 00000001:00100000:0.0:1789708563.303880:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0bd23bbf-17fc-4232-922d-5f674c08c0de 00000001:00100000:0.0:1789708563.303885:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000020:00000080:0.0:1789708563.303887:0:8392:0:(genops.c:885:class_export_put()) final put ffff9bed08bff000/68824747-448a-469b-b2cf-e27bc037ded7 00000020:00000080:1.0:1789708563.303921:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08bff000/68824747-448a-469b-b2cf-e27bc037ded7 for lustre-OST0000 00000020:00000080:1.0:1789708563.303950:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed08bf8800 for lustre-OST0000 00000020:00000004:2.0:1789708563.486471:0:12755:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708563.486621:0:12755:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708564.070348:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789708564.072304:0:12852:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708564.072516:0:12852:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789708564.326409:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708564.326431:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365478784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708564.326494:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708564.326543:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365478784 00000100:00100000:2.0:1789708564.326553:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365478784 00000100:00100000:2.0:1789708564.326599:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789708564.326609:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365478784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789708564.326641:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789708564.326690:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365478784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708564.326697:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789708564.326736:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365478784:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789708565.094386:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708565.167581:0:12996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789708565.350420:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365479040:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.350435:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365479168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708565.350485:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365479552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708565.350513:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365479424:0@lo:400:kworker.0 00000100:00100000:1.0:1789708565.350523:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708565.350524:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708565.350549:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708565.350559:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365479040 00000100:00100000:2.0:1789708565.350567:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365479040 00000100:00100000:1.0:1789708565.350577:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365478912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708565.350578:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365479936:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.350579:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365479296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708565.350615:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789708565.350617:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708565.350629:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365479040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708565.350632:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708565.350638:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365480448:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.350650:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365479424 00000100:00100000:0.0:1789708565.350654:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365479424 00000100:00100000:3.0:1789708565.350678:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708565.350678:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365479680:0@lo:400:kworker.0 00000100:00100000:2.0:1789708565.350688:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365479040:12345-0@lo:400:kworker.0 Request processed in 62us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708565.350690:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789708565.350700:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789708565.350702:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365479424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708565.350703:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365480960:0@lo:400:kworker.0 00000100:00100000:1.0:1789708565.350728:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708565.350736:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708565.350742:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365479936 00000100:00100000:2.0:1789708565.350747:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365479936 00000100:00100000:0.0:1789708565.350751:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365479424:12345-0@lo:400:kworker.0 Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708565.350756:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708565.350764:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365480192:0@lo:400:kworker.0 00000100:00100000:2.0:1789708565.350778:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365479680 00000100:00100000:3.0:1789708565.350781:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365479424:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.350781:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365479168 00000100:00100000:2.0:1789708565.350782:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365479680 00000100:00100000:0.0:1789708565.350786:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365479168 00000100:00100000:1.0:1789708565.350799:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708565.350803:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789708565.350813:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365479936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.350815:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365478912 00000100:00100000:0.0:1789708565.350819:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365478912 00000100:00100000:3.0:1789708565.350822:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365480448 00000100:00100000:3.0:1789708565.350827:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365480448 00000100:00100000:1.0:1789708565.350829:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365480704:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.350839:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789708565.350849:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365479168:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708565.350867:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365480960 00000100:00100000:2.0:1789708565.350867:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365479936:12345-0@lo:400:kworker.0 Request processed in 54us (245us total) trans 0 rc 0/0 00002000:00000024:0.0:1789708565.350868:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789708565.350869:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708565.350877:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365480960 00000100:00100000:2.0:1789708565.350886:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789708565.350904:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789708565.350907:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708565.350912:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365479168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708565.350914:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365480448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708565.350914:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365479680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708565.350915:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365479040:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.350924:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789708565.350940:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789708565.350942:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789708565.350947:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365478912:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708565.350959:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365479680:12345-0@lo:400:kworker.0 Request processed in 47us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708565.350960:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365480448:12345-0@lo:400:kworker.0 Request processed in 45us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708565.350962:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365479808:0@lo:400:kworker.0 00002000:00000024:0.0:1789708565.350963:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708565.350972:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708565.350972:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789708565.350989:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708565.350998:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365480960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708565.351012:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365479936:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.351014:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365478912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708565.351022:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708565.351027:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789708565.351030:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bda680 x1876645365480448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708565.351034:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365480960:12345-0@lo:400:kworker.0 Request processed in 38us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708565.351042:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789708565.351042:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365480448:0@lo:400:kworker.0 00000100:00100000:1.0:1789708565.351052:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365480320:0@lo:400:kworker.0 00000100:00100000:3.0:1789708565.351069:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789708565.351071:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bdaa00 x1876645365480960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708565.351073:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365480192 00000100:00100000:0.0:1789708565.351078:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365480192 00000100:00100000:2.0:1789708565.351085:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365480960:0@lo:400:kworker.0 00000100:00100000:1.0:1789708565.351086:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708565.351092:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876645365480064:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.351111:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365480704 00000100:00100000:0.0:1789708565.351115:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365480704 00000100:00100000:1.0:1789708565.351117:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365480832:0@lo:400:kworker.0 00000100:00100000:3.0:1789708565.351124:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708565.351137:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365479552 00000100:00100000:2.0:1789708565.351142:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365479552 00000100:00100000:3.0:1789708565.351143:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365480576:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.351146:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365479808 00000100:00100000:0.0:1789708565.351152:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365479808 00000100:00100000:1.0:1789708565.351156:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708565.351167:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789708565.351170:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708565.351177:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365479552:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708565.351181:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365480064 00000100:00100000:0.0:1789708565.351186:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365480064 00002000:00000024:2.0:1789708565.351188:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708565.351207:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365480576 00000100:00100000:0.0:1789708565.351210:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365480576 00000100:00100000:3.0:1789708565.351212:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365480320 00000100:00100000:1.0:1789708565.351212:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365479680:0@lo:400:kworker.0 00000100:00100000:3.0:1789708565.351219:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365480320 00000100:00100000:2.0:1789708565.351226:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365479552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708565.351231:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789708565.351236:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789708565.351237:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab1180 x1876645365478912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708565.351242:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365480192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708565.351245:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365480832 00000100:00100000:3.0:1789708565.351251:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365480832 00000100:00100000:1.0:1789708565.351285:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365478912:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789708565.351289:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee048f2d80 x1876645365479552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708565.351314:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789708565.351318:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365479552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708565.351320:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365480192:12345-0@lo:400:kworker.0 Request processed in 80us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708565.351326:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365480320:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789708565.351332:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09b83100 x1876645365480192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708565.351332:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789708565.351345:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365480192:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.351353:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789708565.351362:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365480704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708565.351367:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708565.351368:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365480320:12345-0@lo:400:kworker.0 Request processed in 46us (286us total) trans 0 rc 0/0 00010000:00080000:1.0:1789708565.351374:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bd9180 x1876645365480320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708565.351378:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789708565.351378:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365480832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708565.351392:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365480320:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.351395:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365480704:12345-0@lo:400:kworker.0 Request processed in 35us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708565.351402:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1789708565.351413:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bd9500 x1876645365480704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708565.351419:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789708565.351425:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365480832:12345-0@lo:400:kworker.0 Request processed in 48us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708565.351430:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789708565.351433:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365479808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708565.351435:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365480704:0@lo:400:kworker.0 00000100:00100000:2.0:1789708565.351440:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708565.351441:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876645365480064:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789708565.351472:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bda300 x1876645365480832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708565.351476:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365479808:12345-0@lo:400:kworker.0 Request processed in 45us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708565.351480:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789708565.351491:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876645365480064:12345-0@lo:400:kworker.0 Request processed in 51us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708565.351492:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365480576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.351495:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789708565.351497:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365480832:0@lo:400:kworker.0 00000100:00100000:3.0:1789708565.351504:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789708565.351533:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365480576:12345-0@lo:400:kworker.0 Request processed in 43us (362us total) trans 0 rc 0/0 00000100:00080000:3.0:1789708565.351534:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708565.351537:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365479808:0@lo:400:kworker.0 00000100:00080000:3.0:1789708565.351539:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708565.351539:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789708565.351544:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708565.351547:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1789708565.351549:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708565.351573:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876645365480064:0@lo:400:kworker.0 00000100:00100000:2.0:1789708565.351580:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365479296 00010000:00080000:0.0:1789708565.351583:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09a19180 x1876645365479168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708565.351585:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365479296 00000100:00100000:3.0:1789708565.351590:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365480576:0@lo:400:kworker.0 00000100:00100000:0.0:1789708565.351602:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365479168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708565.351617:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789708565.351626:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365479296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708565.351637:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708565.351666:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365479296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708565.351670:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789708565.351697:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee048f0700 x1876645365479296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708565.351722:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365479296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789708566.118429:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789708566.227991:0:13143:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff00d5faa0 20000000:00000080:2.0:1789708566.228008:0:13143:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bed08bbf000 uarg=0000000000000000 20000000:01000000:2.0:1789708566.228048:0:13143:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789708566.228054:0:13143:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789708566.228058:0:13143:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789708566.228447:0:13144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789708566.228540:0:13143:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789708566.231175:0:13143:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789708566.231194:0:13143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231208:0:13143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee0165a600/0xf45f43947e47cdb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de86 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231214:0:13143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cdbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cdb7 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231219:0:13143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01509e00/0xf45f43947e47cdcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cdc5 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231223:0:13143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01509c00/0xf45f43947e47cdda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cdd3 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231227:0:13143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee00030a00/0xf45f43947e47cde8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cde1 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231231:0:13143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee029c9600/0xf45f43947e47cdfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dec5 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231235:0:13143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231302:0:13143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee029c9600/0xf45f43947e47cdfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dec5 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231321:0:13143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee029c9600/0xf45f43947e47cdfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dec5 expref: 12 pid: 6477 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.231332:0:13143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481088:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708566.231412:0:13143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee00030a00/0xf45f43947e47cde8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cde1 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231418:0:13143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee00030a00/0xf45f43947e47cde8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cde1 expref: 23 pid: 6477 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.231424:0:13143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481216:0@lo:104: 00000100:00100000:0.0:1789708566.231454:0:13143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708566.231482:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365481216 00010000:00010000:0.0:1789708566.231483:0:13143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01509c00/0xf45f43947e47cdda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cdd3 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708566.231492:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365481216 00010000:00010000:0.0:1789708566.231495:0:13143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee01509c00/0xf45f43947e47cdda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cdd3 expref: 23 pid: 6478 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.231505:0:13143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481344:0@lo:104: 00000100:00100000:0.0:1789708566.231531:0:13143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708566.231549:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365481344 00000100:00100000:1.0:1789708566.231554:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365481344 00000100:00100000:3.0:1789708566.231558:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1789708566.231566:0:13143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01509e00/0xf45f43947e47cdcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cdc5 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231576:0:13143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee01509e00/0xf45f43947e47cdcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cdc5 expref: 23 pid: 6479 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.231586:0:13143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481472:0@lo:104: 00000100:00100000:1.0:1789708566.231591:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789708566.231602:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:13143:x1876645365481344:12345-0@lo:104: 00000100:00100000:0.0:1789708566.231613:0:13143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708566.231615:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708566.231628:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:13143:x1876645365481216:12345-0@lo:104: 00010000:00010000:3.0:1789708566.231638:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708566.231640:0:9489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365481472 00000100:00100000:2.0:1789708566.231647:0:9489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365481472 00010000:00010000:0.0:1789708566.231655:0:13143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cdbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47cdb7 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231663:0:13143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cdbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47cdb7 expref: 23 pid: 6477 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.231671:0:13143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481600:0@lo:104: 00000100:00100000:2.0:1789708566.231683:0:9489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1789708566.231683:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789708566.231691:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789708566.231693:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+5:13143:x1876645365481344:12345-0@lo:104: Request processed in 92us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708566.231700:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+5:13143:x1876645365481216:12345-0@lo:104: Request processed in 131us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708566.231702:0:13143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708566.231707:0:9489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+5:13143:x1876645365481472:12345-0@lo:104: 00000100:00100000:1.0:1789708566.231712:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789708566.231719:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1789708566.231721:0:9489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.231733:0:13143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee0165a600/0xf45f43947e47cdb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de86 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708566.231735:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365481600 00000100:00100000:3.0:1789708566.231740:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365481600 00010000:00010000:0.0:1789708566.231745:0:13143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee0165a600/0xf45f43947e47cdb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de86 expref: 12 pid: 6479 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.231747:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789708566.231756:0:13143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481728:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708566.231758:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708566.231767:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1789708566.231771:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508c00 already unused, calling callback (ffffffffc13d2d20) 00000100:00100000:3.0:1789708566.231776:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:13143:x1876645365481600:12345-0@lo:104: 00010000:00010000:2.0:1789708566.231777:0:9489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:1.0:1789708566.231778:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708566.231784:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.231787:0:13143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708566.231790:0:9489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:13143:x1876645365481472:12345-0@lo:104: Request processed in 87us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708566.231793:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708566.231807:0:9489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 10000000:00010000:1.0:1789708566.231810:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.231810:0:13143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481216:0@lo:104: 10000000:01000000:1.0:1789708566.231821:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789708566.231829:0:13143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481344:0@lo:104: 00010000:00010000:3.0:1789708566.231835:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789708566.231841:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:13143:x1876645365481600:12345-0@lo:104: Request processed in 68us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708566.231846:0:13143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481472:0@lo:104: 00010000:00010000:2.0:1789708566.231852:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1789708566.231859:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1789708566.231859:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.231862:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.231866:0:13143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481600:0@lo:104: 00010000:00010000:2.0:1789708566.231879:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509200 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:1.0:1789708566.231880:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789708566.231885:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708566.231895:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708566.231903:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.231907:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708566.231909:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789708566.231912:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789708566.231921:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01508c00/0xf45f43947e47cdd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cdda expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.231925:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365481856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708566.231940:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.231943:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708566.231950:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708566.231952:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789708566.231961:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708566.231964:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee00030800 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:1.0:1789708566.231968:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.231975:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708566.231978:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708566.231984:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708566.231991:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789708566.231996:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708566.232005:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708566.232006:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01509200/0xf45f43947e47cde1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cde8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.232019:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708566.232025:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509000 already unused, calling callback (ffffffffc13d2d20) 00000100:00100000:0.0:1789708566.232027:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365481984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708566.232031:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708566.232034:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708566.232039:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708566.232039:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708566.232049:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708566.232050:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.232061:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708566.232063:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365481856 00000100:00100000:2.0:1789708566.232070:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365481856 00010000:00010000:1.0:1789708566.232073:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee00030800/0xf45f43947e47cdc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cdcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.232087:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789708566.232089:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708566.232093:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01509c00/0xf45f43947e47cdda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cdd3 expref: 24 pid: 6478 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.232094:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365482112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708566.232095:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1789708566.232097:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.232099:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708566.232117:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708566.232123:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708566.232127:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789708566.232129:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365481984 00000100:00100000:0.0:1789708566.232134:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708566.232137:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365481984 00000100:00100000:2.0:1789708566.232138:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789708566.232150:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3615:x1876645365481856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708566.232153:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708566.232160:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708566.232160:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee00030a00/0xf45f43947e47cde8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cde1 expref: 25 pid: 6477 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.232167:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365482112 00000100:00100000:0.0:1789708566.232172:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365482112 00010000:00010000:2.0:1789708566.232173:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708566.232177:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708566.232182:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01509c00/0xf45f43947e47cdda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cdd3 expref: 26 pid: 6478 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.232189:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01509e00/0xf45f43947e47cdcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cdc5 expref: 26 pid: 6479 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708566.232191:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47cdb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47cdbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708566.232196:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1789708566.232202:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01509c00/0xf45f43947e47cdda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cdd3 expref: 26 pid: 6478 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708566.232212:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+26:3617:x1876645365481984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708566.232225:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708566.232226:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1789708566.232227:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708566.232228:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708566.232229:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509c00/0xf45f43947e47cdda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cdd3 expref: 26 pid: 6478 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708566.232232:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708566.232237:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee00030a00/0xf45f43947e47cde8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cde1 expref: 26 pid: 6477 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708566.232241:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708566.232243:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3617:x1876645365482112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708566.232246:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708566.232252:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee00030a00/0xf45f43947e47cde8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cde1 expref: 25 pid: 6477 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.232295:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708566.232301:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01509e00/0xf45f43947e47cdcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cdc5 expref: 25 pid: 6479 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708566.232321:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3615:x1876645365481856:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (359us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708566.232321:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee00030a00/0xf45f43947e47cde8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cde1 expref: 25 pid: 6477 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.232321:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01509e00/0xf45f43947e47cdcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cdc5 expref: 25 pid: 6479 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708566.232342:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1789708566.232348:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509e00/0xf45f43947e47cdcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cdc5 expref: 24 pid: 6479 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.232349:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708566.232352:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365482240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708566.232362:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708566.232396:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:3617:x1876645365481984:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708566.232405:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708566.232406:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:3617:x1876645365482112:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708566.232407:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789708566.232416:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365481856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708566.232420:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789708566.232428:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365482240 00000100:00100000:1.0:1789708566.232439:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365482240 00010000:00010000:1.0:1789708566.232456:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cdbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cdb7 expref: 21 pid: 6477 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708566.232491:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789708566.232500:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365482112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708566.232501:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:3616:x1876645365482240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708566.232513:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789708566.232517:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365481984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708566.232519:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cdbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47cdb7 expref: 21 pid: 6477 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.232531:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cdbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47cdb7 expref: 21 pid: 6477 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708566.232538:0:13143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481088:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708566.232544:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ada00/0xf45f43947e47cdbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47cdb7 expref: 21 pid: 6477 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.232554:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708566.232586:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:3616:x1876645365482240:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708566.232591:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789708566.232610:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365482240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708566.232865:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708566.232869:0:13143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13143:1876645365481728:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708566.232894:0:13143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.232909:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357040000 00000100:00100000:0.0:1789708566.232917:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357040000 00000100:00100000:2.0:1789708566.232924:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:0.0:1789708566.232937:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee029c9600/0xf45f43947e47cdfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dec5 expref: 13 pid: 6477 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708566.232970:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357040128 00000100:00100000:1.0:1789708566.232974:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357040128 00000100:00100000:0.0:1789708566.232978:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00010000:00010000:1.0:1789708566.232986:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee0165a600/0xf45f43947e47cdb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de86 expref: 14 pid: 6479 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708566.232990:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:098f9bc4-0284-4f29-9497-0447ce008685+14:2396:x1876645357040000:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708566.233002:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708566.233009:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee029c9600/0xf45f43947e47cdfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dec5 expref: 14 pid: 6477 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708566.233016:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:1.0:1789708566.233026:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:098f9bc4-0284-4f29-9497-0447ce008685+14:2395:x1876645357040128:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708566.233030:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee029c9600/0xf45f43947e47cdfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dec5 expref: 14 pid: 6477 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.233033:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708566.233039:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee0165a600/0xf45f43947e47cdb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de86 expref: 14 pid: 6479 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.233049:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee029c9600/0xf45f43947e47cdfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dec5 expref: 14 pid: 6477 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.233055:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee0165a600/0xf45f43947e47cdb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de86 expref: 14 pid: 6479 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.233068:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee0165a600/0xf45f43947e47cdb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de86 expref: 13 pid: 6479 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.233070:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.233081:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708566.233089:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708566.233095:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.233104:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708566.233113:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:098f9bc4-0284-4f29-9497-0447ce008685+12:2395:x1876645357040128:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 89us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708566.233114:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708566.233122:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00010000:00010000:0.0:1789708566.233131:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.233160:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee0165aa00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708566.233164:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.233172:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.233187:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708566.233198:0:13143:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708566.233199:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708566.233226:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:098f9bc4-0284-4f29-9497-0447ce008685+11:2396:x1876645357040000:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 240us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708566.233234:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00010000:00010000:3.0:1789708566.233240:0:13143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708566.233246:0:13143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee0165aa00/0xf45f43947e47ce20 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708566.374437:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708566.374465:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365482368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789708566.374527:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708566.374569:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365482368 00000100:00100000:0.0:1789708566.374578:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365482368 00000100:00100000:0.0:1789708566.374635:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789708566.374645:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365482368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789708566.374673:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789708566.374713:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365482368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708566.374719:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789708566.374750:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365482368:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789708567.142373:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708567.285074:0:13338:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789708567.326990:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708567.327067:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357040256 00000100:00100000:1.0:1789708567.327077:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357040256 00000100:00100000:1.0:1789708567.327129:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 283 00000100:00100000:1.0:1789708567.327138:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+11:6155:x1876645357040256:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708567.327152:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708567.327168:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188ac800/0xf45f43947e47ce27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715def6 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708567.327190:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ac800/0xf45f43947e47ce27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715def6 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708567.327198:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188ac800/0xf45f43947e47ce27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715def6 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708567.327205:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ac800, rc 0) 00000100:00100000:1.0:1789708567.327247:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357040256:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 111us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708567.327285:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 283 00000100:00100000:2.0:1789708567.328022:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708567.328057:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357040384 00000100:00100000:0.0:1789708567.328061:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357040384 00000100:00100000:0.0:1789708567.328088:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 284 00000100:00100000:0.0:1789708567.328095:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357040384:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.328212:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357040384:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 116us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708567.328219:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 284 00000100:00100000:3.0:1789708567.328823:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708567.328852:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357040512 00000100:00100000:2.0:1789708567.328856:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357040512 00000100:00100000:2.0:1789708567.328886:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 285 00000100:00100000:2.0:1789708567.328895:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357040512:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708567.328995:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357040512:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 102us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708567.329004:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 285 00000100:00100000:2.0:1789708567.330299:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708567.330329:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357040640 00000100:00100000:0.0:1789708567.330335:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357040640 00000100:00100000:0.0:1789708567.330370:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 286 00000100:00100000:0.0:1789708567.330377:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357040640:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708567.330383:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708567.330393:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee0165a000/0xf45f43947e47ce2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715defd expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.330405:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee0165a000/0xf45f43947e47ce2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715defd expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.330413:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee0165a000/0xf45f43947e47ce2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715defd expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.330418:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee0165a000, rc 0) 00000100:00100000:0.0:1789708567.330440:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+13:6155:x1876645357040640:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708567.330447:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 286 00000100:00100000:3.0:1789708567.330966:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708567.330998:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357040768 00000100:00100000:2.0:1789708567.331004:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357040768 00000100:00100000:2.0:1789708567.331035:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 287 00000100:00100000:2.0:1789708567.331044:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:6155:x1876645357040768:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708567.331117:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:6155:x1876645357040768:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708567.331125:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 287 00000100:00100000:3.0:1789708567.331651:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708567.331683:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357040896 00000100:00100000:0.0:1789708567.331689:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357040896 00000100:00100000:0.0:1789708567.331718:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 288 00000100:00100000:0.0:1789708567.331727:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+13:6155:x1876645357040896:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.331815:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+13:6155:x1876645357040896:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 88us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708567.331828:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 288 10000000:01000000:2.0:1789708567.590302:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789708567.590309:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed08a9c000 from 7 10000000:01000000:2.0:1789708567.590313:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708567.590363:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708567.590376:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708567.590399:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708567.590419:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365482496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708567.590471:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708567.590522:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e8930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708567.590542:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365482496 00000100:00100000:1.0:1789708567.590549:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365482496 00000100:00100000:1.0:1789708567.590598:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789708567.590605:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365482496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708567.590617:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708567.590627:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188ace00/0xf45f43947e47ce3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ce35 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708567.590647:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ace00/0xf45f43947e47ce3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ce35 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708567.590657:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188ace00/0xf45f43947e47ce3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ce35 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708567.590667:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ace00, rc 0) 00000100:00100000:1.0:1789708567.590707:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365482496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708567.590713:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789708567.590735:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365482496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708567.590751:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708567.590758:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708567.590815:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365482624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708567.590843:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708567.590856:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e8930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708567.590879:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365482624 00000100:00100000:0.0:1789708567.590885:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365482624 00000100:00100000:0.0:1789708567.590911:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789708567.590919:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365482624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.591010:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365482624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708567.591017:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789708567.591042:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365482624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708567.591083:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365482752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708567.591122:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708567.591146:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e8930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708567.591174:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365482752 00000100:00100000:1.0:1789708567.591178:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365482752 00000100:00100000:1.0:1789708567.591199:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789708567.591204:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365482752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708567.591315:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365482752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708567.591321:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789708567.591330:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365482752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789708567.591863:0:13353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789708567.591945:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789708567.591973:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708567.591981:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.591991:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708567.592008:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789708567.592010:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee2f569800 from 7 10000000:01000000:0.0:1789708567.592013:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708567.592029:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.592036:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.592044:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708567.592058:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365482880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.592092:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708567.592121:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708567.592130:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365482880 00000100:00100000:2.0:1789708567.592136:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365482880 00000100:00100000:2.0:1789708567.592165:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789708567.592170:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365482880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708567.592176:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708567.592182:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47ce4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ce43 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708567.592194:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47ce4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ce43 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708567.592200:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47ce4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ce43 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708567.592205:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc400, rc 0) 00000100:00100000:2.0:1789708567.592229:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365482880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708567.592233:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789708567.592300:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365482880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708567.592312:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.592320:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708567.592357:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.592383:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708567.592405:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708567.592425:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365483008 00000100:00100000:1.0:1789708567.592434:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365483008 00000100:00100000:1.0:1789708567.592454:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789708567.592458:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365483008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708567.592521:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365483008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708567.592529:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789708567.592548:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.592573:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.592596:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708567.592609:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708567.592623:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365483136 00000100:00100000:2.0:1789708567.592627:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365483136 00000100:00100000:2.0:1789708567.592646:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789708567.592650:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365483136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708567.592710:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365483136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708567.592716:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789708567.592735:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789708567.593333:0:13354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789708567.593402:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789708567.593421:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708567.593425:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.593431:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708567.593436:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789708567.593441:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee36337800 from 7 10000000:01000000:0.0:1789708567.593443:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708567.593453:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.593459:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.593466:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708567.593478:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.593504:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708567.593526:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708567.593553:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365483264 00000100:00100000:1.0:1789708567.593559:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365483264 00000100:00100000:1.0:1789708567.593585:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789708567.593591:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365483264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708567.593599:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708567.593607:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee188ad800/0xf45f43947e47ce58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ce51 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708567.593622:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee188ad800/0xf45f43947e47ce58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ce51 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708567.593631:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee188ad800/0xf45f43947e47ce58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ce51 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708567.593638:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ad800, rc 0) 00000100:00100000:1.0:1789708567.593668:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365483264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708567.593674:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789708567.593695:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708567.593702:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.593707:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708567.593732:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.593748:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708567.593760:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708567.593776:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365483392 00000100:00100000:2.0:1789708567.593780:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365483392 00000100:00100000:2.0:1789708567.593806:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789708567.593813:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365483392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708567.593874:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365483392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708567.593879:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789708567.593898:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.593920:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.593943:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708567.593954:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708567.593976:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365483520 00000100:00100000:1.0:1789708567.593980:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365483520 00000100:00100000:1.0:1789708567.594000:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789708567.594004:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365483520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708567.594066:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365483520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708567.594071:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789708567.594088:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789708567.594729:0:13355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789708567.594808:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789708567.594827:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708567.594833:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.594842:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708567.594850:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789708567.594852:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee02bf3800 from 7 10000000:01000000:0.0:1789708567.594854:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708567.594867:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.594874:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.594882:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708567.594893:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.594916:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708567.594939:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708567.594943:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365483648 00000100:00100000:2.0:1789708567.594947:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365483648 00000100:00100000:2.0:1789708567.594968:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789708567.594973:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365483648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708567.594978:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708567.594984:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47ce66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ce5f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708567.595001:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47ce66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ce5f expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708567.595007:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47ce66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ce5f expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708567.595011:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebcc00, rc 0) 00000100:00100000:2.0:1789708567.595033:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365483648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708567.595037:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789708567.595059:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708567.595070:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.595076:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708567.595115:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.595138:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708567.595154:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708567.595172:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365483776 00000100:00100000:1.0:1789708567.595176:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365483776 00000100:00100000:1.0:1789708567.595196:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789708567.595200:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365483776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708567.595247:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365483776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 47us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708567.595280:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789708567.595306:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.595337:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708567.595370:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708567.595388:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708567.595404:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365483904 00000100:00100000:2.0:1789708567.595409:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365483904 00000100:00100000:2.0:1789708567.595437:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789708567.595445:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365483904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708567.595522:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365483904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708567.595538:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789708567.595544:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365483904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789708567.596067:0:13356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789708567.596135:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789708567.596155:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708567.596161:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708567.596170:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708568.166498:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708568.286921:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708568.286957:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708568.286978:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357041024 00000100:00100000:0.0:1789708568.286987:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708568.286990:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357041024 00000100:00100000:2.0:1789708568.287005:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357041152 00000100:00100000:2.0:1789708568.287009:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357041152 00000100:00100000:0.0:1789708568.287021:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708568.287034:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357041280 00000100:00100000:1.0:1789708568.287049:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 301 00000100:00100000:3.0:1789708568.287050:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357041280 00000100:00100000:2.0:1789708568.287053:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357041408 00000100:00100000:2.0:1789708568.287058:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357041408 00000100:00100000:0.0:1789708568.287064:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708568.287065:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:2398:x1876645357041024:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708568.287089:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1789708568.287101:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:2.0:1789708568.287102:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2397:x1876645357041152:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708568.287111:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708568.287112:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357041280:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708568.287132:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:2398:x1876645357041024:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 74us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708568.287136:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2397:x1876645357041152:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 41us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708568.287141:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 301 00000100:00100000:2.0:1789708568.287142:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1789708568.287157:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357041280:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 45us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708568.287159:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357041536 00000100:00100000:0.0:1789708568.287161:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708568.287164:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357041536 00000100:00100000:3.0:1789708568.287173:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:2.0:1789708568.287187:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:3.0:1789708568.287194:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:2.0:1789708568.287198:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357041408:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708568.287206:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357041536:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:1.0:1789708568.287218:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789708568.287224:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708568.287232:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357041408:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 37us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708568.287249:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357041536:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 36us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708568.287256:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:3.0:1789708568.287282:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:1.0:1789708568.287294:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357041664 00000100:00100000:1.0:1789708568.287299:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357041664 00000100:00100000:3.0:1789708568.287316:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357041792 00000100:00100000:3.0:1789708568.287322:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357041792 00000100:00080000:2.0:1789708568.287340:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789708568.287346:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708568.287346:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:1.0:1789708568.287355:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357041664:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708568.287369:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:3.0:1789708568.287377:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357041792:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708568.287396:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357041664:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 41us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708568.287403:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:3.0:1789708568.287485:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357041792:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 110us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708568.287490:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000001:02000400:3.0:1789708568.955783:0:13490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:16:08 (1789708568) === 00000100:00100000:0.0:1789708569.016307:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.016349:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357041920 00000100:00100000:1.0:1789708569.016360:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357041920 00000100:00100000:1.0:1789708569.016410:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:1.0:1789708569.016432:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:68824747-448a-469b-b2cf-e27bc037ded7+6:10486:x1876645357041920:12345-192.168.201.52@tcp:700:mkdir.0 00000100:00100000:1.0:1789708569.016513:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:68824747-448a-469b-b2cf-e27bc037ded7+6:10486:x1876645357041920:12345-192.168.201.52@tcp:700:mkdir.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708569.016521:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789708569.017336:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.017381:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357042176 00000100:00100000:1.0:1789708569.017386:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357042176 00000100:00100000:1.0:1789708569.017422:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1789708569.017430:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+6:10486:x1876645357042176:12345-192.168.201.52@tcp:36:mkdir.0 00010000:00010000:1.0:1789708569.017463:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708569.017491:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebfc00/0xf45f43947e47cc59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de71 expref: 6 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.017511:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed097e1800) 00010000:00010000:1.0:1789708569.017521:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708569.017597:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.017610:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.017620:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.017665:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.017678:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.017682:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018072:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018079:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018083:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708569.018092:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000381a660e reply state 000000002882ea08 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018106:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018112:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847700) 00010000:00010000:1.0:1789708569.018114:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708569.018117:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789708569.018121:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789708569.018126:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018133:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce6d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018140:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018152:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188acc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.018156:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018164:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce6d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018172:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847b00) 00010000:00010000:1.0:1789708569.018174:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708569.018178:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018184:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708569.018197:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000381a660e reply state 000000002882ea08 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018204:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.018207:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bed08847300) 00010000:00010000:1.0:1789708569.018209:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708569.018210:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789708569.018294:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:10486:x1876645357042176:12345-192.168.201.52@tcp:36:mkdir.0 Request processed in 864us (960us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789708569.018300:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1789708569.022062:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.022106:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357042304 00000100:00100000:1.0:1789708569.022114:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357042304 00000100:00100000:1.0:1789708569.022163:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:1.0:1789708569.022182:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:10487:x1876645357042304:12345-192.168.201.52@tcp:101:chmod.0 00010000:00010000:1.0:1789708569.022200:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708569.022216:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ade00/0xf45f43947e47ce82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df04 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.022316:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.022328:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.022337:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708569.022370:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789708569.022374:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708569.022404:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.022436:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ade00/0xf45f43947e47ce82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df04 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.022454:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df04 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.022462:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847900) 00010000:00010000:1.0:1789708569.022465:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708569.022468:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188acc00, rc 0) 00000100:00100000:1.0:1789708569.022513:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+8:10487:x1876645357042304:12345-192.168.201.52@tcp:101:chmod.0 Request processed in 334us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708569.022529:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:0.0:1789708569.023449:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708569.023481:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357042560 00000100:00100000:3.0:1789708569.023486:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357042560 00000100:00100000:3.0:1789708569.023513:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:3.0:1789708569.023519:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+8:10487:x1876645357042560:12345-192.168.201.52@tcp:36:chmod.0 00010000:00010000:3.0:1789708569.023542:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708569.023554:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47ce89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df04 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.023568:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847900) 00010000:00010000:3.0:1789708569.023573:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708569.023585:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.023590:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.023595:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708569.023754:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d52b7b8 reply state 000000000c6155f6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.023766:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.023773:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee03fa9600) 00010000:00010000:3.0:1789708569.023775:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789708569.023783:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789708569.023789:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789708569.023826:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+9:10487:x1876645357042560:12345-192.168.201.52@tcp:36:chmod.0 Request processed in 308us (380us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789708569.023831:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:0.0:1789708569.031577:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.031627:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357042688 00000100:00100000:1.0:1789708569.031635:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357042688 00000100:00100000:1.0:1789708569.031688:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:1.0:1789708569.031699:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+9:10488:x1876645357042688:12345-192.168.201.52@tcp:101:chown.0 00010000:00010000:1.0:1789708569.031719:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708569.031734:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ade00/0xf45f43947e47ce97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df0b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.031787:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad400/0xf45f43947e47ce9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.031799:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad400/0xf45f43947e47ce9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.031806:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad400/0xf45f43947e47ce9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708569.031836:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789708569.031838:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708569.031863:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad400/0xf45f43947e47ce9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.031881:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ade00/0xf45f43947e47ce97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df0b expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.031891:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad400/0xf45f43947e47ce9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df0b expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.031909:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee03fa9600) 00010000:00010000:1.0:1789708569.031911:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708569.031913:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ad400, rc 0) 00000100:00100000:1.0:1789708569.031953:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+10:10488:x1876645357042688:12345-192.168.201.52@tcp:101:chown.0 Request processed in 257us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708569.031958:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1789708569.032878:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.032918:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357042816 00000100:00100000:1.0:1789708569.032925:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357042816 00000100:00100000:1.0:1789708569.032962:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:1.0:1789708569.032982:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+10:10488:x1876645357042816:12345-192.168.201.52@tcp:101:chown.0 00010000:00010000:1.0:1789708569.032991:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708569.033002:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad600/0xf45f43947e47cea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df12 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033039:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ceac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033049:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ceac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033057:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ceac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033067:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47ceb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033075:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47ceb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033093:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47ceb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033155:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47ceba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033164:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47ceba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033171:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47ceba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708569.033196:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789708569.033200:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708569.033211:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47ceba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033222:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ceac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033244:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ceac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033251:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ceac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033257:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ada00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.033284:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ceac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033292:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ceac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033310:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee03fa9600) 00010000:00010000:1.0:1789708569.033314:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708569.033319:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ceac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033326:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ceac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033338:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47ceb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033344:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47ceb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033350:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47ceb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033356:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ac400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.033359:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47ceb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033364:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47ceb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033371:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bed08847300) 00010000:00010000:1.0:1789708569.033374:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708569.033377:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47ceb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033383:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47ceb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033415:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad600/0xf45f43947e47cea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df12 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033427:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47ceba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df12 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.033443:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847700) 00010000:00010000:1.0:1789708569.033445:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708569.033448:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188aca00, rc 0) 00000100:00100000:1.0:1789708569.033481:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+11:10488:x1876645357042816:12345-192.168.201.52@tcp:101:chown.0 Request processed in 502us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708569.033488:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:1.0:1789708569.034356:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708569.034398:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357042944 00000100:00100000:2.0:1789708569.034403:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357042944 00000100:00100000:2.0:1789708569.034430:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1789708569.034435:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:68824747-448a-469b-b2cf-e27bc037ded7+11:10488:x1876645357042944:12345-192.168.201.52@tcp:900:chown.0 00000100:00100000:2.0:1789708569.034485:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:68824747-448a-469b-b2cf-e27bc037ded7+11:10488:x1876645357042944:12345-192.168.201.52@tcp:900:chown.0 Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708569.034490:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789708569.035388:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708569.035426:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357043200 00000100:00100000:3.0:1789708569.035430:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357043200 00000100:00100000:3.0:1789708569.035457:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:3.0:1789708569.035462:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+11:10488:x1876645357043200:12345-192.168.201.52@tcp:36:chown.0 00010000:00010000:3.0:1789708569.035485:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708569.035503:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47ceba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df12 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.035511:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847700) 00010000:00010000:3.0:1789708569.035514:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708569.035524:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.035531:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.035536:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789708569.036655:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1789708569.036696:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036704:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036709:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036713:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188adc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708569.036715:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036720:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708569.036726:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca94c8ae reply state 00000000b0f9510a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036728:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bed08847300) 00010000:00010000:3.0:1789708569.036732:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708569.036740:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.036743:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036745:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ce74 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.036762:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847700) 00010000:00010000:1.0:1789708569.036765:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789708569.036768:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708569.036768:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789708569.036776:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708569.036778:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789708569.036787:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036794:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ac600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708569.036795:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036799:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036805:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847700) 00010000:00010000:3.0:1789708569.036807:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708569.036810:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036814:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47ce7b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036822:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036825:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789708569.036832:0:6484:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:3.0:1789708569.036833:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036838:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708569.036840:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708569.036844:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708569.036850:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+8:10488:x1876645357043200:12345-192.168.201.52@tcp:36:chown.0 Request processed in 1383us (1459us total) trans 4294967301 rc 0/0 00010000:00010000:3.0:1789708569.036852:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee03fa9600) 00010000:00010000:3.0:1789708569.036857:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789708569.036861:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708569.036866:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00010000:00010000:3.0:1789708569.036868:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47ce90 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.036901:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.036911:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.036918:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.036924:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708569.036927:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.036934:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.036943:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847700) 00010000:00010000:0.0:1789708569.036945:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789708569.036948:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.036954:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47cec1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708569.044011:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.044056:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357043328 00000100:00100000:1.0:1789708569.044075:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357043328 00000100:00100000:1.0:1789708569.044126:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1789708569.044135:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+6:10489:x1876645357043328:12345-192.168.201.52@tcp:101:touch.500 00010000:00010000:1.0:1789708569.044153:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708569.044167:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad600/0xf45f43947e47cec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df19 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708569.044712:0:6512:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 504us 00010000:00010000:1.0:1789708569.049435:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cecf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049454:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049466:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049482:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ced6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049490:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ced6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049499:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ced6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049615:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ade00/0xf45f43947e47cedd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049624:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ade00/0xf45f43947e47cedd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049642:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ade00/0xf45f43947e47cedd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708569.049668:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789708569.049671:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708569.049699:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ade00/0xf45f43947e47cedd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049709:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049713:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cecf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049718:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cecf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049722:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ac400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.049725:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cecf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049729:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cecf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049738:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee03fa9600) 00010000:00010000:1.0:1789708569.049740:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708569.049743:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cecf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049747:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cecf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049761:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ced6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049765:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ced6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049769:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ced6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049772:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ada00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.049774:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ced6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049778:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ced6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049783:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bed08847b00) 00010000:00010000:1.0:1789708569.049785:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708569.049787:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ced6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049790:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47ced6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049818:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad600/0xf45f43947e47cec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df19 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049831:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ade00/0xf45f43947e47cedd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df19 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.049844:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847600) 00010000:00010000:1.0:1789708569.049846:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789708569.049848:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ade00, rc 0) 00000100:00100000:1.0:1789708569.049902:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:10489:x1876645357043328:12345-192.168.201.52@tcp:101:touch.500 Request processed in 5768us (5898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708569.049909:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1789708569.051159:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.051197:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357043584 00000100:00100000:1.0:1789708569.051204:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357043584 00000100:00100000:1.0:1789708569.051246:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1789708569.051253:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:10489:x1876645357043584:12345-192.168.201.52@tcp:101:touch.500 00010000:00010000:1.0:1789708569.051286:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708569.051296:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47cee4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df20 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051345:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ceeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051351:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ceeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051356:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ceeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051363:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051367:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051380:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708569.051649:0:6485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789708569.051751:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47cef9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051757:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47cef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051761:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47cef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051779:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ceeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051783:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ceeb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051787:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ceeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051790:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188adc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.051792:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ceeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051796:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ceeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051806:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847600) 00010000:00010000:1.0:1789708569.051807:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708569.051814:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ceeb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051818:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47ceeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708569.051825:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037a68249 reply state 000000001f7b7fd8 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051832:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051836:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9bed08847c00) 00010000:00010000:1.0:1789708569.051837:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708569.051839:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789708569.051853:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47cee4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df20 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051861:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47cef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df20 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.051865:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bed08847300) 00010000:00010000:1.0:1789708569.051867:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708569.051868:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188acc00, rc 0) 00000100:00100000:1.0:1789708569.051895:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+10:10489:x1876645357043584:12345-192.168.201.52@tcp:101:touch.500 Request processed in 643us (739us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789708569.051900:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:0.0:1789708569.053028:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.053068:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357043840 00000100:00100000:1.0:1789708569.053073:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357043840 00000100:00100000:1.0:1789708569.053100:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:1.0:1789708569.053108:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+10:10489:x1876645357043840:12345-192.168.201.52@tcp:36:touch.500 00010000:00010000:1.0:1789708569.053165:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708569.053179:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47cef9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df20 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.053192:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bed08847300) 00010000:00010000:1.0:1789708569.053198:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708569.053221:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.053241:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.053248:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708569.053322:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7e94740 reply state 000000005169f0a0 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.053329:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.053333:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bed08847700) 00010000:00010000:1.0:1789708569.053335:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708569.053336:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708569.053377:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+11:10489:x1876645357043840:12345-192.168.201.52@tcp:36:touch.500 Request processed in 270us (350us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789708569.053385:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:3.0:1789708569.053943:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.053977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357043968 00000100:00100000:1.0:1789708569.053983:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357043968 00000100:00100000:1.0:1789708569.054009:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:1.0:1789708569.054020:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+11:10489:x1876645357043968:12345-192.168.201.52@tcp:101:touch.500 00010000:00010000:1.0:1789708569.054031:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708569.054040:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030800/0xf45f43947e47cf0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df27 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.054067:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030800/0xf45f43947e47cf0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df27 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.054078:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030800/0xf45f43947e47cf0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df27 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.054090:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bed08847700) 00010000:00010000:1.0:1789708569.054091:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708569.054093:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee00030800, rc 0) 00000100:00100000:1.0:1789708569.054119:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+12:10489:x1876645357043968:12345-192.168.201.52@tcp:101:touch.500 Request processed in 100us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708569.054123:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:2.0:1789708569.055056:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.055086:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357044096 00000100:00100000:1.0:1789708569.055090:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357044096 00000100:00100000:1.0:1789708569.055112:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:1.0:1789708569.055116:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2394:x1876645357044096:12345-192.168.201.52@tcp:8:touch.500 00010000:00080000:1.0:1789708569.055139:0:10054:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:1.0:1789708569.055173:0:10054:0:(genops.c:1384:class_connect()) connect: client 68824747-448a-469b-b2cf-e27bc037ded7, cookie 0xf45f43947e47cf15 00002000:00100000:1.0:1789708569.055183:0:10054:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68824747-448a-469b-b2cf-e27bc037ded7/ffff9bed09820000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789708569.055194:0:10054:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789708569.055242:0:10054:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789708569.055284:0:10054:0:(import.c:65:import_set_state_nolock()) ffff9bed09821800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708569.055318:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+6:2394:x1876645357044096:12345-192.168.201.52@tcp:8:touch.500 Request processed in 200us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708569.055322:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:0.0:1789708569.056071:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.056102:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357044224 00000100:00100000:1.0:1789708569.056106:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357044224 00000100:00100000:1.0:1789708569.056148:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:1.0:1789708569.056156:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+6:0:x1876645357044224:12345-192.168.201.52@tcp:2:touch.500 00000100:00080000:2.0:1789708569.056485:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789708569.058362:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1789708569.058368:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000100:00100000:1.0:1789708569.058451:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+5:0:x1876645357044224:12345-192.168.201.52@tcp:2:touch.500 Request processed in 2294us (2378us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789708569.058457:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:3.0:1789708569.059147:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708569.059195:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357044480 00000100:00100000:0.0:1789708569.059200:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357044480 00000100:00100000:0.0:1789708569.059239:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789708569.059247:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+12:10489:x1876645357044480:12345-192.168.201.52@tcp:35:touch.500 00000100:00100000:0.0:1789708569.059424:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+13:10489:x1876645357044480:12345-192.168.201.52@tcp:35:touch.500 Request processed in 177us (278us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789708569.059433:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:3.0:1789708569.064156:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.064190:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357044608 00000100:00100000:1.0:1789708569.064197:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357044608 00000100:00100000:1.0:1789708569.064245:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:1.0:1789708569.064253:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+13:10490:x1876645357044608:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:1.0:1789708569.064290:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708569.064307:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad600/0xf45f43947e47cf1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df2e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.064348:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47cf23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.064357:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47cf23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.064363:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47cf23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708569.064389:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789708569.064398:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708569.064429:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47cf23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.064450:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad600/0xf45f43947e47cf1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df2e expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.064465:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47cf23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df2e expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.064473:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847600) 00010000:00010000:1.0:1789708569.064477:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708569.064480:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ada00, rc 0) 00000100:00100000:1.0:1789708569.064516:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+14:10490:x1876645357044608:12345-192.168.201.52@tcp:101:rm.0 Request processed in 263us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708569.064522:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:3.0:1789708569.065433:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.065464:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357044864 00000100:00100000:1.0:1789708569.065470:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357044864 00000100:00100000:1.0:1789708569.065497:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:1.0:1789708569.065501:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+14:10490:x1876645357044864:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:1.0:1789708569.065508:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708569.065514:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cf2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df35 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708569.065557:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789708569.065619:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cf2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df35 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.065628:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee03fa9600) 00010000:00010000:1.0:1789708569.065634:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708569.065637:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac400/0xf45f43947e47cf2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df35 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.065643:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ac400, rc 0) 00000100:00100000:1.0:1789708569.065666:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+15:10490:x1876645357044864:12345-192.168.201.52@tcp:101:rm.0 Request processed in 165us (234us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789708569.065671:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:3.0:1789708569.066974:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708569.067025:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357044992 00000100:00100000:2.0:1789708569.067029:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357044992 00000100:00100000:2.0:1789708569.067054:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:2.0:1789708569.067061:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+15:10490:x1876645357044992:12345-192.168.201.52@tcp:37:rm.0 00000100:00100000:2.0:1789708569.068433:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+15:10490:x1876645357044992:12345-192.168.201.52@tcp:37:rm.0 Request processed in 1373us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708569.068438:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1789708569.069550:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708569.069589:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357045248 00000100:00100000:0.0:1789708569.069595:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357045248 00000100:00100000:0.0:1789708569.069625:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:0.0:1789708569.069631:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2c799850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+15:10490:x1876645357045248:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:0.0:1789708569.069731:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2c799850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+16:10490:x1876645357045248:12345-192.168.201.52@tcp:35:rm.0 Request processed in 100us (181us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789708569.069739:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1789708569.070609:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.070635:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357045504 00000100:00100000:1.0:1789708569.070640:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357045504 00000100:00100000:1.0:1789708569.070666:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1789708569.070671:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+16:10490:x1876645357045504:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:1.0:1789708569.070680:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708569.070690:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47cf38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df3c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.070731:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47cf3f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.070740:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47cf3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.070746:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47cf3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708569.070752:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789708569.070790:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188acc00/0xf45f43947e47cf38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df3c expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.070810:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47cf3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df3c expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.070815:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847600) 00010000:00010000:1.0:1789708569.070817:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708569.070819:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee188ac600, rc 0) 00000100:00100000:1.0:1789708569.070842:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+18:10490:x1876645357045504:12345-192.168.201.52@tcp:101:rm.0 Request processed in 172us (234us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789708569.070846:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:3.0:1789708569.071637:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.071676:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357045632 00000100:00100000:1.0:1789708569.071682:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357045632 00000100:00100000:1.0:1789708569.071709:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:1.0:1789708569.071715:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+18:10490:x1876645357045632:12345-192.168.201.52@tcp:41:rm.0 00000004:00000024:1.0:1789708569.071741:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1789708569.071769:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+18:10490:x1876645357045632:12345-192.168.201.52@tcp:41:rm.0 Request processed in 55us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708569.071774:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:3.0:1789708569.072349:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.072373:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357045760 00000100:00100000:1.0:1789708569.072378:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357045760 00000100:00100000:1.0:1789708569.072399:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:1.0:1789708569.072404:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+18:10490:x1876645357045760:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:1.0:1789708569.072410:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708569.072418:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47cf4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df43 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072463:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948200/0xf45f43947e47cf54 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072470:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948200/0xf45f43947e47cf54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072475:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948200/0xf45f43947e47cf54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072480:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949000/0xf45f43947e47cf5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072485:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949000/0xf45f43947e47cf5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072489:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949000/0xf45f43947e47cf5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072533:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948600/0xf45f43947e47cf62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072538:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948600/0xf45f43947e47cf62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072542:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948600/0xf45f43947e47cf62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708569.072559:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789708569.072562:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708569.072569:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948600/0xf45f43947e47cf62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072583:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948600/0xf45f43947e47cf62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072589:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948200/0xf45f43947e47cf54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072593:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948200/0xf45f43947e47cf54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072597:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948200/0xf45f43947e47cf54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072600:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.072603:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948200/0xf45f43947e47cf54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072608:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948200/0xf45f43947e47cf54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072614:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847600) 00010000:00010000:1.0:1789708569.072616:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708569.072619:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948200/0xf45f43947e47cf54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072622:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948200/0xf45f43947e47cf54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072628:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949000/0xf45f43947e47cf5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072632:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949000/0xf45f43947e47cf5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072639:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949000/0xf45f43947e47cf5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072642:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.072643:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949000/0xf45f43947e47cf5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072649:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949000/0xf45f43947e47cf5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072656:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9bed08847c00) 00010000:00010000:1.0:1789708569.072658:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708569.072661:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949000/0xf45f43947e47cf5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072666:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949000/0xf45f43947e47cf5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072686:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188adc00/0xf45f43947e47cf4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df43 expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072699:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948600/0xf45f43947e47cf62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df43 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.072704:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bed08847700) 00010000:00010000:1.0:1789708569.072706:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708569.072707:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948600, rc 0) 00000100:00100000:1.0:1789708569.072733:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+19:10490:x1876645357045760:12345-192.168.201.52@tcp:101:rm.0 Request processed in 329us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708569.072743:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1789708569.073572:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.073603:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357046016 00000100:00100000:1.0:1789708569.073607:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357046016 00000100:00100000:1.0:1789708569.073628:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:1.0:1789708569.073632:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+19:10490:x1876645357046016:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:1.0:1789708569.073652:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789708569.073665:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948600/0xf45f43947e47cf62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df43 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073679:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030800/0xf45f43947e47cf0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df27 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073689:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bed08847700) 00010000:00010000:1.0:1789708569.073696:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ada00/0xf45f43947e47cf23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df2e expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073702:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847600) 00010000:00010000:1.0:1789708569.073704:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708569.073711:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948400/0xf45f43947e47cf69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073716:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948400/0xf45f43947e47cf69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073721:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948400/0xf45f43947e47cf69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073725:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073734:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073738:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073769:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948c00/0xf45f43947e47cf77 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073776:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948c00/0xf45f43947e47cf77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073782:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948c00/0xf45f43947e47cf77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789708569.073936:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789708569.073943:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 139883681897ns, next at 140883680394ns, rc = 0 00010000:00010000:1.0:1789708569.073973:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073982:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073990:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.073997:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074002:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074018:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074040:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708569.074051:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948c00/0xf45f43947e47cf77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074055:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948c00/0xf45f43947e47cf77 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074059:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948c00/0xf45f43947e47cf77 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074062:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.074064:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948c00/0xf45f43947e47cf77 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074067:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948c00/0xf45f43947e47cf77 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074072:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bed08847700) 00010000:00010000:1.0:1789708569.074074:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789708569.074076:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948c00/0xf45f43947e47cf77 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074079:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948c00/0xf45f43947e47cf77 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074087:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948400/0xf45f43947e47cf69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074091:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948400/0xf45f43947e47cf69 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074100:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948400/0xf45f43947e47cf69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074103:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.074106:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948400/0xf45f43947e47cf69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.074112:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708569.074113:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948400/0xf45f43947e47cf69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.074123:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074126:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847600) 00010000:00010000:0.0:1789708569.074132:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708569.074133:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708569.074136:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074138:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948400/0xf45f43947e47cf69 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.074145:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074152:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948400/0xf45f43947e47cf69 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.074156:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bed08847700) 00010000:00010000:0.0:1789708569.074159:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000004:00010000:1.0:1789708569.074163:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b3eea60 reply state 00000000619f08d1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.074163:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074172:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708569.074176:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47cf7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.074179:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9bed08847c00) 00010000:00010000:1.0:1789708569.074183:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708569.074185:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789708569.074188:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708569.074190:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708569.074192:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708569.074216:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+18:10490:x1876645357046016:12345-192.168.201.52@tcp:36:rm.0 Request processed in 583us (644us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789708569.074221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:3.0:1789708569.075004:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708569.075043:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357046272 00000100:00100000:2.0:1789708569.075047:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357046272 00000100:00100000:2.0:1789708569.075073:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789708569.075079:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+18:10490:x1876645357046272:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:2.0:1789708569.075166:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+19:10490:x1876645357046272:12345-192.168.201.52@tcp:35:rm.0 Request processed in 88us (162us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789708569.075171:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789708569.075661:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708569.075691:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357046528 00000100:00100000:1.0:1789708569.075695:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357046528 00000100:00100000:1.0:1789708569.075718:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:1.0:1789708569.075722:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+19:10490:x1876645357046528:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:1.0:1789708569.075738:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789708569.075746:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ac600/0xf45f43947e47cf3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df3c expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075756:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ade00/0xf45f43947e47cedd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df19 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075761:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847600) 00010000:00010000:1.0:1789708569.075769:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188ad400/0xf45f43947e47ce9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df0b expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075776:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee03fa9600) 00010000:00010000:1.0:1789708569.075782:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708569.075794:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47cf85 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075802:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47cf85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075809:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47cf85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075820:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075827:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075841:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075874:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47cf93 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075880:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47cf93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075884:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47cf93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708569.075965:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789708569.075979:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47cf93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075983:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47cf93 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075987:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47cf93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075989:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.075991:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47cf93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075995:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47cf93 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.075999:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bed08847900) 00010000:00010000:1.0:1789708569.076001:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789708569.076008:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47cf93 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.076011:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47cf93 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.076021:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47cf85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.076025:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47cf85 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.076028:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47cf85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.076031:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708569.076033:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47cf85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.076036:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47cf85 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.076039:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847300) 00010000:00010000:1.0:1789708569.076040:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708569.076042:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47cf85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.076046:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47cf85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708569.076054:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fab2480d reply state 00000000108dfee1 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.076073:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708569.076079:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bed08847b00) 00010000:00010000:1.0:1789708569.076081:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708569.076083:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708569.076119:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+18:10490:x1876645357046528:12345-192.168.201.52@tcp:36:rm.0 Request processed in 395us (456us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789708569.076126:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00010000:00010000:3.0:1789708569.190382:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708569.447383:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365484032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789708569.447439:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708569.447477:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365484032 00000100:00100000:0.0:1789708569.447487:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365484032 00000100:00100000:0.0:1789708569.447537:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789708569.447550:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365484032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789708569.447585:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1789708569.447639:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365484032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708569.447649:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789708569.447677:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365484032:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789708570.214447:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789708570.264144:0:13637:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:0.0:1789708570.470379:0:9142:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 141280115684ns, next at 142280112047ns, rc = 0 00000100:00100000:1.0:1789708570.470392:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365484288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708570.470395:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365484160:0@lo:400:kworker.0 00000100:00100000:0.0:1789708570.470410:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365484416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708570.470460:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708570.470461:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708570.470494:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365484544:0@lo:400:kworker.0 00000100:00100000:0.0:1789708570.470503:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708570.470514:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365484800:0@lo:400:kworker.0 00000100:00100000:2.0:1789708570.470517:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365484672:0@lo:400:kworker.0 00000100:00100000:0.0:1789708570.470529:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365484928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708570.470544:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708570.470551:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708570.470558:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365484288 00000100:00100000:0.0:1789708570.470559:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708570.470567:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365484288 00000100:00100000:3.0:1789708570.470584:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365485056:0@lo:400:kworker.0 00000100:00100000:0.0:1789708570.470593:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365485440:0@lo:400:kworker.0 00000100:00100000:2.0:1789708570.470594:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365485184:0@lo:400:kworker.0 00000100:00100000:1.0:1789708570.470612:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365484416 00000100:00100000:1.0:1789708570.470615:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365484416 00000100:00100000:3.0:1789708570.470623:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708570.470629:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708570.470631:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365484928 00000100:00100000:2.0:1789708570.470634:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708570.470635:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365484928 00000100:00100000:3.0:1789708570.470655:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365485568:0@lo:400:kworker.0 00000100:00100000:1.0:1789708570.470660:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789708570.470664:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365485952:0@lo:400:kworker.0 00000100:00100000:2.0:1789708570.470665:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876645365485696:0@lo:400:kworker.0 00000100:00100000:1.0:1789708570.470673:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365484288:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708570.470686:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789708570.470700:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708570.470706:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708570.470712:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365486080:0@lo:400:kworker.0 00000100:00100000:0.0:1789708570.470721:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708570.470745:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365484160 00000100:00100000:2.0:1789708570.470749:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365484160 00000100:00100000:1.0:1789708570.470752:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365484288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708570.470759:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708570.470762:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789708570.470769:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789708570.470772:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365485312:0@lo:400:kworker.0 00000100:00100000:2.0:1789708570.470784:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789708570.470788:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789708570.470794:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3618:x1876645365484160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708570.470795:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365484416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708570.470804:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365485440 00000100:00100000:3.0:1789708570.470810:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365485440 00000100:00100000:0.0:1789708570.470817:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789708570.470821:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708570.470845:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365485568 00000100:00100000:2.0:1789708570.470845:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3618:x1876645365484160:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708570.470846:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365485824:0@lo:400:kworker.0 00000100:00100000:3.0:1789708570.470851:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365485568 00000100:00100000:2.0:1789708570.470860:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789708570.470860:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365484416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708570.470867:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789708570.470875:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365485952 00000100:00100000:3.0:1789708570.470879:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365485952 00000100:00100000:1.0:1789708570.470886:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789708570.470887:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708570.470898:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876645365484928:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708570.470904:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365486080 00000100:00100000:2.0:1789708570.470905:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365484672 00002000:00000024:1.0:1789708570.470909:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708570.470910:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365486080 00000100:00100000:2.0:1789708570.470911:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365484672 00010000:00080000:0.0:1789708570.470930:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fac2d80 x1876645365484416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708570.470940:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789708570.470946:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365485056 00000100:00100000:3.0:1789708570.470952:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1876645365485440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708570.470952:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365484416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708570.470953:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365485056 00010000:00080000:0.0:1789708570.470976:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab2d80 x1876645365484928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708570.470990:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365484928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708570.470991:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789708570.471004:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365484672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708570.471004:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876645365484928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708570.471011:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789708570.471028:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365485440:12345-0@lo:400:kworker.0 Request processed in 78us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708570.471032:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789708570.471037:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365484544 00000100:00100000:3.0:1789708570.471042:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789708570.471042:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365484544 00000100:00100000:0.0:1789708570.471047:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365485568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708570.471048:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365484672:12345-0@lo:400:kworker.0 Request processed in 44us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708570.471058:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789708570.471070:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708570.471071:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365485184 00000100:00100000:2.0:1789708570.471075:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789708570.471075:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365485184 00000100:00100000:3.0:1789708570.471083:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365485952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708570.471085:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365485056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708570.471089:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365485568:12345-0@lo:400:kworker.0 Request processed in 46us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708570.471090:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365485696 00000100:00100000:1.0:1789708570.471094:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365485696 00000100:00100000:0.0:1789708570.471103:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789708570.471114:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365485312 00000100:00100000:1.0:1789708570.471118:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365485312 00000100:00100000:0.0:1789708570.471122:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789708570.471129:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365486080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708570.471142:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365485824 00000100:00100000:2.0:1789708570.471145:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365485056:12345-0@lo:400:kworker.0 Request processed in 63us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708570.471146:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365485824 00000100:00100000:2.0:1789708570.471153:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789708570.471154:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365485952:12345-0@lo:400:kworker.0 Request processed in 74us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708570.471164:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365486080:12345-0@lo:400:kworker.0 Request processed in 35us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708570.471169:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789708570.471172:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708570.471177:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789708570.471178:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708570.471181:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365484544:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789708570.471183:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708570.471186:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789708570.471188:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708570.471221:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789708570.471229:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365485184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708570.471232:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365484544:12345-0@lo:400:kworker.0 Request processed in 54us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708570.471236:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789708570.471245:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789708570.471249:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876645365485696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708570.471254:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789708570.471282:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365485312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708570.471291:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365485184:12345-0@lo:400:kworker.0 Request processed in 63us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708570.471297:0:6484:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1789708570.471299:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789708570.471305:0:6484:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:0.0:1789708570.471305:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876645365485696:12345-0@lo:400:kworker.0 Request processed in 59us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708570.471313:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789708570.471323:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789708570.471332:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365485312:12345-0@lo:400:kworker.0 Request processed in 76us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708570.471336:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365485824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708570.471345:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789708570.471356:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365484544:0@lo:400:kworker.0 00000100:00100000:0.0:1789708570.471370:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365485056:0@lo:400:kworker.0 00000100:00100000:2.0:1789708570.471378:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365485824:12345-0@lo:400:kworker.0 Request processed in 45us (492us total) trans 0 rc 0/0 00010000:00080000:0.0:1789708570.471383:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08beaa00 x1876645365485568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708570.471390:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789708570.471397:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708570.471401:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365485568:0@lo:400:kworker.0 00000100:00100000:3.0:1789708570.471417:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365485184:0@lo:400:kworker.0 00010000:00080000:0.0:1789708570.471423:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09946680 x1876645365486080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708570.471434:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365486080:0@lo:400:kworker.0 00000100:00100000:3.0:1789708570.471439:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876645365485696:0@lo:400:kworker.0 00010000:00080000:1.0:1789708570.471445:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09a19c00 x1876645365484288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708570.471459:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365484160:0@lo:400:kworker.0 00000100:00100000:0.0:1789708570.471459:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708570.471471:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365486208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708570.471477:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365484672:0@lo:400:kworker.0 00000100:00100000:1.0:1789708570.471480:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365484288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708570.471502:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708570.471523:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365486208 00000100:00100000:1.0:1789708570.471526:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365484800 00000100:00100000:2.0:1789708570.471528:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365486208 00000100:00100000:1.0:1789708570.471528:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365484800 00010000:00080000:0.0:1789708570.471544:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08be9c00 x1876645365485312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708570.471551:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365485312:0@lo:400:kworker.0 00000100:00100000:2.0:1789708570.471556:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789708570.471556:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1789708570.471561:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bea300 x1876645365485824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708570.471567:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365486208:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708570.471568:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365484800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708570.471571:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365485824:0@lo:400:kworker.0 00010000:00080000:0.0:1789708570.471582:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08be9180 x1876645365485440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1789708570.471583:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708570.471593:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365485440:0@lo:400:kworker.0 00010000:00080000:0.0:1789708570.471604:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09946a00 x1876645365485952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708570.471617:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365484800:12345-0@lo:400:kworker.0 Request processed in 51us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708570.471621:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365486208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708570.471627:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365485952:0@lo:400:kworker.0 00000100:00100000:2.0:1789708570.471628:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789708570.471628:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789708570.471662:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365484800:0@lo:400:kworker.0 00010000:00080000:2.0:1789708570.471663:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab1180 x1876645365486208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708570.471682:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365486208:0@lo:13:osp-pre-1-1.0 00000020:00000080:1.0:1789708570.611378:0:13686:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc29be4e90 20000000:00000080:1.0:1789708570.611396:0:13686:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bed09ae8800 uarg=0000000000000000 20000000:01000000:1.0:1789708570.611436:0:13686:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789708570.611441:0:13686:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789708570.611445:0:13686:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789708570.611749:0:13687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789708570.611826:0:13686:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789708570.615282:0:13686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789708570.615320:0:13686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789708570.615337:0:13686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789708570.615358:0:13686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789708570.615378:0:13686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615396:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188ac800/0xf45f43947e47ce27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715def6 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615403:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee0165a000/0xf45f43947e47ce2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715defd expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615410:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188ace00/0xf45f43947e47ce3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ce35 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615417:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47ce4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ce43 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615424:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee188ad800/0xf45f43947e47ce58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ce51 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615430:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47ce66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ce5f expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615438:0:13686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615484:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47ce66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ce5f expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615498:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47ce66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ce5f expref: 23 pid: 6478 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708570.615510:0:13686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365486336:0@lo:104: 00000100:00100000:2.0:1789708570.615572:0:13686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708570.615613:0:9489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365486336 00000100:00100000:3.0:1789708570.615621:0:9489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365486336 00010000:00010000:2.0:1789708570.615641:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188ad800/0xf45f43947e47ce58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ce51 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615652:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee188ad800/0xf45f43947e47ce58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ce51 expref: 23 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708570.615662:0:13686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365486464:0@lo:104: 00000100:00100000:3.0:1789708570.615673:0:9489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708570.615684:0:9489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:13686:x1876645365486336:12345-0@lo:104: 00000100:00100000:2.0:1789708570.615696:0:13686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708570.615697:0:9489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615733:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47ce4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ce43 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.615736:0:7425:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789708570.615748:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47ce4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ce43 expref: 23 pid: 6478 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.615752:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365486464 00010000:00010000:3.0:1789708570.615756:0:9489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708570.615759:0:7425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365486464 00000100:00100000:2.0:1789708570.615762:0:13686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365486592:0@lo:104: 00000100:00100000:3.0:1789708570.615765:0:9489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:13686:x1876645365486336:12345-0@lo:104: Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708570.615776:0:9489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789708570.615781:0:10362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708570.615790:0:10362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708570.615798:0:13686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708570.615805:0:10362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee0165a600 already unused, calling callback (ffffffffc13d2d20) 00000100:00100000:0.0:1789708570.615805:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 10000000:00010000:1.0:1789708570.615809:0:10362:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.615810:0:9489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365486592 00000100:00100000:3.0:1789708570.615816:0:9489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365486592 00000100:00100000:0.0:1789708570.615816:0:7425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a06850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:13686:x1876645365486464:12345-0@lo:104: 00010000:00010000:1.0:1789708570.615820:0:10362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.615826:0:7425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615833:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188ace00/0xf45f43947e47ce3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ce35 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.615840:0:9489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 10000000:00010000:1.0:1789708570.615843:0:10362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.615851:0:9489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:13686:x1876645365486592:12345-0@lo:104: 10000000:01000000:1.0:1789708570.615856:0:10362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789708570.615857:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bee188ace00/0xf45f43947e47ce3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ce35 expref: 23 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.615869:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789708570.615870:0:9489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.615881:0:7425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a06850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+4:13686:x1876645365486464:12345-0@lo:104: Request processed in 67us (184us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708570.615889:0:10362:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.615896:0:10362:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789708570.615896:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789708570.615901:0:13686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365486720:0@lo:104: 00010000:00010000:3.0:1789708570.615917:0:9489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789708570.615920:0:10362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.615924:0:9489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:13686:x1876645365486592:12345-0@lo:104: Request processed in 75us (130us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708570.615937:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee0165a600/0xf45f43947e47ce5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.615938:0:9489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789708570.615943:0:13686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708570.615947:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708570.615951:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.615956:0:10362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708570.615957:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee0165b200 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:1.0:1789708570.615959:0:10362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708570.615961:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.615963:0:9489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365486720 00000100:00100000:3.0:1789708570.615967:0:9489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365486720 00010000:00010000:1.0:1789708570.615968:0:10362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee0165aa00 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:0.0:1789708570.615970:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708570.615973:0:10362:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708570.615977:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.615980:0:10362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.615983:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee0165a000/0xf45f43947e47ce2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715defd expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708570.615984:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:1.0:1789708570.615992:0:10362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708570.616003:0:10362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789708570.616006:0:9489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1789708570.616008:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.616011:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee0165a000/0xf45f43947e47ce2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715defd expref: 12 pid: 6478 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.616022:0:9489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:13686:x1876645365486720:12345-0@lo:104: 00010000:00010000:1.0:1789708570.616024:0:10362:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.616024:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708570.616035:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708570.616037:0:9489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708570.616038:0:13686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365486976:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708570.616053:0:10362:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708570.616053:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee0165b200/0xf45f43947e47ce51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.616066:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708570.616069:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708570.616071:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708570.616072:0:10362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.616079:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee0165aa00/0xf45f43947e47ce43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.616089:0:10362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708570.616092:0:10362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.616093:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365487104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708570.616099:0:10362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd800 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:3.0:1789708570.616100:0:9489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:2.0:1789708570.616103:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee188ac800/0xf45f43947e47ce27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715def6 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708570.616105:0:10362:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.616108:0:9489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+3:13686:x1876645365486720:12345-0@lo:104: Request processed in 90us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708570.616123:0:9489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1789708570.616128:0:10362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.616131:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708570.616132:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee188ac800/0xf45f43947e47ce27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715def6 expref: 12 pid: 6479 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708570.616142:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789708570.616143:0:10362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.616150:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:01000000:1.0:1789708570.616151:0:10362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789708570.616152:0:13686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365487360:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708570.616159:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708570.616161:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365487232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708570.616169:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365486848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708570.616175:0:10362:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.616181:0:10362:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789708570.616188:0:13686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02bdd000 going to sleep for 11 seconds 00010000:00010000:1.0:1789708570.616189:0:10362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.616210:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708570.616224:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd800/0xf45f43947e47ce35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ce3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.616227:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365487104 00000100:00100000:2.0:1789708570.616229:0:13686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365486336:0@lo:104: 00000100:00100000:0.0:1789708570.616232:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365487104 00000100:00100000:3.0:1789708570.616241:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365487488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708570.616242:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708570.616247:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708570.616248:0:13686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365486464:0@lo:104: 00010000:00010000:1.0:1789708570.616251:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708570.616252:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188ad800/0xf45f43947e47ce58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ce51 expref: 24 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.616287:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708570.616302:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365487232 00000100:00100000:0.0:1789708570.616307:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365487232 00010000:00010000:0.0:1789708570.616322:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47ce4a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ce43 expref: 25 pid: 6478 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.616342:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365487488 00000100:00100000:0.0:1789708570.616345:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365487488 00010000:00010000:0.0:1789708570.616356:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188ace00/0xf45f43947e47ce3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ce35 expref: 26 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.616384:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789708570.616392:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08575c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+26:3616:x1876645365487104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708570.616402:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708570.616409:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188ad800/0xf45f43947e47ce58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ce51 expref: 26 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708570.616418:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708570.616419:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188ad800/0xf45f43947e47ce58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ce51 expref: 26 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708570.616433:0:13686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365486592:0@lo:104: 00010000:00010000:0.0:1789708570.616435:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ad800/0xf45f43947e47ce58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ce51 expref: 26 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.616438:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1789708570.616453:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708570.616454:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3618:x1876645365487232:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708570.616454:0:13686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365486720:0@lo:104: 00010000:00010000:3.0:1789708570.616473:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708570.616478:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47ce4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ce43 expref: 25 pid: 6478 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.616485:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08575c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3616:x1876645365487104:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708570.616494:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789708570.616498:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708570.616529:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365487104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708570.616534:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365486848 00000100:00100000:0.0:1789708570.616539:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365486848 00010000:00010000:3.0:1789708570.616547:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47ce4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ce43 expref: 25 pid: 6478 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708570.616553:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1789708570.616554:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47ce66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ce5f expref: 25 pid: 6478 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708570.616563:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebc400/0xf45f43947e47ce4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ce43 expref: 25 pid: 6478 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708570.616566:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+25:3618:x1876645365487488:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708570.616572:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1789708570.616575:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708570.616579:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789708570.616579:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3616:x1876645365486848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708570.616585:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188ace00/0xf45f43947e47ce3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ce35 expref: 24 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.616586:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708570.616590:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47ce66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ce5f expref: 24 pid: 6478 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.616596:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188ace00/0xf45f43947e47ce3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ce35 expref: 24 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.616605:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47ce66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ce5f expref: 24 pid: 6478 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.616609:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3618:x1876645365487232:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708570.616619:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789708570.616629:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365487232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708570.616632:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ace00/0xf45f43947e47ce3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ce35 expref: 23 pid: 6479 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.616633:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47ce66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ce5f expref: 23 pid: 6478 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.616644:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708570.616644:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708570.616674:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:3618:x1876645365487488:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708570.616675:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:3616:x1876645365486848:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708570.616682:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789708570.616685:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789708570.616695:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365486848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708570.616718:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365487488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708570.617331:0:13686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365486976:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708570.617487:0:13686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876645365487360:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708570.617523:0:13686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.617622:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708570.617653:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357046656 00000100:00100000:2.0:1789708570.617658:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357046656 00010000:00010000:2.0:1789708570.617674:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee0165a000/0xf45f43947e47ce2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715defd expref: 13 pid: 6478 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708570.617682:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708570.617714:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357046784 00000100:00100000:2.0:1789708570.617718:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357046784 00010000:00010000:2.0:1789708570.617735:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee188ac800/0xf45f43947e47ce27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715def6 expref: 14 pid: 6479 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.617735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:0.0:1789708570.617751:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:098f9bc4-0284-4f29-9497-0447ce008685+14:2395:x1876645357046656:12345-192.168.201.52@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789708570.617758:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00010000:00010000:0.0:1789708570.617765:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708570.617773:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee0165a000/0xf45f43947e47ce2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715defd expref: 14 pid: 6478 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708570.617776:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:098f9bc4-0284-4f29-9497-0447ce008685+14:2395:x1876645357046784:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708570.617789:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708570.617791:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee0165a000/0xf45f43947e47ce2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715defd expref: 14 pid: 6478 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.617798:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee188ac800/0xf45f43947e47ce27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715def6 expref: 14 pid: 6479 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.617809:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee0165a000/0xf45f43947e47ce2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715defd expref: 14 pid: 6478 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.617832:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee188ac800/0xf45f43947e47ce27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715def6 expref: 13 pid: 6479 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.617840:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708570.617846:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ac800/0xf45f43947e47ce27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715def6 expref: 13 pid: 6479 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.617859:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.617868:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.617878:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:098f9bc4-0284-4f29-9497-0447ce008685+12:2395:x1876645357046656:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 130us (255us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708570.617882:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708570.617887:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00010000:00010000:1.0:1789708570.617895:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.617903:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.617909:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.617915:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebdc00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708570.617919:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.617926:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.617953:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708570.617963:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708570.617974:0:13686:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.617983:0:13686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708570.617988:0:13686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebdc00/0xf45f43947e47cf9a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708570.617993:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:098f9bc4-0284-4f29-9497-0447ce008685+11:2395:x1876645357046784:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 223us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708570.618003:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000020:00000080:0.0:1789708570.898340:0:13735:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff5093220 20000000:00000080:0.0:1789708570.898355:0:13735:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bee3fab8000 uarg=0000000000000000 20000000:01000000:0.0:1789708570.898406:0:13735:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789708570.898412:0:13735:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789708570.898423:0:13735:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789708570.898725:0:13736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1789708570.898808:0:13735:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789708570.898875:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1789708570.898899:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1789708570.898913:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1789708570.898928:0:13735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789708570.898946:0:13735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.898959:0:13735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.898969:0:13735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.898976:0:13735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.898983:0:13735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.898990:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.898996:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebf800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708570.898999:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.899006:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.899017:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.899030:0:13735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708570.899036:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebf800/0xf45f43947e47cfa1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708571.238414:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708571.494404:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365487616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708571.494472:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708571.494511:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365487616 00000100:00100000:2.0:1789708571.494520:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365487616 00000100:00100000:2.0:1789708571.494577:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789708571.494584:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365487616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789708571.494611:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789708571.494649:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365487616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708571.494655:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789708571.494694:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365487616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789708571.934976:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708571.935040:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357046912 00000100:00100000:1.0:1789708571.935049:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357046912 00000100:00100000:1.0:1789708571.935092:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 303 00000100:00100000:1.0:1789708571.935101:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+11:6155:x1876645357046912:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708571.935125:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708571.935148:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e948a00/0xf45f43947e47cfa8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df4a expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708571.935187:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e948a00/0xf45f43947e47cfa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df4a expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708571.935196:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e948a00/0xf45f43947e47cfa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df4a expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708571.935203:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948a00, rc 0) 00000100:00100000:1.0:1789708571.935256:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357046912:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 156us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708571.935282:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 303 00000100:00100000:3.0:1789708571.936044:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708571.936089:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357047040 00000100:00100000:1.0:1789708571.936094:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357047040 00000100:00100000:1.0:1789708571.936119:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 304 00000100:00100000:1.0:1789708571.936124:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357047040:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708571.936229:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357047040:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 104us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708571.936237:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 304 00000100:00100000:3.0:1789708571.936857:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708571.936899:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357047168 00000100:00100000:1.0:1789708571.936905:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357047168 00000100:00100000:1.0:1789708571.936937:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 305 00000100:00100000:1.0:1789708571.936945:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357047168:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708571.937035:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357047168:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 91us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708571.937043:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 305 00000100:00100000:3.0:1789708571.937937:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708571.937984:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357047296 00000100:00100000:1.0:1789708571.937989:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357047296 00000100:00100000:1.0:1789708571.938022:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 306 00000100:00100000:1.0:1789708571.938028:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+12:10774:x1876645357047296:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708571.938095:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+12:10774:x1876645357047296:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 66us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708571.938103:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 306 00000100:00100000:3.0:1789708571.938886:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708571.938929:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357047424 00000100:00100000:1.0:1789708571.938938:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357047424 00000100:00100000:1.0:1789708571.938963:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 307 00000100:00100000:1.0:1789708571.938970:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+12:10774:x1876645357047424:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708571.939037:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+12:10774:x1876645357047424:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 67us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708571.939042:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 307 00000100:00100000:3.0:1789708571.939947:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708571.939991:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357047552 00000100:00100000:1.0:1789708571.939995:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357047552 00000100:00100000:1.0:1789708571.940018:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 308 00000100:00100000:1.0:1789708571.940023:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+12:6155:x1876645357047552:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708571.940030:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708571.940042:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e948200/0xf45f43947e47cfaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df51 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708571.940059:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e948200/0xf45f43947e47cfaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df51 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708571.940072:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e948200/0xf45f43947e47cfaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df51 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708571.940079:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948200, rc 0) 00000100:00100000:1.0:1789708571.940101:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:6155:x1876645357047552:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 78us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708571.940107:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 308 00000100:00100000:3.0:1789708571.940811:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708571.940867:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357047680 00000100:00100000:1.0:1789708571.940873:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357047680 00000100:00100000:1.0:1789708571.940902:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 309 00000100:00100000:1.0:1789708571.940910:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:6155:x1876645357047680:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708571.941007:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:6155:x1876645357047680:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 97us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708571.941025:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 309 00000100:00100000:3.0:1789708571.941669:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708571.941713:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357047808 00000100:00100000:1.0:1789708571.941719:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357047808 00000100:00100000:1.0:1789708571.941745:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 310 00000100:00100000:1.0:1789708571.941752:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:6155:x1876645357047808:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708571.941834:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:6155:x1876645357047808:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708571.941841:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 310 00000100:00100000:3.0:1789708571.942619:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708571.942655:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357047936 00000100:00100000:1.0:1789708571.942660:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357047936 00000100:00100000:1.0:1789708571.942684:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 311 00000100:00100000:1.0:1789708571.942689:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee032f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:10777:x1876645357047936:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708571.942748:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee032f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:10777:x1876645357047936:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 59us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708571.942754:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 311 00000100:00100000:3.0:1789708571.943493:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708571.943543:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357048064 00000100:00100000:1.0:1789708571.943548:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357048064 00000100:00100000:1.0:1789708571.943578:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 312 00000100:00100000:1.0:1789708571.943586:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:10777:x1876645357048064:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708571.943664:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:10777:x1876645357048064:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 78us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708571.943671:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 312 10000000:01000000:2.0:1789708572.070381:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789708572.070388:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed08a9c000 from 7 10000000:01000000:2.0:1789708572.070393:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708572.070447:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708572.070458:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708572.070470:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708572.070492:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365487744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708572.070545:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708572.070592:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02bdd000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.070600:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365487744 00000100:00100000:1.0:1789708572.070609:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365487744 00000100:00100000:1.0:1789708572.070665:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789708572.070675:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:6481:x1876645365487744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708572.070689:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708572.070715:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e949000/0xf45f43947e47cfbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cfb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.070745:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e949000/0xf45f43947e47cfbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cfb6 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.070757:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e949000/0xf45f43947e47cfbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cfb6 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.070767:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949000, rc 0) 00000100:00100000:1.0:1789708572.070805:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365487744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.070810:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789708572.070837:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365487744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708572.070853:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708572.070862:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708572.070906:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365487872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708572.070951:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708572.070969:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02bdd000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.070986:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365487872 00000100:00100000:1.0:1789708572.070990:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365487872 00000100:00100000:1.0:1789708572.071010:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789708572.071015:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365487872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.071093:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365487872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.071098:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789708572.071117:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365487872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708572.071149:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365488000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708572.071191:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708572.071203:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02bdd000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.071222:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365488000 00000100:00100000:1.0:1789708572.071225:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365488000 00000100:00100000:1.0:1789708572.071248:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789708572.071253:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365488000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.071342:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365488000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.071346:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789708572.071365:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365488000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708572.071579:0:13748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13748:1876645365488128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708572.071607:0:13748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708572.071625:0:13748:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02bddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.071636:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365488128 00000100:00100000:1.0:1789708572.071640:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365488128 00000100:00100000:1.0:1789708572.071657:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789708572.071663:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:13748:x1876645365488128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708572.071727:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:13748:x1876645365488128:12345-0@lo:502:llog_process_th.0 Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.071732:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789708572.071735:0:13748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13748:1876645365488128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708572.071756:0:13748:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708572.071763:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708572.071765:0:13748:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708572.071770:0:13748:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bed08a9c000 00000020:00000080:2.0:1789708572.071771:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708572.071815:0:13748:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708572.071817:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708572.071818:0:13748:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708572.071820:0:13748:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708572.071822:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708572.071824:0:13748:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789708572.071828:0:13748:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bed08a9c000 00000020:00000080:2.0:1789708572.071831:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789708572.071860:0:13748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13748:1876645365488256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708572.071890:0:13748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708572.071907:0:13748:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02bddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.071933:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365488256 00000100:00100000:1.0:1789708572.071936:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365488256 00000100:00100000:1.0:1789708572.071961:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789708572.071970:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:13748:x1876645365488256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708572.072045:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:13748:x1876645365488256:12345-0@lo:502:llog_process_th.0 Request processed in 78us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.072051:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789708572.072066:0:13748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13748:1876645365488256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708572.072084:0:13748:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708572.072087:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708572.072088:0:13748:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789708572.072092:0:13748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789708572.072156:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789708572.072193:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708572.072200:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.072210:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708572.072219:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789708572.072222:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee2f569800 from 7 10000000:01000000:1.0:1789708572.072229:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708572.072243:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.072248:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.072253:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708572.072278:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365488384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.072305:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708572.072327:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365488384 00000100:00100000:1.0:1789708572.072331:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708572.072332:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365488384 00000100:00100000:2.0:1789708572.072362:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789708572.072368:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+21:6481:x1876645365488384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708572.072374:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708572.072382:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cfcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cfc4 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708572.072394:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cfcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cfc4 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708572.072399:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cfcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cfc4 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708572.072404:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc800, rc 0) 00000100:00100000:2.0:1789708572.072437:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365488384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708572.072444:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789708572.072452:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365488384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708572.072464:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.072472:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708572.072521:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365488512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.072554:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708572.072576:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708572.072583:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365488512 00000100:00100000:2.0:1789708572.072587:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365488512 00000100:00100000:2.0:1789708572.072612:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789708572.072618:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee02a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365488512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708572.072674:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee02a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365488512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708572.072684:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789708572.072701:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365488512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.072737:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365488640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.072777:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708572.072794:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708572.072798:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365488640 00000100:00100000:2.0:1789708572.072803:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365488640 00000100:00100000:2.0:1789708572.072833:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789708572.072842:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365488640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708572.072909:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365488640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708572.072914:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789708572.072936:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365488640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.073132:0:13749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13749:1876645365488768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708572.073191:0:13749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708572.073215:0:13749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708572.073235:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365488768 00000100:00100000:0.0:1789708572.073240:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365488768 00000100:00100000:0.0:1789708572.073292:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789708572.073299:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:13749:x1876645365488768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708572.073378:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:13749:x1876645365488768:12345-0@lo:502:llog_process_th.0 Request processed in 80us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708572.073384:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789708572.073404:0:13749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13749:1876645365488768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789708572.073433:0:13749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708572.073440:0:13749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708572.073442:0:13749:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789708572.073449:0:13749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee2f569800 00000020:00000080:1.0:1789708572.073452:0:13749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789708572.073482:0:13749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708572.073486:0:13749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708572.073488:0:13749:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789708572.073491:0:13749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708572.073494:0:13749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708572.073496:0:13749:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789708572.073500:0:13749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee2f569800 00000020:00000080:1.0:1789708572.073503:0:13749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789708572.073540:0:13749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13749:1876645365488896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708572.073576:0:13749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708572.073608:0:13749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708572.073619:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365488896 00000100:00100000:0.0:1789708572.073623:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365488896 00000100:00100000:0.0:1789708572.073643:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789708572.073648:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:13749:x1876645365488896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708572.073712:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:13749:x1876645365488896:12345-0@lo:502:llog_process_th.0 Request processed in 63us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708572.073718:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789708572.073741:0:13749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13749:1876645365488896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789708572.073766:0:13749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708572.073771:0:13749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708572.073773:0:13749:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789708572.073777:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789708572.073852:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789708572.073875:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708572.073881:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708572.073888:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708572.073902:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789708572.073904:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee36337800 from 7 10000000:01000000:0.0:1789708572.073906:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708572.073924:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708572.073932:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708572.073939:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708572.073953:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708572.073986:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708572.074008:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.074011:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365489024 00000100:00100000:1.0:1789708572.074016:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365489024 00000100:00100000:1.0:1789708572.074044:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789708572.074060:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:6481:x1876645365489024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708572.074068:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708572.074076:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e948c00/0xf45f43947e47cfd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cfd2 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.074092:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e948c00/0xf45f43947e47cfd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cfd2 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.074100:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e948c00/0xf45f43947e47cfd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cfd2 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.074108:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948c00, rc 0) 00000100:00100000:1.0:1789708572.074142:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365489024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.074149:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789708572.074166:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708572.074184:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708572.074190:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708572.074223:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708572.074246:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708572.074290:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.074291:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365489152 00000100:00100000:1.0:1789708572.074296:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365489152 00000100:00100000:1.0:1789708572.074324:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789708572.074332:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365489152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.074404:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365489152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.074413:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789708572.074426:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708572.074453:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708572.074484:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708572.074499:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.074506:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365489280 00000100:00100000:1.0:1789708572.074511:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365489280 00000100:00100000:1.0:1789708572.074541:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789708572.074549:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365489280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.074626:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365489280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708572.074638:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.074643:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789708572.074822:0:13751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13751:1876645365489408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708572.074861:0:13751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708572.074880:0:13751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc67f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708572.074894:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365489408 00000100:00100000:0.0:1789708572.074898:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365489408 00000100:00100000:0.0:1789708572.074919:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789708572.074926:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:13751:x1876645365489408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708572.074991:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:13751:x1876645365489408:12345-0@lo:502:llog_process_th.0 Request processed in 66us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708572.074997:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789708572.075010:0:13751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13751:1876645365489408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789708572.075034:0:13751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708572.075040:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708572.075042:0:13751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789708572.075048:0:13751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee36337800 00000020:00000080:1.0:1789708572.075051:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789708572.075091:0:13751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708572.075096:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708572.075098:0:13751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789708572.075101:0:13751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708572.075104:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708572.075106:0:13751:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789708572.075111:0:13751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee36337800 00000020:00000080:1.0:1789708572.075115:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789708572.075158:0:13751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13751:1876645365489536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708572.075217:0:13751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708572.075239:0:13751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5780 going to sleep for 11 seconds 00000100:00100000:0.0:1789708572.075250:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365489536 00000100:00100000:0.0:1789708572.075255:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365489536 00000100:00100000:0.0:1789708572.075305:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789708572.075314:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:13751:x1876645365489536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708572.075378:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:13751:x1876645365489536:12345-0@lo:502:llog_process_th.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708572.075383:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789708572.075396:0:13751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13751:1876645365489536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789708572.075420:0:13751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708572.075425:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708572.075427:0:13751:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789708572.075430:0:13751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789708572.075480:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789708572.075506:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708572.075512:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708572.075520:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708572.075529:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789708572.075532:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee02bf3800 from 7 10000000:01000000:0.0:1789708572.075538:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708572.075551:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708572.075558:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708572.075566:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708572.075578:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708572.075602:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708572.075630:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.075631:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365489664 00000100:00100000:1.0:1789708572.075642:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365489664 00000100:00100000:1.0:1789708572.075673:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789708572.075683:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:6481:x1876645365489664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708572.075691:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708572.075700:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e948400/0xf45f43947e47cfe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47cfe0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.075715:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e948400/0xf45f43947e47cfe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47cfe0 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.075724:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e948400/0xf45f43947e47cfe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47cfe0 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708572.075730:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948400, rc 0) 00000100:00100000:1.0:1789708572.075767:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365489664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.075775:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789708572.075778:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708572.075792:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708572.075800:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708572.075832:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708572.075854:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708572.075870:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.075876:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365489792 00000100:00100000:1.0:1789708572.075882:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365489792 00000100:00100000:1.0:1789708572.075910:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789708572.075917:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365489792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.075982:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365489792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.075987:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789708572.075994:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708572.076025:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708572.076057:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708572.076073:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365489920 00000100:00100000:0.0:1789708572.076075:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.076077:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365489920 00000100:00100000:1.0:1789708572.076099:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789708572.076105:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365489920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708572.076194:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:6481:x1876645365489920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.076202:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789708572.076226:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:6481:1876645365489920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708572.076420:0:13753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13753:1876645365490048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708572.076449:0:13753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708572.076468:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365490048 00000100:00100000:1.0:1789708572.076472:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365490048 00000100:00100000:0.0:1789708572.076474:0:13753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708572.076495:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789708572.076503:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:13753:x1876645365490048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708572.076569:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:13753:x1876645365490048:12345-0@lo:502:llog_process_th.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708572.076575:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789708572.076585:0:13753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13753:1876645365490048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789708572.076607:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708572.076612:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708572.076614:0:13753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789708572.076619:0:13753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee02bf3800 00000020:00000080:0.0:1789708572.076622:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708572.076655:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708572.076659:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708572.076660:0:13753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789708572.076663:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708572.076665:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708572.076666:0:13753:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789708572.076670:0:13753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee02bf3800 00000020:00000080:0.0:1789708572.076672:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789708572.076705:0:13753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13753:1876645365490176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708572.076735:0:13753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708572.076752:0:13753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708572.076771:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365490176 00000100:00100000:2.0:1789708572.076778:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365490176 00000100:00100000:2.0:1789708572.076814:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789708572.076824:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:13753:x1876645365490176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708572.076909:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:13753:x1876645365490176:12345-0@lo:502:llog_process_th.0 Request processed in 87us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708572.076917:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789708572.076926:0:13753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:13753:1876645365490176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789708572.076947:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708572.076951:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708572.076952:0:13753:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789708572.076955:0:13753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789708572.077004:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789708572.077029:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708572.077036:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708572.077044:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708572.079524:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789708572.085727:0:13756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789708572.262392:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708573.096719:0:13756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789708573.096761:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789708573.286404:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708573.407385:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708573.407429:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708573.407455:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357048192 00000100:00100000:3.0:1789708573.407466:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708573.407467:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357048192 00000100:00100000:0.0:1789708573.407495:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357048320 00000100:00100000:0.0:1789708573.407501:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357048320 00000100:00100000:3.0:1789708573.407505:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708573.407532:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 333 00000100:00100000:3.0:1789708573.407533:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708573.407534:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357048448 00000100:00100000:2.0:1789708573.407541:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357048448 00000100:00100000:1.0:1789708573.407547:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee102e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:2397:x1876645357048192:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708573.407560:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708573.407569:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357048704 00000100:00100000:3.0:1789708573.407581:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708573.407581:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357048704 00000100:00100000:2.0:1789708573.407592:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357048832 00000100:00100000:2.0:1789708573.407597:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357048832 00000100:00100000:0.0:1789708573.407619:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:3.0:1789708573.407623:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708573.407635:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee102e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:098f9bc4-0284-4f29-9497-0447ce008685+13:2397:x1876645357048192:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708573.407635:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+18:2398:x1876645357048320:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708573.407642:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:1.0:1789708573.407647:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 333 00000100:00100000:2.0:1789708573.407656:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357048448:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708573.407676:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+18:2398:x1876645357048320:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 45us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708573.407684:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:1.0:1789708573.407695:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:2.0:1789708573.407701:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357048448:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 48us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708573.407706:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357048704:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708573.407706:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:0.0:1789708573.407715:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357048832:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708573.407721:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00080000:2.0:1789708573.407749:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708573.407750:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357048576 00000100:00080000:2.0:1789708573.407756:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708573.407757:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357048576 00000100:00100000:1.0:1789708573.407757:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357048704:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 51us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708573.407757:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357048832:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 39us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708573.407767:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:1.0:1789708573.407773:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:0.0:1789708573.407801:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357048960 00000100:00100000:1.0:1789708573.407802:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357049088 00000100:00100000:1.0:1789708573.407806:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357049088 00000100:00100000:0.0:1789708573.407806:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357048960 00000100:00080000:2.0:1789708573.407830:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789708573.407835:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708573.407844:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:1.0:1789708573.407851:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:0.0:1789708573.407854:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357048960:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708573.407856:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357049088:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:2.0:1789708573.407882:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708573.407893:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:1.0:1789708573.407900:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357049088:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 40us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708573.407900:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357048960:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 45us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708573.407908:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357048576:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708573.407912:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:1.0:1789708573.407920:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:3.0:1789708573.407954:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357048576:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 50us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708573.407963:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00010000:00010000:3.0:1789708574.310398:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708574.566432:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365490304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708574.566538:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708574.566590:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365490304 00000100:00100000:2.0:1789708574.566600:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365490304 00000100:00100000:2.0:1789708574.566648:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789708574.566658:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365490304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789708574.566690:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789708574.566740:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365490304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708574.566748:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708574.566766:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365490304:0@lo:41:osp-pre-0-1.0 00000004:00080000:1.0:1789708575.079586:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789708575.079623:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1789708575.079633:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789708575.079667:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079682:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079691:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079698:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188aca00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708575.079703:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079725:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079744:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9bed08847c00) 00010000:00010000:3.0:1789708575.079748:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708575.079754:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079761:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee188aca00/0xf45f43947e47cef2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708575.079785:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365490432:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789708575.079790:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079798:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079804:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079810:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee00030a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708575.079814:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079820:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079828:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bed08847700) 00010000:00010000:3.0:1789708575.079831:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708575.079834:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079852:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee00030a00/0xf45f43947e47cf07 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708575.079857:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708575.079880:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079888:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079895:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079901:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708575.079905:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708575.079911:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365490432 00010000:00010000:3.0:1789708575.079913:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708575.079920:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365490432 00010000:00010000:3.0:1789708575.079926:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9bed08847c00) 00010000:00010000:3.0:1789708575.079931:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708575.079935:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079942:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47cf70 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789708575.079959:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789708575.079962:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.079970:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708575.079974:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789708575.079986:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365490432:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789708575.079997:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.080005:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708575.080008:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.080014:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.080023:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bed08847b00) 00002000:00080000:0.0:1789708575.080026:0:8399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00010000:00010000:3.0:1789708575.080027:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708575.080033:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708575.080041:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47cf8c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708575.080060:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aacc918, atime: 0x6aacc918, ctime: 0x6aacc918, blocks: 0x0 00010000:00010000:0.0:1789708575.080067:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000216b25c1/0xf45f43947e47cfee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708575.080080:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=145s v=(0 0) 00010000:00010000:0.0:1789708575.080084:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708575.080089:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000216b25c1/0xf45f43947e47cfee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708575.080102:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000216b25c1/0xf45f43947e47cfee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708575.080110:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000216b25c1/0xf45f43947e47cfee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708575.080130:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000216b25c1/0xf45f43947e47cfee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708575.080151:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708575.080183:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708575.080190:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000216b25c1/0xf45f43947e47cfee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708575.080197:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebee00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708575.080200:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000216b25c1/0xf45f43947e47cfee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708575.080220:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000216b25c1/0xf45f43947e47cfee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708575.080238:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000216b25c1/0xf45f43947e47cfee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708575.080247:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000216b25c1/0xf45f43947e47cfee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708575.080284:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708575.080289:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708575.080293:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708575.080308:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1876645365490432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 323us (453us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789708575.080317:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1789708575.080341:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bed09919880/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789708575.080350:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365490432:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789708575.334392:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708575.590428:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365490944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708575.590465:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365490560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708575.590475:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365490688:0@lo:400:kworker.0 00000100:00100000:0.0:1789708575.590503:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708575.590537:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365490944 00000100:00100000:2.0:1789708575.590543:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708575.590544:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365490944 00000100:00100000:1.0:1789708575.590574:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365491072:0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.590593:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365491200:0@lo:400:kworker.0 00000100:00100000:0.0:1789708575.590594:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365491584:0@lo:400:kworker.0 00000100:00100000:3.0:1789708575.590600:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789708575.590611:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365490944:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708575.590618:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789708575.590638:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708575.590639:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708575.590650:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365491456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708575.590664:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365491072 00000100:00100000:0.0:1789708575.590670:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365491072 00000100:00100000:2.0:1789708575.590677:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365491712:0@lo:400:kworker.0 00000100:00100000:1.0:1789708575.590690:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708575.590695:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365490944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708575.590702:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789708575.590710:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789708575.590711:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365492096:0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.590715:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708575.590726:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365491456 00000100:00100000:0.0:1789708575.590727:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365491072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708575.590731:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365491456 00000100:00100000:2.0:1789708575.590742:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876645365492224:0@lo:400:kworker.0 00000100:00100000:1.0:1789708575.590751:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708575.590757:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789708575.590764:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365491456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708575.590774:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708575.590782:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708575.590786:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365492608:0@lo:400:kworker.0 00000100:00100000:0.0:1789708575.590790:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365491072:12345-0@lo:400:kworker.0 Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708575.590801:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789708575.590817:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365491456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708575.590821:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365491712 00000100:00100000:1.0:1789708575.590826:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708575.590827:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365491712 00000100:00100000:2.0:1789708575.590829:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365490688 00000100:00100000:3.0:1789708575.590831:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789708575.590836:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365490688 00000100:00100000:0.0:1789708575.590864:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365492224 00000100:00080000:3.0:1789708575.590865:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708575.590870:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365492224 00000100:00080000:3.0:1789708575.590872:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708575.590877:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365491072:0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.590879:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789708575.590891:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3618:x1876645365490688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708575.590896:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789708575.590901:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee048f1180 x1876645365491456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708575.590918:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789708575.590921:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0991a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365490816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708575.590933:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365491712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708575.590935:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365491456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708575.590940:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3618:x1876645365490688:12345-0@lo:400:kworker.0 Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708575.590950:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708575.590953:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789708575.590971:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365491328:0@lo:400:kworker.0 00000100:00100000:0.0:1789708575.590984:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365491712:12345-0@lo:400:kworker.0 Request processed in 55us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708575.590990:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365490560 00000100:00100000:1.0:1789708575.590991:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365492096 00000100:00100000:2.0:1789708575.590995:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365490560 00000100:00100000:0.0:1789708575.590996:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789708575.590998:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365492096 00000100:00100000:3.0:1789708575.591004:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708575.591020:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365491328 00000100:00100000:3.0:1789708575.591022:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365491840:0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.591024:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365490816 00000100:00100000:0.0:1789708575.591027:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365491328 00000100:00100000:2.0:1789708575.591028:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365490816 00000100:00100000:1.0:1789708575.591042:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365492608 00000100:00100000:3.0:1789708575.591048:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708575.591050:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365492608 00000100:00100000:2.0:1789708575.591058:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708575.591059:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365491840 00000100:00100000:3.0:1789708575.591064:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365492352:0@lo:400:kworker.0 00000100:00100000:0.0:1789708575.591064:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365491840 00000100:00100000:2.0:1789708575.591068:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365490560:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708575.591082:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00002000:00000024:2.0:1789708575.591085:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708575.591097:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708575.591098:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1876645365492096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708575.591098:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789708575.591130:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876645365492224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.591139:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365490560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708575.591144:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365490560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708575.591148:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789708575.591168:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789708575.591173:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789708575.591173:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1876645365492096:12345-0@lo:400:kworker.0 Request processed in 80us (422us total) trans 0 rc 0/0 00000100:00080000:3.0:1789708575.591179:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708575.591179:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365490816:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708575.591181:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876645365492224:12345-0@lo:400:kworker.0 Request processed in 55us (397us total) trans 0 rc 0/0 00000100:00080000:3.0:1789708575.591183:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708575.591193:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00002000:00000024:2.0:1789708575.591194:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708575.591198:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789708575.591204:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365492352 00000100:00100000:3.0:1789708575.591208:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365492352 00000100:00100000:1.0:1789708575.591221:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708575.591226:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789708575.591231:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365490816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708575.591237:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365492608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708575.591240:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365491328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.591242:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789708575.591243:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789708575.591256:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365491840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.591292:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876645365492224:0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.591303:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365490688:0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.591314:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365491712:0@lo:400:kworker.0 00000100:00100000:1.0:1789708575.591322:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365492608:12345-0@lo:400:kworker.0 Request processed in 90us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708575.591332:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708575.591337:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365491328:12345-0@lo:400:kworker.0 Request processed in 101us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708575.591339:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365491840:12345-0@lo:400:kworker.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708575.591348:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789708575.591355:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1789708575.591360:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fac1f80 x1876645365491840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708575.591369:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789708575.591375:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365491840:0@lo:400:kworker.0 00000100:00100000:1.0:1789708575.591382:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365492352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708575.591395:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365491200 00000100:00100000:3.0:1789708575.591399:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365491200 00000100:00100000:0.0:1789708575.591409:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708575.591418:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0991a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365490816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708575.591431:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365491584 00000100:00100000:3.0:1789708575.591434:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365491584 00000100:00100000:0.0:1789708575.591439:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365491968:0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.591440:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365491328:0@lo:400:kworker.0 00000100:00100000:1.0:1789708575.591443:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365492352:12345-0@lo:400:kworker.0 Request processed in 63us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708575.591448:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789708575.591459:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365491200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708575.591459:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1789708575.591477:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fabf100 x1876645365492352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708575.591481:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708575.591490:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365492352:0@lo:400:kworker.0 00000100:00100000:1.0:1789708575.591501:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365491968 00000100:00100000:1.0:1789708575.591507:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365491968 00000100:00100000:0.0:1789708575.591512:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365492480:0@lo:400:kworker.0 00000100:00100000:3.0:1789708575.591513:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365491200:12345-0@lo:400:kworker.0 Request processed in 55us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708575.591517:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789708575.591527:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789708575.591530:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365491584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708575.591538:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789708575.591548:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789708575.591549:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789708575.591552:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365491968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.591565:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365491584:12345-0@lo:400:kworker.0 Request processed in 39us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708575.591571:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789708575.591580:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365491200:0@lo:400:kworker.0 00010000:00080000:0.0:1789708575.591592:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3e928000 x1876645365490944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708575.591603:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365491968:12345-0@lo:400:kworker.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708575.591607:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365492480 00000100:00100000:2.0:1789708575.591611:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365492480 00000100:00100000:0.0:1789708575.591612:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365490944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708575.591614:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789708575.591635:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365492096:0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.591643:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708575.591645:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365491584:0@lo:400:kworker.0 00010000:00080000:3.0:1789708575.591652:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fabc000 x1876645365492608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708575.591653:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365492480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708575.591663:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365491968:0@lo:400:kworker.0 00000100:00100000:3.0:1789708575.591668:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365492608:0@lo:400:kworker.0 00000100:00100000:2.0:1789708575.591691:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365492480:12345-0@lo:400:kworker.0 Request processed in 41us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708575.591697:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789708575.591701:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fabf800 x1876645365492480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708575.591711:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365492480:0@lo:400:kworker.0 00010000:00010000:1.0:1789708576.358390:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708576.614450:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708576.614473:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365492736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708576.614540:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708576.614597:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365492736 00000100:00100000:3.0:1789708576.614607:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365492736 00000100:00100000:3.0:1789708576.614654:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789708576.614664:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365492736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789708576.614695:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789708576.614746:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365492736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708576.614772:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789708576.614778:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365492736:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789708577.382375:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708578.406473:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708578.527303:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708578.527342:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708578.527365:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357049216 00000100:00100000:0.0:1789708578.527374:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357049216 00000100:00100000:2.0:1789708578.527378:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708578.527399:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708578.527417:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357049472 00000100:00100000:1.0:1789708578.527423:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357049472 00000100:00100000:2.0:1789708578.527431:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708578.527432:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357049728 00000100:00100000:0.0:1789708578.527438:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 335 00000100:00100000:3.0:1789708578.527440:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357049728 00000100:00100000:0.0:1789708578.527460:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+13:2397:x1876645357049216:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708578.527466:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357049344 00000100:00100000:1.0:1789708578.527470:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357049344 00000100:00100000:3.0:1789708578.527480:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:3.0:1789708578.527491:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357049472:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708578.527496:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708578.527500:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:1.0:1789708578.527511:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357049728:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708578.527543:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357049472:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 51us (196us total) trans 0 rc 0/0 00000100:00080000:2.0:1789708578.527544:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708578.527544:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+13:2397:x1876645357049216:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 91us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708578.527554:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357049728:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708578.527556:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00080000:2.0:1789708578.527558:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708578.527564:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 335 00000100:00100000:1.0:1789708578.527570:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1789708578.527575:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357049856 00000100:00100000:3.0:1789708578.527579:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357049856 00000100:00100000:2.0:1789708578.527588:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:2.0:1789708578.527600:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357049344:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708578.527622:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:1.0:1789708578.527632:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357049856:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:3.0:1789708578.527635:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708578.527641:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357049344:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 41us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708578.527651:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:1.0:1789708578.527668:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357049856:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 37us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708578.527673:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357049600 00000100:00100000:1.0:1789708578.527677:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:3.0:1789708578.527678:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357049600 00000100:00080000:2.0:1789708578.527729:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708578.527750:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:3.0:1789708578.527760:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357049600:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708578.527861:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357049600:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 103us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708578.527869:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:2.0:1789708578.530113:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708578.530152:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708578.530175:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357049984 00000100:00100000:1.0:1789708578.530183:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357049984 00000100:00100000:3.0:1789708578.530194:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357050112 00000100:00100000:3.0:1789708578.530197:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357050112 00000100:00080000:2.0:1789708578.530241:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708578.530246:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00080000:2.0:1789708578.530248:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708578.530254:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:1.0:1789708578.530283:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2394:x1876645357049984:12345-192.168.201.52@tcp:9:kworker.0 00000100:00100000:3.0:1789708578.530289:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2394:x1876645357050112:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:3.0:1789708578.530304:0:8398:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ce19 00000020:00000080:1.0:1789708578.530304:0:10054:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ce12 00000100:00080000:3.0:1789708578.530312:0:8398:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa12000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789708578.530312:0:10054:0:(import.c:65:import_set_state_nolock()) ffff9bee3f9f3800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789708578.530355:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789708578.530362:0:8398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000001:00000004:1.0:1789708578.530362:0:10054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:0.0:1789708578.530362:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708578.530486:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+2:2394:x1876645357050112:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 197us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708578.530486:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0bd23bbf-17fc-4232-922d-5f674c08c0de+2:2394:x1876645357049984:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 230us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708578.530495:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:3.0:1789708578.530498:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00010000:00010000:3.0:1789708579.430342:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708579.686447:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708579.686473:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365492864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708579.686527:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708579.686567:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365492864 00000100:00100000:3.0:1789708579.686577:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365492864 00000100:00100000:3.0:1789708579.686622:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789708579.686630:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365492864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789708579.686657:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789708579.686704:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365492864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708579.686709:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789708579.686740:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365492864:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789708580.454434:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708580.710444:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708580.710485:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365493632:0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.710485:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365493504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708580.710490:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365493760:0@lo:400:kworker.0 00000100:00100000:3.0:1789708580.710572:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708580.710573:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708580.710575:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708580.710640:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365493376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708580.710642:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365494016:0@lo:400:kworker.0 00000100:00100000:0.0:1789708580.710648:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365494272:0@lo:400:kworker.0 00000100:00100000:3.0:1789708580.710683:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708580.710691:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708580.710694:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708580.710716:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365494144:0@lo:400:kworker.0 00000100:00100000:0.0:1789708580.710727:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365494784:0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.710728:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365494528:0@lo:400:kworker.0 00000100:00100000:3.0:1789708580.710750:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708580.710771:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708580.710777:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708580.710780:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365494656:0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.710809:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365495040:0@lo:400:kworker.0 00000100:00100000:0.0:1789708580.710813:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365493632 00000100:00100000:1.0:1789708580.710821:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365493504 00000100:00100000:0.0:1789708580.710821:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365493632 00000100:00100000:1.0:1789708580.710828:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365493504 00000100:00100000:0.0:1789708580.710869:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365494272 00000100:00100000:1.0:1789708580.710870:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365493376 00000100:00100000:0.0:1789708580.710875:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365494272 00000100:00100000:1.0:1789708580.710876:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365493376 00000100:00100000:0.0:1789708580.710905:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365494144 00000100:00100000:1.0:1789708580.710909:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708580.710911:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365494144 00000100:00100000:1.0:1789708580.710924:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365493504:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708580.710929:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365494784 00000100:00100000:0.0:1789708580.710933:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365494784 00000100:00100000:0.0:1789708580.710949:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00002000:00000024:1.0:1789708580.710953:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708580.710957:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365493632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708580.711115:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365493504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 191us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708580.711116:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708580.711118:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708580.711121:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365493632:12345-0@lo:400:kworker.0 Request processed in 162us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708580.711131:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708580.711135:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789708580.711160:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789708580.711172:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365493376:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708580.711174:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365494656 00000100:00100000:0.0:1789708580.711180:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365494656 00000100:00100000:2.0:1789708580.711181:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365493504:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789708580.711184:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708580.711195:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365493632:0@lo:400:kworker.0 00000100:00100000:0.0:1789708580.711211:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789708580.711214:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 6 async RPCs [2->3] 00000100:00100000:0.0:1789708580.711223:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365494272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.711226:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365493120:0@lo:400:kworker.0 00000100:00100000:1.0:1789708580.711227:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365493376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708580.711236:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365493376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708580.711245:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789708580.711291:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708580.711295:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365493760 00000100:00100000:3.0:1789708580.711296:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789708580.711302:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365493760 00000100:00100000:3.0:1789708580.711311:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365494144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708580.711318:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365494272:12345-0@lo:400:kworker.0 Request processed in 97us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708580.711331:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365492992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708580.711332:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789708580.711336:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365494016 00000100:00100000:1.0:1789708580.711342:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365494016 00000100:00100000:0.0:1789708580.711353:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789708580.711365:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365494784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708580.711371:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789708580.711380:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365494144:12345-0@lo:400:kworker.0 Request processed in 70us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708580.711380:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708580.711385:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365493760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708580.711393:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789708580.711409:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365493248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708580.711414:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365494784:12345-0@lo:400:kworker.0 Request processed in 51us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708580.711417:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789708580.711427:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789708580.711432:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365494656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708580.711438:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365493760:12345-0@lo:400:kworker.0 Request processed in 56us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708580.711446:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708580.711461:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789708580.711467:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365493888:0@lo:400:kworker.0 00010000:00080000:0.0:1789708580.711472:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fabdc00 x1876645365494272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708580.711481:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365494656:12345-0@lo:400:kworker.0 Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708580.711484:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365494272:0@lo:400:kworker.0 00000100:00100000:1.0:1789708580.711487:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789708580.711496:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708580.711500:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789708580.711504:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365494016:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789708580.711505:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fabf800 x1876645365494784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708580.711518:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365494784:0@lo:400:kworker.0 00000100:00100000:3.0:1789708580.711519:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365493888 00000100:00100000:2.0:1789708580.711523:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365494400:0@lo:400:kworker.0 00000100:00100000:3.0:1789708580.711526:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365493888 00000100:00100000:0.0:1789708580.711532:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365493760:0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.711561:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708580.711567:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789708580.711573:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365494016:12345-0@lo:400:kworker.0 Request processed in 73us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708580.711579:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365493888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708580.711584:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789708580.711587:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365494912:0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.711625:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708580.711629:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365494144:0@lo:400:kworker.0 00000100:00100000:0.0:1789708580.711631:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365493888:12345-0@lo:400:kworker.0 Request processed in 55us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708580.711642:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789708580.711653:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365494656:0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.711665:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365494016:0@lo:400:kworker.0 00000100:00100000:0.0:1789708580.711675:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365494528 00000100:00100000:0.0:1789708580.711680:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365494528 00000100:00100000:3.0:1789708580.711687:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365495040 00000100:00100000:2.0:1789708580.711691:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365493888:0@lo:400:kworker.0 00000100:00100000:3.0:1789708580.711694:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365495040 00000100:00100000:0.0:1789708580.711716:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365494400 00000100:00100000:0.0:1789708580.711721:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365494400 00000100:00100000:2.0:1789708580.711726:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365492992 00000100:00100000:3.0:1789708580.711727:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365494912 00000100:00100000:2.0:1789708580.711733:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365492992 00000100:00100000:3.0:1789708580.711734:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365494912 00000100:00100000:1.0:1789708580.711747:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789708580.711759:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365494528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.711766:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365493248 00000100:00100000:0.0:1789708580.711769:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789708580.711771:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365493248 00000100:00100000:3.0:1789708580.711776:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789708580.711780:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365495040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708580.711791:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365494400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.711797:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789708580.711811:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365494528:12345-0@lo:400:kworker.0 Request processed in 53us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708580.711812:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365492992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708580.711825:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365495040:12345-0@lo:400:kworker.0 Request processed in 48us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708580.711828:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00002000:00000024:2.0:1789708580.711838:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708580.711840:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789708580.711845:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365494400:12345-0@lo:400:kworker.0 Request processed in 57us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708580.711852:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789708580.711860:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789708580.711865:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3618:x1876645365494912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.711879:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365492992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708580.711887:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789708580.711892:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bda680 x1876645365492992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708580.711913:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365492992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708580.711914:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789708580.711915:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3618:x1876645365494912:12345-0@lo:400:kworker.0 Request processed in 50us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708580.711928:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789708580.711931:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876645365493248:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708580.711935:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365494400:0@lo:400:kworker.0 00002000:00000024:2.0:1789708580.711947:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1789708580.711951:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fabc000 x1876645365494912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708580.711961:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365494912:0@lo:400:kworker.0 00000100:00100000:0.0:1789708580.711971:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365494528:0@lo:400:kworker.0 00000100:00080000:1.0:1789708580.711974:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708580.711982:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789708580.711984:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fabf100 x1876645365495040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789708580.711987:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708580.711991:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365493120 00000100:00080000:1.0:1789708580.711993:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708580.711993:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365495040:0@lo:400:kworker.0 00000100:00100000:2.0:1789708580.711994:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365493248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708580.711997:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365493120 00000100:00100000:2.0:1789708580.712007:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789708580.712045:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fa90380 x1876645365493248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708580.712059:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789708580.712059:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365493248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708580.712073:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3618:x1876645365493120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708580.712115:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3618:x1876645365493120:12345-0@lo:400:kworker.0 Request processed in 47us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708580.712129:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789708580.712141:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365493120:0@lo:400:kworker.0 00000001:00100000:1.0:1789708581.223426:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0bd23bbf-17fc-4232-922d-5f674c08c0de 00000020:00000080:1.0:1789708581.223435:0:8392:0:(genops.c:885:class_export_put()) final put ffff9bee3f9f1800/0bd23bbf-17fc-4232-922d-5f674c08c0de 00000001:00080000:1.0:1789708581.223461:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000020:00000080:0.0:1789708581.223480:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3f9f1800/0bd23bbf-17fc-4232-922d-5f674c08c0de for lustre-OST0000 00000020:00000080:0.0:1789708581.223528:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3f9f3800 for lustre-OST0000 00010000:00010000:2.0:1789708581.478437:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708581.734479:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708581.734499:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365495168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708581.734557:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708581.734615:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365495168 00000100:00100000:3.0:1789708581.734626:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365495168 00000100:00100000:3.0:1789708581.734677:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789708581.734689:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365495168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789708581.734722:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789708581.734778:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365495168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708581.734787:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789708581.734819:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365495168:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789708582.502439:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789708583.337187:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789708583.337209:0:13756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789708583.526374:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708583.647135:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708583.647176:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708583.647196:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357050240 00000100:00100000:2.0:1789708583.647205:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708583.647206:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357050240 00000100:00100000:3.0:1789708583.647241:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357050368 00000100:00100000:3.0:1789708583.647249:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357050368 00000100:00100000:0.0:1789708583.647254:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 337 00000100:00100000:0.0:1789708583.647293:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+13:2397:x1876645357050240:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708583.647297:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357050496 00000100:00100000:1.0:1789708583.647304:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357050496 00000100:00100000:2.0:1789708583.647307:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708583.647334:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:2.0:1789708583.647340:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708583.647346:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:3.0:1789708583.647349:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357050368:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708583.647354:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+13:2397:x1876645357050240:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.647362:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357050496:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708583.647365:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 337 00000100:00100000:0.0:1789708583.647399:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357050624 00000100:00100000:0.0:1789708583.647403:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357050624 00000100:00100000:3.0:1789708583.647407:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357050368:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 63us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.647414:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357050496:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 56us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708583.647422:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:1.0:1789708583.647430:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:3.0:1789708583.647446:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357050880 00000100:00100000:0.0:1789708583.647449:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00080000:1.0:1789708583.647457:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708583.647458:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357050880 00000100:00080000:1.0:1789708583.647464:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708583.647464:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357050624:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:1.0:1789708583.647471:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708583.647476:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708583.647504:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357050752 00000100:00100000:0.0:1789708583.647507:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357050624:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.647509:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357050752 00000100:00100000:0.0:1789708583.647519:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:0.0:1789708583.647548:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:1.0:1789708583.647556:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:0.0:1789708583.647562:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357050880:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708583.647571:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357050752:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708583.647604:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357050880:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.647611:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357050752:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 43us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708583.647615:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:1.0:1789708583.647627:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00080000:0.0:1789708583.647656:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789708584.295417:0:9480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0bd23bbf-17fc-4232-922d-5f674c08c0de 00000020:00000080:2.0:1789708584.295426:0:9480:0:(genops.c:885:class_export_put()) final put ffff9bed08565000/0bd23bbf-17fc-4232-922d-5f674c08c0de 00000020:00000080:0.0:1789708584.295467:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08565000/0bd23bbf-17fc-4232-922d-5f674c08c0de for lustre-OST0001 00000020:00000080:0.0:1789708584.295511:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3fa12000 for lustre-OST0001 00010000:00010000:2.0:1789708584.550448:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708584.806492:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708584.806516:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365495296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708584.806587:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708584.806650:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365495296 00000100:00100000:1.0:1789708584.806659:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365495296 00000100:00100000:1.0:1789708584.806716:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789708584.806728:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365495296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708584.806761:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789708584.806840:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365495296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708584.806849:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789708584.806891:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365495296:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789708585.574443:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708585.830393:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365495424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708585.830489:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708585.830527:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365495552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708585.830572:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708585.830605:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365495424 00000100:00100000:1.0:1789708585.830615:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365495424 00000100:00100000:2.0:1789708585.830632:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365495552 00000100:00100000:2.0:1789708585.830638:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365495552 00000100:00100000:1.0:1789708585.830669:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789708585.830680:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365495424:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789708585.830703:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789708585.830709:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708585.830720:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0991a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365495808:0@lo:400:kworker.0 00000100:00100000:3.0:1789708585.830758:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365495680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708585.830767:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365495424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708585.830769:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708585.830779:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789708585.830805:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789708585.830816:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708585.830816:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365495552:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708585.830827:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365495808 00002000:00000024:1.0:1789708585.830831:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708585.830832:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365495808 00000100:00100000:3.0:1789708585.830845:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365496192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708585.830867:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789708585.830873:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365495552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708585.830882:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3616:x1876645365495808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708585.830883:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708585.830888:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789708585.830907:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365495680 00000100:00100000:1.0:1789708585.830911:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365495680 00000100:00100000:3.0:1789708585.830945:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365496192 00000100:00100000:2.0:1789708585.830946:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3616:x1876645365495808:12345-0@lo:400:kworker.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708585.830957:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789708585.830959:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365496192 00000100:00100000:2.0:1789708585.830960:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789708585.830968:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365495680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708585.830985:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708585.831019:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0991a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365495808:0@lo:400:kworker.0 00000100:00100000:2.0:1789708585.831056:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365496320:0@lo:400:kworker.0 00000100:00100000:0.0:1789708585.831106:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365496064:0@lo:400:kworker.0 00000100:00100000:1.0:1789708585.831205:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365495680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 239us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708585.831213:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789708585.831223:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365496704:0@lo:400:kworker.0 00000100:00100000:2.0:1789708585.831224:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708585.831232:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789708585.831241:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365496192:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708585.831257:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365496832:0@lo:400:kworker.0 00000100:00100000:3.0:1789708585.831283:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789708585.831284:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789708585.831315:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee11040700 x1876645365495680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708585.831322:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708585.831330:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365496192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708585.831337:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365495680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708585.831343:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789708585.831353:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fa91180 x1876645365496192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708585.831362:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365496192:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789708585.831366:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708585.831380:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365496320 00000100:00100000:2.0:1789708585.831386:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365496320 00000100:00100000:1.0:1789708585.831387:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365495936:0@lo:400:kworker.0 00000100:00100000:3.0:1789708585.831389:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365496704 00000100:00100000:3.0:1789708585.831395:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365496704 00000100:00100000:2.0:1789708585.831421:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365496832 00000100:00100000:1.0:1789708585.831426:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708585.831427:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365496832 00000100:00100000:3.0:1789708585.831431:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789708585.831441:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365496320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708585.831456:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365496448:0@lo:400:kworker.0 00000100:00100000:2.0:1789708585.831457:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365495936 00000100:00100000:2.0:1789708585.831463:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365495936 00000100:00100000:3.0:1789708585.831478:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365496320:12345-0@lo:400:kworker.0 Request processed in 40us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708585.831483:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789708585.831489:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789708585.831498:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708585.831502:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789708585.831503:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365496704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708585.831511:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365496832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708585.831527:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365496960:0@lo:400:kworker.0 00000100:00100000:3.0:1789708585.831551:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365496832:12345-0@lo:400:kworker.0 Request processed in 42us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708585.831556:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789708585.831566:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365496704:12345-0@lo:400:kworker.0 Request processed in 66us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708585.831566:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708585.831572:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789708585.831588:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789708585.831597:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365495936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708585.831598:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365495424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708585.831604:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365496960 00000100:00100000:2.0:1789708585.831610:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365496960 00000100:00100000:3.0:1789708585.831651:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365495936:12345-0@lo:400:kworker.0 Request processed in 61us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708585.831658:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789708585.831671:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365496960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708585.831672:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789708585.831694:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365495936:0@lo:400:kworker.0 00000100:00080000:3.0:1789708585.831699:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789708585.831705:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708585.831717:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365496448 00010000:00080000:1.0:1789708585.831717:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab1880 x1876645365496960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708585.831718:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365496960:12345-0@lo:400:kworker.0 Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708585.831725:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365496448 00000100:00100000:2.0:1789708585.831736:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789708585.831739:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365496960:0@lo:400:kworker.0 00000100:00100000:3.0:1789708585.831762:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789708585.831772:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365496448:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789708585.831784:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab1c00 x1876645365496704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708585.831795:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365496704:0@lo:400:kworker.0 00000100:00100000:3.0:1789708585.831819:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365496448:12345-0@lo:400:kworker.0 Request processed in 47us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708585.831823:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365496832:0@lo:400:kworker.0 00000100:00100000:3.0:1789708585.831829:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789708585.831853:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365496448:0@lo:400:kworker.0 00000100:00100000:2.0:1789708585.831855:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365496320:0@lo:400:kworker.0 00000100:00100000:0.0:1789708585.831928:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708585.831950:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365496576:0@lo:400:kworker.0 00000100:00100000:0.0:1789708585.831973:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708585.831998:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789708585.832002:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bed09919880, transno 4294967301 00000100:00100000:0.0:1789708585.832018:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365495552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708585.832026:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365496576 00000100:00100000:2.0:1789708585.832036:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365496576 00000100:00100000:1.0:1789708585.832060:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365496064 00000100:00100000:1.0:1789708585.832067:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365496064 00000100:00100000:2.0:1789708585.832087:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1789708585.832088:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708585.832110:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365496576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708585.832113:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789708585.832126:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365496064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708585.832169:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365496576:12345-0@lo:400:kworker.0 Request processed in 62us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708585.832179:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789708585.832192:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365496064:12345-0@lo:400:kworker.0 Request processed in 64us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708585.832193:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365496064:0@lo:400:kworker.0 00000100:00100000:0.0:1789708585.832206:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365496576:0@lo:400:kworker.0 00000100:00100000:1.0:1789708585.832222:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1789708586.598433:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708586.854440:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708586.854467:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365497088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708586.854522:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708586.854558:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365497088 00000100:00100000:3.0:1789708586.854566:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365497088 00000100:00100000:3.0:1789708586.854607:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789708586.854615:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365497088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789708586.854640:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789708586.854709:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365497088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708586.854713:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789708586.854760:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365497088:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789708587.622385:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708588.646416:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708588.767205:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708588.767256:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708588.767307:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357051008 00000100:00100000:0.0:1789708588.767316:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357051008 00000100:00100000:3.0:1789708588.767348:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357051264 00000100:00100000:3.0:1789708588.767355:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357051264 00000100:00100000:0.0:1789708588.767367:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 339 00000100:00100000:0.0:1789708588.767378:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:2395:x1876645357051008:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:1.0:1789708588.767392:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708588.767408:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708588.767412:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:3.0:1789708588.767425:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2395:x1876645357051264:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708588.767428:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357051136 00000100:00100000:1.0:1789708588.767434:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357051136 00000100:00100000:0.0:1789708588.767437:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:2395:x1876645357051008:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 61us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708588.767444:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 339 00000100:00100000:1.0:1789708588.767483:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00080000:0.0:1789708588.767484:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708588.767501:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2395:x1876645357051264:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 46us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708588.767503:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+5:2395:x1876645357051136:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708588.767517:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:1.0:1789708588.767552:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+5:2395:x1876645357051136:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 61us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708588.767586:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:2.0:1789708588.772293:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708588.772336:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708588.772355:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357051392 00000100:00100000:1.0:1789708588.772365:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357051392 00000100:00100000:2.0:1789708588.772367:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708588.772395:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357051520 00000100:00100000:3.0:1789708588.772401:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357051520 00000100:00100000:1.0:1789708588.772422:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1789708588.772432:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:2394:x1876645357051392:12345-192.168.201.52@tcp:9:kworker.0 00000100:00100000:3.0:1789708588.772440:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357051648 00000100:00100000:3.0:1789708588.772442:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357051648 00000100:00100000:0.0:1789708588.772447:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 111 00000020:00000080:1.0:1789708588.772462:0:10054:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cf15 00000100:00100000:0.0:1789708588.772462:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2396:x1876645357051520:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708588.772476:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00080000:1.0:1789708588.772479:0:10054:0:(import.c:65:import_set_state_nolock()) ffff9bed09821800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789708588.772493:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2396:x1876645357051648:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:3.0:1789708588.772508:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708588.772514:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789708588.772517:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1789708588.772530:0:10054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:3.0:1789708588.772532:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708588.772548:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2396:x1876645357051648:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708588.772548:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2396:x1876645357051520:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708588.772562:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:0.0:1789708588.772580:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:1.0:1789708588.772644:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+2:2394:x1876645357051392:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 213us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708588.772652:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00010000:00010000:0.0:1789708589.670434:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708589.926453:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708589.926475:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365497216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708589.926530:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708589.926597:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365497216 00000100:00100000:1.0:1789708589.926607:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365497216 00000100:00100000:1.0:1789708589.926671:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789708589.926681:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365497216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708589.926712:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789708589.926762:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365497216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708589.926771:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789708589.926795:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365497216:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789708590.694382:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708590.950373:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708590.950383:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365497472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708590.950389:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365497344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708590.950442:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708590.950497:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365497728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708590.950513:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365497344 00000100:00100000:0.0:1789708590.950518:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708590.950520:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365497344 00000100:00100000:3.0:1789708590.950541:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365497600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708590.950548:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365497728 00000100:00100000:0.0:1789708590.950552:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365497728 00000100:00100000:2.0:1789708590.950570:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708590.950575:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708590.950585:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365497344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708590.950588:0:8400:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789708590.950598:0:8400:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1789708590.950629:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789708590.950682:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365497344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708590.950690:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708590.950695:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789708590.950717:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365497984:0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.950731:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365497600 00000100:00100000:2.0:1789708590.950736:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365497600 00000100:00100000:0.0:1789708590.950746:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708590.950761:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365497472 00000100:00100000:2.0:1789708590.950765:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365497472 00000100:00100000:0.0:1789708590.950766:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365498496:0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.950786:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789708590.950790:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708590.950796:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365498240:0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.950797:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365497728:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708590.950811:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00002000:00000024:2.0:1789708590.950818:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708590.950819:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365498112:0@lo:400:kworker.0 00000100:00100000:3.0:1789708590.950848:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708590.950872:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708590.950875:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365498752:0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.950881:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365497728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708590.950887:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789708590.950900:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365498624:0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.950902:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789708590.950909:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365497600:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708590.950916:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789708590.950923:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708590.950954:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708590.950961:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365497600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708590.950966:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365497728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708590.950975:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1789708590.950993:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab3b80 x1876645365497344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708590.950997:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789708590.951001:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365497984 00000100:00100000:2.0:1789708590.951008:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365497472:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708590.951008:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365497984 00000100:00100000:3.0:1789708590.951012:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365497344:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789708590.951019:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789708590.951048:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365498496 00000100:00100000:2.0:1789708590.951053:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365497472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708590.951053:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365498496 00000100:00100000:2.0:1789708590.951062:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789708590.951063:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789708590.951072:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365498240 00000100:00100000:3.0:1789708590.951073:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365497856:0@lo:400:kworker.0 00000100:00100000:0.0:1789708590.951076:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365498240 00000100:00100000:0.0:1789708590.951096:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365498752 00000100:00100000:2.0:1789708590.951097:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365498624 00000100:00100000:0.0:1789708590.951098:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365498752 00000100:00100000:2.0:1789708590.951105:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365498624 00000100:00100000:0.0:1789708590.951121:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789708590.951123:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708590.951130:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365497984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.951138:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789708590.951149:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365498496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708590.951154:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365498368:0@lo:400:kworker.0 00000100:00100000:0.0:1789708590.951165:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365497984:12345-0@lo:400:kworker.0 Request processed in 37us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708590.951169:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789708590.951184:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789708590.951192:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708590.951196:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365498496:12345-0@lo:400:kworker.0 Request processed in 49us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708590.951200:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789708590.951203:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365498240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708590.951218:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365498880:0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.951219:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789708590.951232:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365498752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708590.951236:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365498240:12345-0@lo:400:kworker.0 Request processed in 45us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708590.951242:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789708590.951248:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708590.951275:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789708590.951282:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365498624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.951297:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365498752:12345-0@lo:400:kworker.0 Request processed in 67us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708590.951302:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365498240:0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.951304:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789708590.951315:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365498624:12345-0@lo:400:kworker.0 Request processed in 33us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708590.951324:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365498752:0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.951324:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365498880 00000100:00100000:0.0:1789708590.951324:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789708590.951329:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365498880 00000100:00100000:2.0:1789708590.951368:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789708590.951369:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365498112 00000100:00100000:3.0:1789708590.951374:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365498112 00000100:00100000:2.0:1789708590.951377:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365498880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708590.951409:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365498368 00000100:00100000:3.0:1789708590.951412:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365498368 00000100:00100000:2.0:1789708590.951414:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365498880:12345-0@lo:400:kworker.0 Request processed in 39us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708590.951420:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789708590.951437:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789708590.951446:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365498112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.951447:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789708590.951459:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365498368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708590.951489:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365498112:12345-0@lo:400:kworker.0 Request processed in 44us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708590.951498:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789708590.951500:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365497856 00000100:00100000:2.0:1789708590.951502:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365498368:12345-0@lo:400:kworker.0 Request processed in 44us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708590.951506:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365497856 00000100:00100000:2.0:1789708590.951509:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789708590.951537:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00080000:2.0:1789708590.951541:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708590.951545:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3615:x1876645365497856:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789708590.951547:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708590.951550:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789708590.951558:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708590.951586:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365498368:0@lo:400:kworker.0 00000100:00100000:0.0:1789708590.951591:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3615:x1876645365497856:12345-0@lo:400:kworker.0 Request processed in 47us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708590.951593:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365498112:0@lo:400:kworker.0 00010000:00080000:3.0:1789708590.951603:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086a7480 x1876645365498880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708590.951608:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00010000:00080000:2.0:1789708590.951616:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086a4e00 x1876645365498624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708590.951617:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365498880:0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.951633:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365498624:0@lo:400:kworker.0 00000100:00100000:2.0:1789708590.951656:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365497984:0@lo:400:kworker.0 00000100:00100000:3.0:1789708590.951659:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365497856:0@lo:400:kworker.0 00010000:00080000:0.0:1789708590.951684:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee11043800 x1876645365497600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708590.951686:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365498496:0@lo:400:kworker.0 00000100:00100000:0.0:1789708590.951709:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365497600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708590.951715:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365497472:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789708591.723431:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708591.974369:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708591.974387:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365499008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789708591.974445:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708591.974482:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365499008 00000100:00100000:1.0:1789708591.974491:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365499008 00000100:00100000:1.0:1789708591.974537:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789708591.974547:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365499008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789708591.974577:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789708591.974631:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365499008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708591.974640:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789708591.974654:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365499008:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789708592.743341:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789708592.762825:0:14015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:16:32 (1789708592) 00000100:00100000:3.0:1789708593.324166:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708593.324228:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357051776 00000100:00100000:0.0:1789708593.324238:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357051776 00000100:00080000:2.0:1789708593.324300:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708593.324358:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:0.0:1789708593.324371:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:11065:x1876645357051776:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708593.324392:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708593.324455:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165aa00/0xf45f43947e47cff5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df58 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.324513:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a600/0xf45f43947e47cffc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.324527:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a600/0xf45f43947e47cffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.324540:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a600/0xf45f43947e47cffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708593.324593:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789708593.324597:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708593.324634:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a600/0xf45f43947e47cffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.324670:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165aa00/0xf45f43947e47cff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df58 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.324688:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a600/0xf45f43947e47cffc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df58 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.324698:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48700) 00010000:00010000:0.0:1789708593.324701:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708593.324704:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee0165a600, rc 0) 00000100:00100000:0.0:1789708593.324755:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:11065:x1876645357051776:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 388us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.324764:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:0.0:1789708593.328955:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708593.329025:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357051904 00000100:00100000:2.0:1789708593.329034:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357051904 00000100:00100000:2.0:1789708593.329111:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:2.0:1789708593.329123:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+6:11066:x1876645357051904:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708593.329144:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708593.329165:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47d003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df5f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329214:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d00a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329224:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d00a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329233:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d00a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329257:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d011 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329291:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329300:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329369:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47d018 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329375:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47d018 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329380:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47d018 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708593.329420:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789708593.329423:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708593.329445:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47d018 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329455:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d00a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329460:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d00a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329467:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d00a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329482:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebdc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708593.329486:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d00a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329493:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d00a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329505:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48700) 00010000:00010000:2.0:1789708593.329507:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708593.329512:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d00a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329517:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d00a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329530:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329536:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d011 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329542:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d011 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329547:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708593.329554:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d011 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329559:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d011 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329571:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bee2c76c600) 00010000:00010000:2.0:1789708593.329573:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708593.329575:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d011 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329579:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d011 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329601:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47d003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df5f expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329608:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47d018 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df5f expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.329612:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bee2c76c700) 00010000:00010000:2.0:1789708593.329614:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708593.329615:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc400, rc 0) 00000100:00100000:2.0:1789708593.329661:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:11066:x1876645357051904:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 542us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708593.329665:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:2.0:1789708593.330941:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708593.330985:0:9146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357052032 00000100:00100000:0.0:1789708593.330992:0:9146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357052032 00000100:00100000:0.0:1789708593.331029:0:9146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789708593.331037:0:9146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:68824747-448a-469b-b2cf-e27bc037ded7+7:11066:x1876645357052032:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789708593.331092:0:9146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:68824747-448a-469b-b2cf-e27bc037ded7+7:11066:x1876645357052032:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 Request processed in 56us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.331099:0:9146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789708593.332244:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708593.332297:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357052288 00000100:00100000:0.0:1789708593.332303:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357052288 00000100:00100000:0.0:1789708593.332341:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:0.0:1789708593.332351:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:11066:x1876645357052288:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708593.332363:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708593.332402:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165aa00/0xf45f43947e47d01f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df66 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332465:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a000/0xf45f43947e47d026 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332477:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a000/0xf45f43947e47d026 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332486:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a000/0xf45f43947e47d026 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332542:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165b200/0xf45f43947e47d02d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332551:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165b200/0xf45f43947e47d02d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332558:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165b200/0xf45f43947e47d02d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332662:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1c00/0xf45f43947e47d034 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332672:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1c00/0xf45f43947e47d034 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332679:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1c00/0xf45f43947e47d034 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708593.332688:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789708593.332762:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a000/0xf45f43947e47d026 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332789:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a000/0xf45f43947e47d026 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332797:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a000/0xf45f43947e47d026 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332803:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee0165a000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708593.332807:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a000/0xf45f43947e47d026 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332813:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a000/0xf45f43947e47d026 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332823:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bee2c76c700) 00010000:00010000:0.0:1789708593.332825:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708593.332828:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a000/0xf45f43947e47d026 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332831:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a000/0xf45f43947e47d026 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332840:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165b200/0xf45f43947e47d02d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332843:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165b200/0xf45f43947e47d02d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332847:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165b200/0xf45f43947e47d02d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332850:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee0165b200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708593.332856:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165b200/0xf45f43947e47d02d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332859:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165b200/0xf45f43947e47d02d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332863:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bee08f48c00) 00010000:00010000:0.0:1789708593.332865:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708593.332866:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165b200/0xf45f43947e47d02d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.332870:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165b200/0xf45f43947e47d02d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.333073:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165aa00/0xf45f43947e47d01f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df66 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.333082:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1c00/0xf45f43947e47d034 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df66 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.333087:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:0.0:1789708593.333088:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708593.333090:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1c00, rc 0) 00000100:00100000:0.0:1789708593.333125:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+9:11066:x1876645357052288:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 778us (884us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789708593.333131:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:2.0:1789708593.334677:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708593.334721:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357052416 00000100:00100000:0.0:1789708593.334728:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357052416 00000100:00100000:0.0:1789708593.334771:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:0.0:1789708593.334791:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+9:11066:x1876645357052416:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789708593.334859:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+9:11066:x1876645357052416:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.334864:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:2.0:1789708593.335735:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708593.335768:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357052544 00000100:00100000:0.0:1789708593.335772:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357052544 00000100:00100000:0.0:1789708593.335821:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00080000:2.0:1789708593.335822:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708593.335827:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:11066:x1876645357052544:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789708593.336393:0:8421:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 540us 00000100:00100000:2.0:1789708593.341724:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:11066:x1876645357052544:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 5890us (5983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708593.341734:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000040:00080000:0.0:1789708593.576965:0:13756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789708593.576973:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789708593.766400:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708593.887061:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708593.887106:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708593.887128:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357052800 00000100:00100000:0.0:1789708593.887138:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357052800 00000100:00100000:3.0:1789708593.887144:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708593.887164:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357052672 00000100:00100000:2.0:1789708593.887170:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357052672 00000100:00100000:1.0:1789708593.887194:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357052928 00000100:00100000:1.0:1789708593.887201:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357052928 00000100:00100000:2.0:1789708593.887217:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 341 00000100:00100000:0.0:1789708593.887218:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:2.0:1789708593.887229:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:2396:x1876645357052672:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708593.887236:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2395:x1876645357052800:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708593.887247:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00080000:1.0:1789708593.887299:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708593.887302:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2396:x1876645357052928:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:1.0:1789708593.887304:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708593.887311:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:2396:x1876645357052672:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 84us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.887313:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2395:x1876645357052800:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708593.887321:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 341 00000100:00100000:0.0:1789708593.887328:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:3.0:1789708593.887344:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2396:x1876645357052928:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708593.887353:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 120 00000001:00100000:1.0:1789708594.023463:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000020:00000080:1.0:1789708594.023471:0:8392:0:(genops.c:885:class_export_put()) final put ffff9bed09820000/68824747-448a-469b-b2cf-e27bc037ded7 00000020:00000080:3.0:1789708594.023509:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed09820000/68824747-448a-469b-b2cf-e27bc037ded7 for lustre-OST0000 00000020:00000080:3.0:1789708594.023561:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed09821800 for lustre-OST0000 00000100:00100000:0.0:1789708594.039110:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.039173:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357053056 00000100:00100000:1.0:1789708594.039184:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357053056 00000100:00100000:1.0:1789708594.039274:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1789708594.039287:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+9:11108:x1876645357053056:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708594.039308:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708594.039328:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d042 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df6d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039415:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d049 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039430:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d049 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039441:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d049 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039459:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d050 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039467:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d050 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039474:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d050 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039514:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d049 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039523:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d049 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039530:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d049 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039538:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708594.039542:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d049 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039560:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d049 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039573:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48700) 00010000:00010000:1.0:1789708594.039576:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708594.039581:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039588:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039600:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d050 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039606:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d050 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039612:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d050 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039617:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708594.039620:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d050 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039627:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d050 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039634:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bed08848d00) 00010000:00010000:1.0:1789708594.039637:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708594.039640:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d050 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039656:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d050 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039688:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d042 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df6d expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039698:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48700) 00010000:00010000:1.0:1789708594.039700:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708594.039704:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d042 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df6d expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.039715:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949400, rc 0) 00000100:00100000:1.0:1789708594.039792:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+9:11108:x1876645357053056:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 507us (690us total) trans 0 rc 301/301 00000100:00100000:1.0:1789708594.039802:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1789708594.043870:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.043926:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357053312 00000100:00100000:0.0:1789708594.043935:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357053312 00000100:00100000:0.0:1789708594.043996:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:0.0:1789708594.044008:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+9:11108:x1876645357053312:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:0.0:1789708594.044072:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708594.044099:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee0165a600/0xf45f43947e47cffc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df58 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044117:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48700) 00010000:00010000:0.0:1789708594.044132:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708594.044191:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d057 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044204:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d057 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044215:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d057 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044227:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044235:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044242:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044785:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044795:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044803:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708594.044818:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062af1b5d reply state 000000006710053f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044829:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044844:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708594.044846:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708594.044849:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789708594.044853:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789708594.044858:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d057 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044863:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d057 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044867:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d057 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044871:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.044874:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d057 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044879:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d057 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044884:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48c00) 00010000:00010000:0.0:1789708594.044885:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.044887:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d057 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044891:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d057 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708594.044903:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062af1b5d reply state 000000006710053f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044919:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.044925:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bee08f48800) 00010000:00010000:0.0:1789708594.044927:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708594.044929:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789708594.045019:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+10:11108:x1876645357053312:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 1012us (1154us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789708594.045028:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1789708594.074398:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.074455:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357053440 00000100:00100000:0.0:1789708594.074463:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357053440 00000100:00100000:0.0:1789708594.074506:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:0.0:1789708594.074518:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+10:11116:x1876645357053440:12345-192.168.201.52@tcp:101:lctl.0 00010000:00010000:0.0:1789708594.074538:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708594.074556:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d06c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df74 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.074602:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d073 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.074615:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.074625:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708594.074665:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789708594.074669:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708594.074720:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.074744:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d06c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df74 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.074758:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df74 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.074777:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48c00) 00010000:00010000:0.0:1789708594.074780:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708594.074784:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0400, rc 0) 00000100:00100000:0.0:1789708594.074839:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+11:11116:x1876645357053440:12345-192.168.201.52@tcp:101:lctl.0 Request processed in 321us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708594.074846:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:2.0:1789708594.097948:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708594.098046:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357053568 00000100:00100000:3.0:1789708594.098056:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357053568 00000100:00100000:3.0:1789708594.098118:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:3.0:1789708594.098130:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+11:11122:x1876645357053568:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708594.098150:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708594.098168:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d07a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df7b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098223:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d081 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098236:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d081 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098247:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d081 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098298:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d088 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098306:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098313:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098387:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47d08f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098396:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47d08f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098403:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47d08f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708594.098435:0:8421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789708594.098439:0:8421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708594.098474:0:8421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47d08f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098485:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d081 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098491:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d081 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098497:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d081 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098512:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708594.098516:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d081 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098523:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d081 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098535:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48c00) 00010000:00010000:3.0:1789708594.098537:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708594.098542:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098548:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098561:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098566:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d088 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098572:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d088 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098577:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708594.098580:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d088 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098586:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d088 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098603:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bee08f48800) 00010000:00010000:3.0:1789708594.098606:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708594.098609:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d088 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098615:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d088 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098637:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d07a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df7b expref: 13 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098649:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47d08f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df7b expref: 12 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.098656:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:3.0:1789708594.098658:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789708594.098661:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8600, rc 0) 00000100:00100000:3.0:1789708594.098715:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+12:11122:x1876645357053568:12345-192.168.201.52@tcp:101:bash.0 Request processed in 588us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708594.098723:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:1.0:1789708594.100083:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.100143:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357053824 00000100:00100000:0.0:1789708594.100149:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357053824 00000100:00100000:0.0:1789708594.100186:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:0.0:1789708594.100195:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+12:11122:x1876645357053824:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708594.100206:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708594.100218:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d096 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df82 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100299:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d09d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100310:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d09d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100317:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d09d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100355:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100362:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100367:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789708594.100691:0:13656:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789708594.100832:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100841:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100847:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100875:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d09d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100882:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d09d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100888:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d09d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100894:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.100897:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d09d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100913:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d09d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100923:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708594.100926:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.100929:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d09d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100935:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d09d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708594.100946:0:13656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030ade28f reply state 00000000c03fdfcc transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100956:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100962:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48700) 00010000:00010000:0.0:1789708594.100964:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708594.100966:0:13656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789708594.100987:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d096 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df82 expref: 15 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.100996:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df82 expref: 14 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.101000:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:0.0:1789708594.101002:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708594.101003:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1e00, rc 0) 00000100:00100000:0.0:1789708594.101041:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+15:11122:x1876645357053824:12345-192.168.201.52@tcp:101:bash.0 Request processed in 849us (961us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789708594.101045:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:2.0:1789708594.102653:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.102707:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357053952 00000100:00100000:1.0:1789708594.102713:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357053952 00000100:00100000:1.0:1789708594.102742:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1789708594.102748:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1876645357053952:12345-192.168.201.52@tcp:8:bash.0 00010000:00080000:1.0:1789708594.102786:0:8397:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1789708594.102813:0:8397:0:(genops.c:1384:class_connect()) connect: client 68824747-448a-469b-b2cf-e27bc037ded7, cookie 0xf45f43947e47d0b9 00002000:00100000:1.0:1789708594.102824:0:8397:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 68824747-448a-469b-b2cf-e27bc037ded7/ffff9bee3fa41000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789708594.102840:0:8397:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789708594.102895:0:8397:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789708594.102921:0:8397:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa45000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708594.102962:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2394:x1876645357053952:12345-192.168.201.52@tcp:8:bash.0 Request processed in 213us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.102969:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:2.0:1789708594.103675:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708594.103711:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357054080 00000100:00100000:3.0:1789708594.103717:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357054080 00000100:00100000:3.0:1789708594.103779:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00080000:1.0:1789708594.103782:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708594.103789:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:0:x1876645357054080:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708594.103800:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708594.103818:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ea71910/0xf45f43947e47d0c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df89 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708594.103859:0:8398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708594.103873:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=164s v=(0 0) 00010000:00010000:3.0:1789708594.103877:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708594.103885:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ea71910/0xf45f43947e47d0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df89 expref: 7 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.103903:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ea71910/0xf45f43947e47d0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df89 expref: 7 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.103915:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9400, rc 0) 00000100:00100000:3.0:1789708594.103947:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+7:0:x1876645357054080:12345-192.168.201.52@tcp:101:bash.0 Request processed in 161us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708594.103954:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:2.0:1789708594.104973:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.105023:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357054208 00000100:00100000:1.0:1789708594.105029:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357054208 00000100:00100000:1.0:1789708594.105063:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:1.0:1789708594.105072:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+7:11122:x1876645357054208:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708594.105081:0:10054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708594.105091:0:10054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df90 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.105110:0:10054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ea71910/0xf45f43947e47d0c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df89 expref: 8 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.105116:0:10054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708594.105118:0:10054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708594.105121:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 8 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.105150:0:10054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ea71910/0xf45f43947e47d0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df89 expref: 8 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.105160:0:10054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ea71910/0xf45f43947e47d0c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df89 expref: 8 pid: 8398 timeout: 264 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.105179:0:10054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10054:1876645365499136:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708594.105235:0:10054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee182cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708594.105972:0:10054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10054:1876645365499136:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708594.105987:0:10054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 8 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.105996:0:10054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948e00, rc 0) 00000100:00100000:1.0:1789708594.106020:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+8:11122:x1876645357054208:12345-192.168.201.52@tcp:101:bash.0 Request processed in 951us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.106025:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:2.0:1789708594.106245:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.106291:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357054336 00000100:00100000:1.0:1789708594.106296:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357054336 00010000:00010000:1.0:1789708594.106312:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ea71910/0xf45f43947e47d0c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df89 expref: 8 pid: 8398 timeout: 264 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.106332:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:1.0:1789708594.106338:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357054336:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708594.106345:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708594.106356:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ea71910/0xf45f43947e47d0c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df89 expref: 8 pid: 8398 timeout: 264 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.106363:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ea71910/0xf45f43947e47d0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df89 expref: 8 pid: 8398 timeout: 264 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.106387:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ea71910/0xf45f43947e47d0c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df89 expref: 8 pid: 8398 timeout: 264 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.106399:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708594.106402:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708594.106409:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 7 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.106418:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 7 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.106442:0:6469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 7 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.106449:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6469:1876645365499264:192.168.201.52@tcp:105: 00000100:00100000:1.0:1789708594.106479:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee182cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708594.107253:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6469:1876645365499264:192.168.201.52@tcp:105: 00010000:00010000:1.0:1789708594.107296:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708594.107322:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2396:x1876645357054336:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 984us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.107328:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1789708594.107649:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.107706:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357054592 00000100:00100000:0.0:1789708594.107717:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357054592 00000100:00100000:0.0:1789708594.107757:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789708594.107779:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+15:11122:x1876645357054592:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1789708594.108003:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+16:11122:x1876645357054592:12345-192.168.201.52@tcp:35:bash.0 Request processed in 237us (353us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789708594.108011:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1789708594.138040:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708594.138150:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357054848 00000100:00100000:3.0:1789708594.138159:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357054848 00000100:00100000:3.0:1789708594.138213:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:3.0:1789708594.138223:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+16:11132:x1876645357054848:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708594.138247:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708594.138293:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d0ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df97 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708594.138382:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789708594.138484:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d0ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df97 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.138512:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48c00) 00010000:00010000:3.0:1789708594.138514:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708594.138518:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d0ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df97 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.138528:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8e00, rc 0) 00000100:00100000:3.0:1789708594.138570:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+17:11132:x1876645357054848:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 350us (540us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1789708594.138579:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:2.0:1789708594.139688:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708594.139733:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357055104 00000100:00100000:3.0:1789708594.139738:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357055104 00000100:00100000:3.0:1789708594.139784:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789708594.139792:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+17:11132:x1876645357055104:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708594.139895:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+18:11132:x1876645357055104:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 104us (208us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789708594.139903:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789708594.165923:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.166001:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357055232 00000100:00100000:1.0:1789708594.166012:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357055232 00000100:00100000:1.0:1789708594.166076:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:1.0:1789708594.166099:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+18:11138:x1876645357055232:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708594.166125:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708594.166154:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d0dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715df9e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.166218:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d0e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.166232:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.166242:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708594.166311:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789708594.166315:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708594.166336:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.166363:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d0dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df9e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.166380:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df9e expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.166389:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:1.0:1789708594.166392:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708594.166396:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949c00, rc 0) 00000100:00100000:1.0:1789708594.166452:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+19:11138:x1876645357055232:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 355us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.166470:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:2.0:1789708594.168311:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.168412:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357055488 00000100:00100000:0.0:1789708594.168421:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357055488 00000100:00100000:0.0:1789708594.168468:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:0.0:1789708594.168477:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+19:11138:x1876645357055488:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708594.168491:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708594.168506:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d0ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfa5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.168585:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d0f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.168598:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df82 expref: 20 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.168606:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d0f1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.168636:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df82 expref: 20 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.168659:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df82 expref: 20 pid: 13656 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.168672:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365499392:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708594.168776:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708594.169526:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365499392:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708594.169543:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d0f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708594.169730:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708594.169777:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357055616 00000100:00100000:3.0:1789708594.169783:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357055616 00010000:00010000:3.0:1789708594.169845:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df82 expref: 21 pid: 13656 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708594.169869:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:3.0:1789708594.169875:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08577850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+21:2395:x1876645357055616:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708594.169883:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708594.169893:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df82 expref: 21 pid: 13656 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.169904:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df82 expref: 21 pid: 13656 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.169924:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d0ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df82 expref: 21 pid: 13656 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.169935:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:3.0:1789708594.169938:0:7427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d0f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.169943:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d0f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.169948:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d0f1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.169963:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708594.169988:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08577850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+20:2395:x1876645357055616:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 113us (259us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708594.169992:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d0f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708594.169996:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00010000:00010000:0.0:1789708594.170006:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d0f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708594.170020:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789708594.170122:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d0ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfa5 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.170137:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d0f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfa5 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.170145:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:0.0:1789708594.170149:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789708594.170151:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708594.170183:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+20:11138:x1876645357055488:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1707us (1874us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789708594.170200:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:2.0:1789708594.171353:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.171394:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357055872 00000100:00100000:0.0:1789708594.171400:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357055872 00000100:00100000:0.0:1789708594.171432:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:0.0:1789708594.171441:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+20:11138:x1876645357055872:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708594.171454:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708594.171456:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789708594.171467:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d0f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfa5 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.171478:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:0.0:1789708594.171486:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708594.171496:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d0ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfac expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.171548:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d106 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.171558:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d106 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.171565:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d106 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708594.171573:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789708594.171622:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d0ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfac expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.171644:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d106 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfac expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.171651:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48300) 00010000:00010000:0.0:1789708594.171653:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789708594.171656:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0800, rc 0) 00000100:00100000:0.0:1789708594.171685:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+21:11138:x1876645357055872:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 247us (333us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789708594.171692:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1789708594.173674:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.173736:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357056000 00000100:00100000:1.0:1789708594.173743:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357056000 00000100:00100000:1.0:1789708594.173801:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:1.0:1789708594.173810:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+21:11138:x1876645357056000:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708594.173826:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708594.173839:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d114 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfb3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.173874:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d114 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfb3 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.173900:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d114 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfb3 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.173917:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48300) 00010000:00010000:1.0:1789708594.173920:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708594.173923:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948000, rc 0) 00000100:00100000:1.0:1789708594.173966:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+22:11138:x1876645357056000:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 158us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.173973:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:2.0:1789708594.175829:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.175932:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357056128 00000100:00100000:1.0:1789708594.175939:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357056128 00000100:00100000:1.0:1789708594.175979:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:1.0:1789708594.175989:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357056128:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:1.0:1789708594.176021:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.176063:0:8397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 7 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.176073:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708594.176077:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708594.176082:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.176115:0:8397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 7 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.176129:0:8397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 7 pid: 10054 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.176142:0:8397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8397:1876645365499520:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708594.176211:0:8397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee182cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708594.177059:0:8397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8397:1876645365499520:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708594.177076:0:8397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708594.177368:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.177411:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357056256 00000100:00100000:0.0:1789708594.177425:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357056256 00002000:00100000:0.0:1789708594.177454:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9bee086d2680 x1876645357056256/t0(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:735/0 lens 504/0 e 0 to 0 dl 1789708605 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708594.177463:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086d2680 with x1876645357056256 ext(0->12) 00010000:00010000:0.0:1789708594.177471:0:8402:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 8 pid: 10054 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.177484:0:8402:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 8 pid: 10054 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708594.177492:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bee086d2680 00000100:00100000:0.0:1789708594.177513:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:0.0:1789708594.177521:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357056256:12345-192.168.201.52@tcp:4:lfs.0 00000001:00100000:2.0:1789708594.178679:0:9480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000100:00100000:0.0:1789708594.179076:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68824747-448a-469b-b2cf-e27bc037ded7+9:2396:x1876645357056256:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 1553us (1706us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789708594.179092:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00002000:00100000:0.0:1789708594.179101:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9bee086d2680 x1876645357056256/t4294967300(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:735/0 lens 504/448 e 0 to 0 dl 1789708605 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708594.179111:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086d2680 with x1876645357056256 ext(0->12) 00010000:00010000:0.0:1789708594.179119:0:8402:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 9 pid: 10054 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.179134:0:8402:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 9 pid: 10054 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708594.179142:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bee086d2680 00000100:00100000:2.0:1789708594.180023:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.180082:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357056384 00000100:00100000:1.0:1789708594.180088:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357056384 00010000:00010000:1.0:1789708594.180113:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 9 pid: 10054 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.180156:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1789708594.180165:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+9:2395:x1876645357056384:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708594.180176:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789708594.180189:0:6470:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789708594.180192:0:6470:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789708593 00002000:00010000:1.0:1789708594.180195:0:6470:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789708593 00002000:00010000:1.0:1789708594.180197:0:6470:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789708593 00002000:00010000:1.0:1789708594.180199:0:6470:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789708594.180204:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 9 pid: 10054 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.180215:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 9 pid: 10054 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.180236:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ee50df9/0xf45f43947e47d0c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df90 expref: 9 pid: 10054 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.180250:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708594.180253:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708594.180278:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.180289:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.180328:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708594.180356:0:8397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.180368:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357056384:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 202us (343us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708594.180371:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.180385:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00010000:00010000:3.0:1789708594.180408:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.180416:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.180425:0:8397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.180432:0:8397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708594.180437:0:8397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.180446:0:8397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.180457:0:8397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.180461:0:8397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000649885b6/0xf45f43947e47d11b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708594.180549:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357056128:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 4561us (4722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708594.180556:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:2.0:1789708594.181429:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.181471:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357056640 00000100:00100000:0.0:1789708594.181475:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357056640 00000100:00100000:0.0:1789708594.181501:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1789708594.181507:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+22:11138:x1876645357056640:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:0.0:1789708594.181541:0:6487:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d106 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfac expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789708594.181685:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1789708594.181715:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789708594.181981:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1789708594.182005:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.182015:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d114 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfb3 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.182028:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.182048:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d114 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfb3 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.182056:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d114 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfb3 expref: 26 pid: 6512 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.182065:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6487:1876645365499648:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708594.182108:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e872300 going to sleep for 11 seconds 00000100:00100000:0.0:1789708594.182807:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6487:1876645365499648:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708594.182823:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708594.183131:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708594.183167:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357056768 00000100:00100000:3.0:1789708594.183174:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357056768 00010000:00010000:3.0:1789708594.183246:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d114 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfb3 expref: 27 pid: 6512 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708594.183302:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:3.0:1789708594.183314:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+27:2395:x1876645357056768:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708594.183324:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708594.183331:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d114 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfb3 expref: 27 pid: 6512 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.183342:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d114 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfb3 expref: 27 pid: 6512 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.183357:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d114 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfb3 expref: 27 pid: 6512 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.183370:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48300) 00010000:00010000:3.0:1789708594.183375:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.183394:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.183402:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.183421:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708594.183448:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708594.183456:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+26:2395:x1876645357056768:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 144us (323us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708594.183459:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708594.183474:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000001:00080000:0.0:1789708594.183511:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1789708594.183591:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789708594.183669:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6487:1876645365499776:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789708594.183712:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708594.183737:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08a91900 going to sleep for 11 seconds 00000100:00100000:2.0:1789708594.183779:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365499776 00000100:00100000:2.0:1789708594.183790:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365499776 00000100:00100000:2.0:1789708594.183833:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789708594.183834:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708594.183843:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6487:x1876645365499776:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789708594.183913:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6487:x1876645365499776:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708594.183921:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789708594.183954:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6487:1876645365499776:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789708594.184083:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1789708594.184117:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6487:1876645365499904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789708594.184152:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708594.184172:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08a91480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708594.184189:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365499904 00000100:00100000:1.0:1789708594.184194:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365499904 00000100:00100000:1.0:1789708594.184225:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789708594.184233:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6487:x1876645365499904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789708594.184362:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6487:x1876645365499904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (209us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789708594.184370:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789708594.184381:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6487:1876645365499904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789708594.184408:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1789708594.184446:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.184454:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.184460:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.184466:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.184470:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.184477:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.184486:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48300) 00010000:00010000:0.0:1789708594.184488:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789708594.184492:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.184497:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d122 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789708594.184557:0:6487:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789708594.184617:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789708594.184627:0:6487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164994365885ns, next at 165994363488ns, rc = 0 00000001:00080000:0.0:1789708594.184633:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1789708594.184651:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48300) 00010000:00010000:0.0:1789708594.184654:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789708594.184659:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d106 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfac expref: 30 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.184725:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+29:11138:x1876645357056640:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 3216us (3296us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1789708594.184732:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000020:00080000:0.0:1789708594.184736:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789708594.186090:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.188849:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357056896 00000100:00100000:1.0:1789708594.188863:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357056896 00000100:00100000:1.0:1789708594.188923:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1789708594.188933:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+29:11138:x1876645357056896:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708594.188956:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708594.188978:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d129 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfba expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.189029:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d129 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfba expref: 30 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.189043:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d129 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfba expref: 30 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.189077:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708594.189080:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708594.189083:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949a00, rc 0) 00000100:00100000:1.0:1789708594.189143:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+30:11138:x1876645357056896:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 212us (3057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.189150:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:2.0:1789708594.191089:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708594.191129:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357057152 00000100:00100000:3.0:1789708594.191137:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357057152 00000100:00100000:3.0:1789708594.191171:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1789708594.191181:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2c799450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+30:11138:x1876645357057152:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708594.191375:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2c799450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+31:11138:x1876645357057152:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 197us (293us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789708594.191384:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:2.0:1789708594.217976:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708594.218029:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357057408 00000100:00100000:3.0:1789708594.218038:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357057408 00000100:00100000:3.0:1789708594.218085:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:3.0:1789708594.218092:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+31:11149:x1876645357057408:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708594.218113:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708594.218128:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfc1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.218213:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d137 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.218224:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d137 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.218234:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d137 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708594.218241:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789708594.218338:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc1 expref: 34 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.218373:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d137 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc1 expref: 33 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.218382:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:3.0:1789708594.218386:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789708594.218389:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9000, rc 0) 00000100:00100000:3.0:1789708594.218447:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+33:11149:x1876645357057408:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 353us (478us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789708594.218455:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:2.0:1789708594.219489:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.219545:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357057536 00000100:00100000:0.0:1789708594.219552:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357057536 00000100:00100000:0.0:1789708594.219591:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:0.0:1789708594.219601:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+33:11149:x1876645357057536:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:0.0:1789708594.219641:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d145 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219652:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d145 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219661:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d145 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219671:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d14c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219679:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d14c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219699:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d14c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219778:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219787:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219794:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708594.219827:0:8421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219839:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d145 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219845:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d145 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219852:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d145 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219858:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.219862:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d145 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219869:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d145 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219878:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708594.219886:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.219891:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d145 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219897:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d145 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219907:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d14c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219912:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d14c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219918:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d14c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219922:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.219925:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d14c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219931:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d14c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219938:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48700) 00010000:00010000:0.0:1789708594.219940:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.219943:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d14c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219948:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d14c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219957:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219967:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219973:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219977:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.219981:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219987:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.219995:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.219997:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.220000:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.220006:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d153 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.220055:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+33:11149:x1876645357057536:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 457us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708594.220062:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:2.0:1789708594.234087:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.234157:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357057792 00000100:00100000:0.0:1789708594.234167:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357057792 00000100:00100000:0.0:1789708594.234222:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:0.0:1789708594.234232:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+33:11152:x1876645357057792:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708594.234251:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708594.234305:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d15a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234372:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d161 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234385:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d161 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234396:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d161 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234406:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d168 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234412:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234418:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234515:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234524:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234531:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708594.234540:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789708594.234613:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d161 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234631:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d161 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234637:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d161 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234643:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.234647:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d161 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234654:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d161 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234665:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708594.234669:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.234674:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d161 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234679:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d161 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234690:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234695:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d168 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234700:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234704:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.234712:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234718:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d168 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234724:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48700) 00010000:00010000:0.0:1789708594.234726:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.234729:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d168 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234735:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d168 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234783:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d15a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc8 expref: 36 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234796:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc8 expref: 35 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.234803:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.234805:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708594.234808:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708594.234863:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+35:11152:x1876645357057792:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 633us (786us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789708594.234870:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:2.0:1789708594.235841:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.235875:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357057920 00000100:00100000:0.0:1789708594.235879:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357057920 00000100:00100000:0.0:1789708594.235904:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:0.0:1789708594.235909:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+35:11152:x1876645357057920:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789708594.235945:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d17d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.235953:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d17d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.235958:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d17d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.235971:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d17d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.235975:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d17d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.235979:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d17d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.235982:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.235984:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d17d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.235987:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d17d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.235992:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.235993:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708594.235995:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d17d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.235998:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d17d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.236033:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+35:11152:x1876645357057920:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 124us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708594.236038:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:2.0:1789708594.236678:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.236733:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357058176 00000100:00100000:0.0:1789708594.236738:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357058176 00000100:00100000:0.0:1789708594.236782:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1789708594.236789:0:6486:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1789708594.236791:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+35:11152:x1876645357058176:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708594.236798:0:6486:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1789708594.236910:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+36:11152:x1876645357058176:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 120us (232us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789708594.236919:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789708594.332573:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.332648:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357058432 00000100:00100000:1.0:1789708594.332659:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357058432 00000100:00100000:1.0:1789708594.332731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:1.0:1789708594.332743:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+36:11183:x1876645357058432:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:1.0:1789708594.332782:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708594.332803:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d184 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfcf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.332924:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d18b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.332938:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d18b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.332950:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d18b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708594.332962:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789708594.333124:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d184 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfcf expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.333151:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d18b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfcf expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.333159:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708594.333162:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789708594.333165:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948800, rc 0) 00000100:00100000:1.0:1789708594.333226:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+38:11183:x1876645357058432:12345-192.168.201.52@tcp:101:cat.0 Request processed in 486us (668us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789708594.333233:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:3.0:1789708594.356424:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.356491:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357058688 00000100:00100000:1.0:1789708594.356500:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357058688 00000100:00100000:1.0:1789708594.356544:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:1.0:1789708594.356550:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+38:11189:x1876645357058688:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:1.0:1789708594.356571:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708594.356573:0:13656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789708594.356598:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d0e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df9e expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.356614:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:1.0:1789708594.356618:0:13656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708594.356628:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d199 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfd6 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.356706:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.356726:0:13656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc8 expref: 38 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.356732:0:13656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.356757:0:13656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc8 expref: 38 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.356781:0:13656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc8 expref: 38 pid: 6485 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.356790:0:13656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13656:1876645365500032:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708594.356862:0:13656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f06180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708594.357786:0:13656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13656:1876645365500032:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708594.357799:0:13656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708594.357910:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.357964:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357058816 00000100:00100000:0.0:1789708594.357969:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357058816 00010000:00010000:0.0:1789708594.357992:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc8 expref: 39 pid: 6485 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.358021:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:0.0:1789708594.358029:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+39:2396:x1876645357058816:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708594.358038:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708594.358044:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc8 expref: 39 pid: 6485 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.358054:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc8 expref: 39 pid: 6485 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.358067:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d16f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc8 expref: 39 pid: 6485 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.358084:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.358088:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.358095:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.358103:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.358122:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708594.358138:0:13656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.358144:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708594.358154:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:0.0:1789708594.358159:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+38:2396:x1876645357058816:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 129us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708594.358167:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00010000:00010000:1.0:1789708594.358296:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d199 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfd6 expref: 39 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.358322:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfd6 expref: 38 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.358330:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708594.358333:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708594.358336:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949200, rc 0) 00000100:00100000:1.0:1789708594.358362:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+38:11189:x1876645357058688:12345-192.168.201.52@tcp:101:dd.0 Request processed in 1812us (1947us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789708594.358367:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:3.0:1789708594.359310:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708594.359353:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357058944 00000100:00100000:2.0:1789708594.359359:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357058944 00000100:00100000:2.0:1789708594.359390:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1789708594.359398:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+38:11189:x1876645357058944:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:2.0:1789708594.359413:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708594.359426:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47d1ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfdd expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708594.359450:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708594.359459:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708594.359467:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708594.359552:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47d1ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfdd expref: 40 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708594.359565:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfdd expref: 39 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708594.359573:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:2.0:1789708594.359575:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789708594.359577:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd400, rc 0) 00000100:00100000:2.0:1789708594.359609:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+39:11189:x1876645357058944:12345-192.168.201.52@tcp:101:dd.0 Request processed in 214us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708594.359617:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1789708594.360448:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.360486:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357059200 00000100:00100000:0.0:1789708594.360493:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357059200 00000100:00100000:0.0:1789708594.360530:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:0.0:1789708594.360539:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+39:11189:x1876645357059200:12345-192.168.201.52@tcp:36:dd.0 00010000:00010000:0.0:1789708594.360688:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.360698:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.360706:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789708594.360754:0:8421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1789708594.360787:0:8421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043ba88b2 reply state 000000004fcdfc3b transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.360805:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.360811:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.360813:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708594.360816:0:8421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708594.360869:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+42:11189:x1876645357059200:12345-192.168.201.52@tcp:36:dd.0 Request processed in 332us (423us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789708594.360876:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000020:00080000:0.0:1789708594.360879:0:8421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789708594.461854:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.461918:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357059328 00000100:00100000:0.0:1789708594.461926:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357059328 00000100:00100000:0.0:1789708594.461973:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:0.0:1789708594.461980:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+42:11203:x1876645357059328:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:0.0:1789708594.461999:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708594.462019:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d1c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfe4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462075:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d1ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462088:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d1ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462098:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d1ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462107:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d1d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462131:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462140:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462207:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462218:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfd6 expref: 43 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462226:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462304:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfd6 expref: 43 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.462317:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfd6 expref: 43 pid: 13656 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.462332:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365500160:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708594.462428:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08a91a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708594.463368:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365500160:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708594.463388:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.463511:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.463573:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357059584 00000100:00100000:0.0:1789708594.463585:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357059584 00000100:00100000:0.0:1789708594.463621:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:0.0:1789708594.463628:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+44:6153:x1876645357059584:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789708594.463859:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+45:6153:x1876645357059584:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 229us (347us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789708594.463867:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789708594.464661:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.464713:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357059712 00000100:00100000:0.0:1789708594.464718:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357059712 00010000:00010000:0.0:1789708594.464751:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfd6 expref: 45 pid: 13656 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.464789:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:0.0:1789708594.464797:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+45:2395:x1876645357059712:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708594.464808:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708594.464813:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfd6 expref: 45 pid: 13656 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.464827:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfd6 expref: 45 pid: 13656 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.464847:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfd6 expref: 45 pid: 13656 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.464863:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.464866:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.464889:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.464901:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.464925:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708594.464954:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.464964:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.464972:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+44:2395:x1876645357059712:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 174us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708594.464980:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000004:00200000:1.0:1789708594.464999:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789708594.465004:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708594.465052:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465064:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465073:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d1ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465080:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d1ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465093:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d1ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465098:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708594.465102:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d1ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465110:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d1ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465119:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:1.0:1789708594.465121:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708594.465125:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d1ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465144:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d1ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465158:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465165:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d1d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465171:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465177:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708594.465180:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465196:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d1d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465204:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48700) 00010000:00010000:1.0:1789708594.465207:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708594.465210:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d1d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465216:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d1d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465242:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d1c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfe4 expref: 44 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465256:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfe4 expref: 43 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.465302:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708594.465304:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708594.465307:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0200, rc 0) 00000100:00100000:1.0:1789708594.465344:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+43:11203:x1876645357059328:12345-192.168.201.52@tcp:101:stat.0 Request processed in 3363us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.465351:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:3.0:1789708594.494238:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.494313:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357059968 00000100:00100000:0.0:1789708594.494325:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357059968 00000100:00100000:0.0:1789708594.494386:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:0.0:1789708594.494395:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+43:11209:x1876645357059968:12345-192.168.201.52@tcp:36:truncate.0 00010000:00010000:0.0:1789708594.494450:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708594.494473:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d1d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfe4 expref: 43 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.494487:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.494491:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708594.494647:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.494660:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.494667:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789708594.494717:0:6483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789708594.494743:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cad7f386 reply state 00000000226f02f1 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.494766:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.494775:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.494777:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708594.494780:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708594.494901:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+45:11209:x1876645357059968:12345-192.168.201.52@tcp:36:truncate.0 Request processed in 505us (673us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789708594.494906:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000020:00080000:0.0:1789708594.494911:0:6483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789708594.542591:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.542643:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357060096 00000100:00100000:1.0:1789708594.542653:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357060096 00000100:00100000:1.0:1789708594.542698:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:1.0:1789708594.542705:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+45:11223:x1876645357060096:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:1.0:1789708594.542738:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708594.542753:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d1e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dfeb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542813:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d1ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542824:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d1ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542831:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d1ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542838:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d1f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542842:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542846:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542904:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542909:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542913:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708594.542941:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789708594.542948:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708594.542964:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542971:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542977:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d1ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542981:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d1ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542985:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d1ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542989:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708594.542992:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d1ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.542996:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d1ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543003:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:1.0:1789708594.543005:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708594.543009:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d1ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543013:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d1ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543021:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543030:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d1f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543034:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543037:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708594.543038:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543042:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543045:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48700) 00010000:00010000:1.0:1789708594.543047:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708594.543049:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d1f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543052:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d1f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543068:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d1e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfeb expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543075:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfeb expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.543080:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708594.543081:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708594.543086:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949200, rc 0) 00000100:00100000:1.0:1789708594.543132:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+46:11223:x1876645357060096:12345-192.168.201.52@tcp:101:stat.0 Request processed in 427us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.543136:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:2.0:1789708594.589370:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.589430:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357060352 00000100:00100000:1.0:1789708594.589439:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357060352 00000100:00100000:1.0:1789708594.589489:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:1.0:1789708594.589497:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+46:11239:x1876645357060352:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708594.589514:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708594.589530:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d202 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dff2 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.589610:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.589621:0:13656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfeb expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.589627:0:13656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.589651:0:13656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfeb expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.589660:0:13656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfeb expref: 47 pid: 6512 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.589670:0:13656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabf800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13656:1876645365500288:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708594.589773:0:13656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f06d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708594.590500:0:13656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabf800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13656:1876645365500288:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708594.590518:0:13656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708594.590697:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.590741:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357060480 00000100:00100000:1.0:1789708594.590745:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357060480 00010000:00010000:1.0:1789708594.590785:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfeb expref: 48 pid: 6512 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.590810:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:1.0:1789708594.590819:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+48:2396:x1876645357060480:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708594.590833:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708594.590839:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfeb expref: 48 pid: 6512 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.590851:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfeb expref: 48 pid: 6512 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.590870:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d1fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfeb expref: 48 pid: 6512 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.590887:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708594.590890:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.590896:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.590902:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.590924:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708594.590953:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+47:2396:x1876645357060480:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 134us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.590962:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00010000:00010000:0.0:1789708594.590967:0:13656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.590974:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708594.590985:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789708594.591077:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d202 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff2 expref: 48 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.591092:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff2 expref: 47 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.591100:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.591109:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789708594.591112:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949e00, rc 0) 00000100:00100000:0.0:1789708594.591161:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+47:11239:x1876645357060352:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1659us (1792us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1789708594.591169:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:2.0:1789708594.592089:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708594.592134:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357060736 00000100:00100000:3.0:1789708594.592140:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357060736 00000100:00100000:3.0:1789708594.592174:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:3.0:1789708594.592180:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+47:11239:x1876645357060736:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:3.0:1789708594.592340:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.592349:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.592355:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708594.592395:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:3.0:1789708594.592415:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe7f03fe reply state 00000000051b31dc transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.592427:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.592434:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:3.0:1789708594.592436:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708594.592438:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708594.592482:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+50:11239:x1876645357060736:12345-192.168.201.52@tcp:36:bash.0 Request processed in 302us (396us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789708594.592486:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00000020:00080000:3.0:1789708594.592489:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789708594.595351:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.595396:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357060864 00000100:00100000:0.0:1789708594.595406:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357060864 00000100:00100000:0.0:1789708594.595465:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:0.0:1789708594.595474:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+50:11239:x1876645357060864:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708594.595495:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708594.595511:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d21e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715dff9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.595584:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.595598:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff2 expref: 51 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.595606:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.595639:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff2 expref: 51 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.595652:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff2 expref: 51 pid: 13656 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.595667:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8421:1876645365500416:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708594.595742:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08a91a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708594.596595:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8421:1876645365500416:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708594.596621:0:8421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708594.596796:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.596837:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357060992 00000100:00100000:1.0:1789708594.596843:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357060992 00010000:00010000:1.0:1789708594.596869:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff2 expref: 52 pid: 13656 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.596905:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:1.0:1789708594.596913:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+52:2395:x1876645357060992:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708594.596928:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708594.596934:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff2 expref: 52 pid: 13656 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.596947:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff2 expref: 52 pid: 13656 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.596969:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d209 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff2 expref: 52 pid: 13656 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.596985:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708594.596990:0:7427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.596999:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.597025:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.597050:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708594.597075:0:8421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.597085:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.597093:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+51:2395:x1876645357060992:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 179us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.597102:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000004:00200000:0.0:1789708594.597131:0:8421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789708594.597137:0:8421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708594.597159:0:8421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.597191:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d21e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff9 expref: 51 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.597205:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff9 expref: 50 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.597212:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.597215:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708594.597217:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708594.597254:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+50:11239:x1876645357060864:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1781us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708594.597292:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:3.0:1789708594.598828:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.598916:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357061248 00000100:00100000:1.0:1789708594.598925:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357061248 00000100:00100000:1.0:1789708594.599010:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:1.0:1789708594.599020:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+50:11239:x1876645357061248:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:1.0:1789708594.599219:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+51:11239:x1876645357061248:12345-192.168.201.52@tcp:35:bash.0 Request processed in 200us (404us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789708594.599226:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:2.0:1789708594.629154:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.629223:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357061376 00000100:00100000:0.0:1789708594.629247:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357061376 00000100:00100000:0.0:1789708594.629355:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:0.0:1789708594.629367:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+51:11249:x1876645357061376:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:0.0:1789708594.629456:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d22c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629473:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d22c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629485:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d22c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629497:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d233 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629505:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d233 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629512:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d233 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629589:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629600:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629607:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708594.629655:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629679:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d22c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629685:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d22c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629692:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d22c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629698:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.629703:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d22c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629710:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d22c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629723:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708594.629726:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.629731:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d22c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629738:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d22c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629751:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d233 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629771:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d233 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629777:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d233 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629789:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.629792:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d233 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629799:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d233 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629807:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48700) 00010000:00010000:0.0:1789708594.629810:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.629813:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d233 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629819:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d233 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629829:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629835:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629841:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629847:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.629850:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629856:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629874:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.629876:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.629880:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.629886:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d23a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708594.629968:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+51:11249:x1876645357061376:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 602us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708594.629977:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:2.0:1789708594.647964:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.648013:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357061632 00000100:00100000:0.0:1789708594.648022:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357061632 00000100:00100000:0.0:1789708594.648067:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:0.0:1789708594.648074:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+51:11252:x1876645357061632:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708594.648091:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708594.648107:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d241 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e000 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648159:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d248 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648169:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d248 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648176:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d248 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648182:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d24f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648198:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d24f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648202:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d24f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648309:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d256 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648316:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d256 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648321:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d256 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708594.648327:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789708594.648380:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d248 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648386:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d248 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648390:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d248 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648394:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.648396:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d248 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648401:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d248 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648426:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708594.648428:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.648432:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d248 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648436:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d248 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648444:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d24f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648448:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d24f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648452:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d24f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648454:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.648456:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d24f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648459:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d24f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648463:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48700) 00010000:00010000:0.0:1789708594.648464:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.648465:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d24f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648468:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d24f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648498:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d241 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e000 expref: 54 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648507:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d256 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e000 expref: 53 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.648511:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.648513:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708594.648514:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0a00, rc 0) 00000100:00100000:0.0:1789708594.648558:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+53:11252:x1876645357061632:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 484us (602us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789708594.648562:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1789708594.649515:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.649634:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357062016 00000100:00100000:0.0:1789708594.649640:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357062016 00000100:00100000:3.0:1789708594.649665:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.649676:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:0.0:1789708594.649682:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+53:11252:x1876645357062016:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789708594.649726:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357061888 00000100:00100000:2.0:1789708594.649732:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357061888 00000100:00100000:2.0:1789708594.649789:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:2.0:1789708594.649800:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08577c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+55:2396:x1876645357061888:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708594.649811:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789708594.649814:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+55:11252:x1876645357062016:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 130us (298us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789708594.649820:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00010000:00010000:2.0:1789708594.649829:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d256 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e000 expref: 54 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708594.649855:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:2.0:1789708594.649860:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708594.649893:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08577c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+53:2396:x1876645357061888:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708594.649901:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1789708594.650514:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.650564:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357062144 00000100:00100000:1.0:1789708594.650571:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357062144 00000100:00100000:1.0:1789708594.650606:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:1.0:1789708594.650615:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+53:11252:x1876645357062144:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1789708594.650644:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d264 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.650661:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.650670:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.650686:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.650699:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d264 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.650705:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.650710:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708594.650713:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.650719:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d264 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.650727:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708594.650730:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708594.650733:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d264 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.650739:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d264 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708594.650794:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+53:11252:x1876645357062144:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 180us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.650802:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:0.0:1789708594.710378:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.710452:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357062272 00000100:00100000:1.0:1789708594.710463:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357062272 00000100:00100000:1.0:1789708594.710518:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:1.0:1789708594.710529:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+53:11271:x1876645357062272:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708594.710547:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708594.710579:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d26b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e007 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.710651:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d272 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.710665:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.710675:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708594.710718:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789708594.710722:0:13656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708594.710739:0:13656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.710790:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d26b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e007 expref: 55 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.710810:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d272 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e007 expref: 54 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708594.710818:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:1.0:1789708594.710821:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708594.710825:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949c00, rc 0) 00000100:00100000:1.0:1789708594.710879:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+54:11271:x1876645357062272:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 352us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708594.710886:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:2.0:1789708594.712594:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708594.712636:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357062656 00000100:00100000:1.0:1789708594.712652:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357062656 00000100:00100000:1.0:1789708594.712693:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1789708594.712709:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+54:11271:x1876645357062656:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789708594.712947:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+55:11271:x1876645357062656:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 239us (355us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789708594.712955:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1789708594.713535:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708594.713575:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357062784 00000100:00100000:2.0:1789708594.713580:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357062784 00000100:00100000:2.0:1789708594.713610:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:2.0:1789708594.713614:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+55:11271:x1876645357062784:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:2.0:1789708594.713622:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789708594.713637:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d225 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dff9 expref: 55 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708594.713649:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d18b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfcf expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708594.713657:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d129 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfba expref: 53 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708594.713663:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:2.0:1789708594.713665:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708594.713691:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+52:11271:x1876645357062784:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 75us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708594.713698:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:0.0:1789708594.714216:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708594.714249:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357062912 00000100:00100000:3.0:1789708594.714254:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357062912 00000100:00100000:3.0:1789708594.714318:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:3.0:1789708594.714327:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+52:11271:x1876645357062912:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:3.0:1789708594.714398:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d279 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.714421:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d279 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708594.714431:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d279 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708594.714640:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708594.714798:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789708594.714869:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789708594.714915:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+52:11271:x1876645357062912:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 589us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708594.714920:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:1.0:1789708594.722505:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708594.722564:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357063040 00000100:00100000:0.0:1789708594.722574:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357063040 00000100:00100000:0.0:1789708594.722626:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:0.0:1789708594.722638:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+52:11273:x1876645357063040:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708594.722669:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708594.722684:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d280 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e00e expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722731:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d287 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722741:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d287 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722748:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d287 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722769:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d28e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722782:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d28e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722787:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d28e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722843:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722848:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722852:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708594.722882:0:8421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789708594.722889:0:8421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708594.722904:0:8421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722912:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722918:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d287 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722922:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d287 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722926:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d287 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722930:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.722932:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d287 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722937:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d287 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722945:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708594.722947:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.722950:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d287 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722954:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d287 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722962:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d28e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722972:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d28e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722975:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d28e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722978:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708594.722980:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d28e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722983:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d28e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722987:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48700) 00010000:00010000:0.0:1789708594.722988:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708594.722990:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d28e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.722993:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d28e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.723009:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d280 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e00e expref: 54 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.723016:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e00e expref: 53 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708594.723021:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708594.723022:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708594.723027:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1400, rc 0) 00000100:00100000:0.0:1789708594.723081:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+53:11273:x1876645357063040:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 445us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708594.723089:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00010000:00010000:3.0:1789708594.790364:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789708595.014022:0:14163:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708595.014030:0:14163:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708595.014061:0:14163:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789708595.014074:0:14163:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789708595.046385:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708595.046407:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365500544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708595.046471:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708595.046503:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365500544 00000100:00100000:2.0:1789708595.046514:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365500544 00000100:00100000:2.0:1789708595.046569:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789708595.046580:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365500544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789708595.046610:0:8422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446268928 avail 1300029440 00000100:00100000:2.0:1789708595.046659:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365500544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708595.046665:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789708595.046692:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365500544:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789708595.622449:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708595.622458:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708595.622494:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789708595.622507:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789708595.622625:0:13754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365500672:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789708595.622731:0:13754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857480 going to sleep for 11 seconds 00000100:00100000:3.0:1789708595.624080:0:13754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365500672:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708595.624547:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708595.624607:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357063168 00000100:00100000:0.0:1789708595.624614:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357063168 00000100:00080000:1.0:1789708595.624682:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708595.624688:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:0.0:1789708595.624700:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+53:11285:x1876645357063168:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789708595.624730:0:6485:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708595.624851:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+53:11285:x1876645357063168:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 152us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708595.624860:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:1.0:1789708595.625982:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708595.626030:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357063296 00000100:00100000:0.0:1789708595.626036:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357063296 00000100:00100000:0.0:1789708595.626067:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:0.0:1789708595.626075:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+53:11285:x1876645357063296:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789708595.626131:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d29c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626148:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d29c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626174:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d29c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626231:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626252:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626286:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626313:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626322:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626329:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708595.626363:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789708595.626368:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708595.626392:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626407:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d29c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626413:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d29c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626421:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d29c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626427:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.626432:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d29c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626445:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d29c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626457:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:0.0:1789708595.626460:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708595.626465:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d29c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626472:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d29c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626494:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626501:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2a3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626507:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626512:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.626515:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626521:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2a3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626528:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9bee08f48300) 00010000:00010000:0.0:1789708595.626530:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708595.626533:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2a3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626548:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2a3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626562:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626568:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626573:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626578:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.626581:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626587:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626594:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708595.626597:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708595.626600:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.626606:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708595.626659:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+53:11285:x1876645357063296:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 585us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708595.626667:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:2.0:1789708595.630200:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.630296:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357063552 00000100:00100000:1.0:1789708595.630306:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357063552 00000100:00100000:1.0:1789708595.630360:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:1.0:1789708595.630380:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+53:11285:x1876645357063552:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708595.630400:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708595.630419:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e015 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630517:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d2b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630531:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630541:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708595.630567:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789708595.630648:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630655:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d2b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630663:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630668:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708595.630672:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630679:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d2b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630691:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708595.630694:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708595.630699:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d2b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630704:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d2b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630762:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2b1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e015 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630779:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:1.0:1789708595.630781:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708595.630791:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e015 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.630811:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948000, rc 0) 00000100:00100000:1.0:1789708595.630868:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+54:11285:x1876645357063552:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 500us (676us total) trans 4294967346 rc 301/301 00000100:00100000:1.0:1789708595.630875:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:2.0:1789708595.633806:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.633885:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357063680 00000100:00100000:1.0:1789708595.633894:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357063680 00000100:00100000:1.0:1789708595.633942:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:1.0:1789708595.633951:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+54:11285:x1876645357063680:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789708595.633982:0:13656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789708595.634082:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+54:11285:x1876645357063680:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 132us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708595.634090:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:2.0:1789708595.635652:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708595.635769:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357063936 00000100:00100000:3.0:1789708595.635777:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357063936 00000100:00100000:3.0:1789708595.635820:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:3.0:1789708595.635830:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+54:11285:x1876645357063936:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708595.635858:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708595.635861:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789708595.635898:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d272 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e007 expref: 54 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.635918:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:3.0:1789708595.635923:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708595.635950:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d2c6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e01c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708595.636338:0:6484:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789708595.636469:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d2cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.636483:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.636493:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.636535:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d2c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e01c expref: 56 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.636549:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d2cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e01c expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.636557:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee03fa9a00) 00010000:00010000:3.0:1789708595.636560:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708595.636568:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8200, rc 0) 00000100:00100000:3.0:1789708595.636613:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+55:11285:x1876645357063936:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 785us (963us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789708595.636621:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:2.0:1789708595.640160:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708595.640220:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357064192 00000100:00100000:0.0:1789708595.640229:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357064192 00000100:00100000:0.0:1789708595.640298:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:0.0:1789708595.640306:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+55:11285:x1876645357064192:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789708595.640352:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708595.640374:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d2cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e01c expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640389:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee03fa9a00) 00010000:00010000:0.0:1789708595.640396:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708595.640408:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2db lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640416:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640422:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640468:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3786583d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640472:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3786583d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640476:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3786583d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640504:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640520:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2db lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640524:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640528:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.640531:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640536:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640541:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708595.640543:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708595.640546:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2db lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640550:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d2db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640555:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3786583d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640559:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3786583d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640563:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3786583d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640565:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.640570:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3786583d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640574:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2e2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3786583d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640578:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3786583d (ffff9bee08f48300) 00010000:00010000:0.0:1789708595.640579:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708595.640581:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2e2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3786583d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.640584:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d2e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3786583d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708595.640633:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+54:11285:x1876645357064192:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 329us (479us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708595.640638:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:2.0:1789708595.641438:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708595.641466:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357064320 00000100:00100000:0.0:1789708595.641471:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357064320 00000100:00100000:0.0:1789708595.641506:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:0.0:1789708595.641514:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+54:11285:x1876645357064320:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708595.641524:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708595.641536:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d2e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e023 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.641561:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.641568:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.641581:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.641643:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d2e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e023 expref: 56 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.641653:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e023 expref: 55 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.641658:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:0.0:1789708595.641660:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708595.641662:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0200, rc 0) 00000100:00100000:0.0:1789708595.641687:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+55:11285:x1876645357064320:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 174us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708595.641691:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:2.0:1789708595.642644:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708595.642683:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357064576 00000100:00100000:0.0:1789708595.642689:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357064576 00000100:00100000:0.0:1789708595.642725:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:0.0:1789708595.642732:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+55:11285:x1876645357064576:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789708595.642790:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.642800:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.642808:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708595.642964:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1789708595.642974:0:6483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 166452713191ns, next at 167452710610ns, rc = 0 00000004:00010000:0.0:1789708595.643018:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4792413 reply state 00000000b8132d53 transno 4294967348 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.643029:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.643035:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:0.0:1789708595.643037:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789708595.643040:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708595.643100:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+57:11285:x1876645357064576:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 368us (457us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789708595.643106:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:2.0:1789708595.643796:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.643854:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357064704 00000100:00100000:1.0:1789708595.643861:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357064704 00000100:00100000:1.0:1789708595.643897:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:1.0:1789708595.643912:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+57:11285:x1876645357064704:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708595.643925:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708595.643936:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e02a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.643968:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e02a expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.643979:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e02a expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.644003:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:1.0:1789708595.644006:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708595.644008:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948000, rc 0) 00000100:00100000:1.0:1789708595.644041:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+58:11285:x1876645357064704:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 136us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708595.644048:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:2.0:1789708595.644905:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708595.644944:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357064832 00000100:00100000:3.0:1789708595.644949:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357064832 00000100:00100000:3.0:1789708595.644971:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:3.0:1789708595.644976:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876645357064832:12345-192.168.201.52@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789708595.644995:0:8398:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:3.0:1789708595.645016:0:8398:0:(genops.c:1384:class_connect()) connect: client 68824747-448a-469b-b2cf-e27bc037ded7, cookie 0xf45f43947e47d305 00002000:00100000:3.0:1789708595.645024:0:8398:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68824747-448a-469b-b2cf-e27bc037ded7/ffff9bed0a0ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789708595.645036:0:8398:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789708595.645090:0:8398:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789708595.645109:0:8398:0:(import.c:65:import_set_state_nolock()) ffff9bed0a0a8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708595.645139:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:2394:x1876645357064832:12345-192.168.201.52@tcp:8:lhsmtool_posix.0 Request processed in 162us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708595.645147:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789708595.645883:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.645935:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357064960 00000100:00100000:1.0:1789708595.645941:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357064960 00000100:00080000:2.0:1789708595.645981:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708595.645990:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1789708595.645999:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+6:0:x1876645357064960:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000001:00080000:0.0:1789708595.648081:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1789708595.648094:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000100:00100000:1.0:1789708595.648215:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:0:x1876645357064960:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 2214us (2329us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789708595.648222:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708595.649438:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708595.649504:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357065216 00000100:00100000:0.0:1789708595.649512:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357065216 00000100:00100000:0.0:1789708595.649562:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:0.0:1789708595.649573:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2c799050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+58:11285:x1876645357065216:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789708595.649778:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2c799050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+59:11285:x1876645357065216:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 207us (342us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789708595.649786:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789708595.650753:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.650811:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357065472 00000100:00100000:1.0:1789708595.650817:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357065472 00000100:00100000:1.0:1789708595.650851:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:1.0:1789708595.650859:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+59:11285:x1876645357065472:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789708595.650947:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+59:11285:x1876645357065472:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708595.650954:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:2.0:1789708595.651913:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708595.652014:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357065600 00000100:00100000:3.0:1789708595.652020:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357065600 00000100:00100000:3.0:1789708595.652060:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:3.0:1789708595.652068:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+59:11285:x1876645357065600:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708595.652080:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708595.652099:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d30c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e031 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.652154:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d313 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.652177:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.652188:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708595.652222:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708595.652237:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.652287:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d30c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e031 expref: 61 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.652306:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d313 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e031 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.652314:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:3.0:1789708595.652317:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789708595.652321:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8200, rc 0) 00000100:00100000:3.0:1789708595.652395:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+60:11285:x1876645357065600:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 328us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708595.652402:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:2.0:1789708595.653553:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708595.653627:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357065728 00000100:00100000:3.0:1789708595.653634:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357065728 00000100:00100000:3.0:1789708595.653672:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:3.0:1789708595.653680:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2395:x1876645357065728:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708595.653690:0:8397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708595.653714:0:8397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47d31a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e038 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708595.653746:0:8397:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacc933, blocks: 0x0 00010000:00010000:3.0:1789708595.653761:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=166s v=(0 0) 00010000:00010000:3.0:1789708595.653766:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708595.653773:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47d31a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e038 expref: 6 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.653788:0:8397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47d31a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e038 expref: 6 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.653799:0:8397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9400, rc 0) 00000100:00100000:3.0:1789708595.653837:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357065728:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 158us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708595.653844:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1789708595.655230:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708595.655288:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357065984 00000100:00100000:0.0:1789708595.655295:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357065984 00000100:00100000:0.0:1789708595.655339:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:0.0:1789708595.655348:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+60:11285:x1876645357065984:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789708595.655435:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+60:11285:x1876645357065984:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708595.655444:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:2.0:1789708595.659221:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708595.659275:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357066112 00000100:00100000:3.0:1789708595.659283:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357066112 00000100:00100000:3.0:1789708595.659331:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1789708595.659337:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:11285:x1876645357066112:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708595.659350:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708595.659364:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e03f expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.659387:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47d31a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e038 expref: 7 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.659414:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708595.659418:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708595.659424:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.659457:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47d31a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e038 expref: 7 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.659470:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47d31a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e038 expref: 7 pid: 8397 timeout: 266 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708595.659492:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8398:1876645365500800:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708595.659580:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708595.660391:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8398:1876645365500800:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708595.660411:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.660477:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9200, rc 0) 00000100:00100000:3.0:1789708595.660517:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+7:11285:x1876645357066112:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1178us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708595.660525:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:2.0:1789708595.660549:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.660766:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357066240 00000100:00100000:1.0:1789708595.660771:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357066240 00010000:00010000:1.0:1789708595.660797:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47d31a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e038 expref: 7 pid: 8397 timeout: 266 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.660842:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:1.0:1789708595.660850:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357066240:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708595.660862:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708595.660882:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47d31a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e038 expref: 7 pid: 8397 timeout: 266 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.660893:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47d31a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e038 expref: 7 pid: 8397 timeout: 266 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.660927:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47d31a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e038 expref: 7 pid: 8397 timeout: 266 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.660942:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708595.660945:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708595.660952:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.660962:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.660987:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.660997:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6514:1876645365500928:192.168.201.52@tcp:105: 00000100:00100000:1.0:1789708595.661058:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04e9d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789708595.662946:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6514:1876645365500928:192.168.201.52@tcp:105: 00010000:00010000:1.0:1789708595.662964:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708595.663007:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357066240:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 2154us (2458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708595.663016:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1789708595.663067:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708595.663220:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357066368 00000100:00100000:3.0:1789708595.663276:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357066368 00002000:00100000:3.0:1789708595.663314:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9bee10fa0e00 x1876645357066368/t0(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:736/0 lens 504/0 e 0 to 0 dl 1789708606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708595.663336:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee10fa0e00 with x1876645357066368 ext(0->8) 00002000:00010000:3.0:1789708595.663341:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee10fa0e00 00000100:00100000:3.0:1789708595.663366:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1789708595.663375:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:2396:x1876645357066368:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789708595.663954:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357066368:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 578us (885us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789708595.663960:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00002000:00100000:3.0:1789708595.663966:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9bee10fa0e00 x1876645357066368/t4294967303(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:736/0 lens 504/448 e 0 to 0 dl 1789708606 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708595.663971:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee10fa0e00 with x1876645357066368 ext(0->8) 00002000:00010000:3.0:1789708595.663974:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee10fa0e00 00000100:00100000:0.0:1789708595.664661:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.664693:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357066496 00000100:00100000:1.0:1789708595.664704:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357066496 00000100:00100000:1.0:1789708595.664752:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:1.0:1789708595.664761:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+60:11285:x1876645357066496:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789708595.665747:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:3.0:1789708595.665755:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:0.0:1789708595.665792:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665804:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708595.665806:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1789708595.665815:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665822:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00000020:00080000:3.0:1789708595.665828:0:6463:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bed08a91900 refcount 2 committed 0 result 0 batchid 1 00010000:00010000:0.0:1789708595.665829:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708595.665837:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee2f7b6500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bed08a91000 00000020:00080000:3.0:1789708595.665843:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee2f7b6400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bed084f8a00 00010000:00010000:0.0:1789708595.665844:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665863:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bee08f48800) 00010000:00010000:0.0:1789708595.665867:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708595.665872:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665879:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d05e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665900:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.665901:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365501184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789708595.665902:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365501056:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789708595.665924:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665932:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665937:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.665941:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665947:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665956:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708595.665961:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708595.665963:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708595.665965:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665972:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d065 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665987:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.665994:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666001:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666007:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.666014:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.666022:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+20:11285:x1876645357066496:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 1259us (1358us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708595.666024:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.666040:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00010000:00010000:0.0:1789708595.666041:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48700) 00010000:00010000:0.0:1789708595.666045:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708595.666059:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666066:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d0a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.666074:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708595.666088:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666096:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666102:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666108:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.666111:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666117:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.666121:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365501056 00010000:00010000:0.0:1789708595.666125:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00000100:00100000:1.0:1789708595.666127:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365501056 00010000:00010000:0.0:1789708595.666130:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708595.666139:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666146:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d1bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666159:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666166:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.666169:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365501184 00000100:00100000:1.0:1789708595.666174:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365501184 00010000:00010000:0.0:1789708595.666175:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789708595.666179:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789708595.666183:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.666187:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666193:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.666200:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1789708595.666203:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:0.0:1789708595.666207:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708595.666211:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365501056:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789708595.666212:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708595.666216:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1789708595.666225:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d1df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708595.666228:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1876645365501184:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789708595.666241:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789708595.666247:0:9145:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:0.0:1789708595.666248:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666288:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708595.666293:0:9145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aacc931, atime: 0x6aacc931, ctime: 0x6aacc931, blocks: 0x8 00010000:00010000:0.0:1789708595.666294:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.666301:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.666302:0:9145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c593c618/0xf45f43947e47d328 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708595.666305:0:8397:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789708595.666317:0:8397:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789708595 00010000:00010000:0.0:1789708595.666318:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.666322:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=166s v=(0 0) 00002000:00010000:1.0:1789708595.666324:0:8397:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1789708595.666331:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00002000:00010000:1.0:1789708595.666332:0:8397:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789708595 -> 1789708595 00002000:00010000:1.0:1789708595.666336:0:8397:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789708595.666337:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:3.0:1789708595.666338:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c593c618/0xf45f43947e47d328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666344:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708595.666350:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.666357:0:9145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c593c618/0xf45f43947e47d328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666358:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d217 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.666377:0:9145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c593c618/0xf45f43947e47d328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.666383:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365501056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (422us total) trans 4294967304 rc 0/0 00010000:00010000:0.0:1789708595.666384:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.666390:0:9145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c593c618/0xf45f43947e47d328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.666398:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1789708595.666403:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666413:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.666418:0:9145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708595.666419:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708595.666425:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708595.666429:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bee3fabed80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789708595.666434:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365501056:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789708595.666445:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666454:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:0.0:1789708595.666457:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789708595.666460:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.666466:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d2f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708595.666519:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3616:x1876645365501184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 293us (450us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789708595.666527:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1789708595.666544:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bed09b82a00/2, rc 0, transno 4294967302 00000100:00100000:1.0:1789708595.666551:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365501184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789708595.666871:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708595.666899:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357066624 00000020:00080000:2.0:1789708595.666901:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1789708595.666903:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357066624 00000100:00100000:3.0:1789708595.666928:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1789708595.666933:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357066624:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789708595.666974:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708595.666983:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c593c618/0xf45f43947e47d328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.666993:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708595.666998:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c593c618/0xf45f43947e47d328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.667008:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c593c618/0xf45f43947e47d328 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.667023:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c593c618/0xf45f43947e47d328 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.667031:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c593c618/0xf45f43947e47d328 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789708595.667032:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1789708595.667050:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708595.667052:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708595.667059:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789708595.667595:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789708595.667602:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1789708595.667681:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357066624:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 745us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708595.667697:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1789708595.668671:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708595.668715:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357066880 00000100:00100000:0.0:1789708595.668721:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357066880 00000100:00100000:0.0:1789708595.668763:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:0.0:1789708595.668770:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+15:11285:x1876645357066880:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789708595.668802:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708595.668817:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d313 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e031 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.668827:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:0.0:1789708595.668830:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708595.668846:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.668855:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.668866:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708595.668937:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bf1915f reply state 000000008c8064c3 transno 4294967350 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.668948:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.668954:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:0.0:1789708595.668957:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708595.668959:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708595.669031:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+16:11285:x1876645357066880:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 260us (361us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789708595.669038:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:0.0:1789708595.669888:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.669923:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357067008 00000100:00100000:1.0:1789708595.669928:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357067008 00000100:00100000:1.0:1789708595.669957:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:1.0:1789708595.669964:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357067008:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789708595.670052:0:8399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789708595.670055:0:8399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789708595 -> 1789708594 00002000:00010000:1.0:1789708595.670058:0:8399:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789708593 00002000:00010000:1.0:1789708595.670060:0:8399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789708595 -> 1789708594 00002000:00010000:1.0:1789708595.670062:0:8399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789708595.670095:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357067008:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 131us (205us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789708595.670102:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:2.0:1789708595.670860:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.670905:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357067264 00000100:00100000:1.0:1789708595.670910:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357067264 00000100:00100000:1.0:1789708595.670939:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:1.0:1789708595.670950:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+16:11285:x1876645357067264:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789708595.670988:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.671002:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e023 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.671011:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.671040:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e023 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.671066:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e023 expref: 16 pid: 6485 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.671078:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365501312:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708595.671145:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04e9de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708595.671946:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365501312:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708595.671963:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.672124:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.672157:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357067392 00000100:00100000:1.0:1789708595.672162:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357067392 00010000:00010000:1.0:1789708595.672180:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e023 expref: 17 pid: 6485 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.672213:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:1.0:1789708595.672228:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+17:2396:x1876645357067392:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708595.672239:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708595.672246:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e023 expref: 17 pid: 6485 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.672287:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e023 expref: 17 pid: 6485 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.672307:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d2f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e023 expref: 17 pid: 6485 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.672331:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:1.0:1789708595.672336:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.672344:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.672352:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.672373:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708595.672400:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.672408:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+16:2396:x1876645357067392:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 185us (281us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708595.672412:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.672421:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00010000:00010000:2.0:1789708595.672442:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.672449:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.672456:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.672463:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708595.672467:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.672473:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.672482:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:2.0:1789708595.672484:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789708595.672487:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.672492:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d336 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.672540:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+15:11285:x1876645357067264:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 1595us (1681us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789708595.672548:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:2.0:1789708595.673287:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708595.673323:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357067520 00000100:00100000:3.0:1789708595.673328:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357067520 00000100:00100000:3.0:1789708595.673360:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:3.0:1789708595.673367:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357067520:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789708595.673387:0:9145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.673398:0:9145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.673404:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708595.673407:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789708595.673410:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.673424:0:9145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.673430:0:9145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 7 pid: 8398 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708595.673438:0:9145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9145:1876645365501440:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708595.673471:0:9145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708595.674076:0:9145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9145:1876645365501440:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708595.674091:0:9145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.674340:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.674374:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357067648 00000100:00100000:1.0:1789708595.674380:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357067648 00010000:00010000:1.0:1789708595.674400:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 8 pid: 8398 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.674430:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:1.0:1789708595.674438:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357067648:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708595.674448:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708595.674465:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 8 pid: 8398 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.674476:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 8 pid: 8398 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.674504:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47d321 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e03f expref: 8 pid: 8398 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.674515:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708595.674519:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708595.674523:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.674531:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.674554:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708595.674574:0:9145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.674581:0:9145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.674590:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357067648:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 150us (247us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708595.674595:0:9145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.674598:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00010000:00010000:0.0:1789708595.674607:0:9145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.674612:0:9145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.674617:0:9145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708595.674620:0:9145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.674625:0:9145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.674633:0:9145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708595.674637:0:9145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d33d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708595.674680:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357067520:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 1314us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708595.674685:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:2.0:1789708595.675318:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.675352:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357067904 00000100:00100000:1.0:1789708595.675358:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357067904 00000100:00100000:1.0:1789708595.675392:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:1.0:1789708595.675399:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+15:11285:x1876645357067904:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789708595.675445:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.675457:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfdd expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.675464:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.675493:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfdd expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.675504:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfdd expref: 15 pid: 6484 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.675514:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365501568:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708595.675556:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04e9db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708595.676145:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365501568:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708595.676158:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.676345:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708595.676371:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357068032 00000100:00100000:3.0:1789708595.676375:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357068032 00010000:00010000:3.0:1789708595.676390:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfdd expref: 16 pid: 6484 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.676438:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:1.0:1789708595.676448:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+16:2396:x1876645357068032:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708595.676457:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708595.676464:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfdd expref: 16 pid: 6484 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.676476:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfdd expref: 16 pid: 6484 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.676491:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d1b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfdd expref: 16 pid: 6484 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.676502:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708595.676511:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.676519:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.676526:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.676545:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708595.676569:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.676571:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+15:2396:x1876645357068032:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 125us (225us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708595.676585:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.676588:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00010000:00010000:2.0:1789708595.676772:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.676784:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e02a expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.676792:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.676822:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e02a expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.676833:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e02a expref: 15 pid: 6512 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.676853:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365501696:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708595.676891:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708595.677632:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365501696:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708595.677656:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708595.677700:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708595.677747:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357068160 00000100:00100000:2.0:1789708595.677752:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357068160 00010000:00010000:2.0:1789708595.677779:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e02a expref: 16 pid: 6512 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.677810:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:2.0:1789708595.677820:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+16:2395:x1876645357068160:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708595.677829:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708595.677835:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e02a expref: 16 pid: 6512 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.677846:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e02a expref: 16 pid: 6512 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.677859:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d2fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e02a expref: 16 pid: 6512 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.677870:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:2.0:1789708595.677875:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.677882:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.677898:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.677915:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708595.677931:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.677940:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+15:2395:x1876645357068160:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 120us (239us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708595.677940:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.677955:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000001:00080000:1.0:1789708595.677993:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967351 00000001:00080000:1.0:1789708595.678080:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967352 00000001:00080000:1.0:1789708595.678108:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967353 00000100:00100000:1.0:1789708595.678164:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1876645365501824:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789708595.678210:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708595.678233:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f06300 going to sleep for 11 seconds 00000100:00100000:0.0:1789708595.678243:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365501824 00000100:00100000:0.0:1789708595.678247:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365501824 00000100:00100000:0.0:1789708595.678304:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789708595.678313:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6485:x1876645365501824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789708595.678384:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6485:x1876645365501824:12345-0@lo:1000:mdt00_002.0 Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708595.678392:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789708595.678399:0:6485:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789708595.678404:0:6485:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bee3fabed80, transno 4294967304 00000100:00100000:1.0:1789708595.678420:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1876645365501824:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789708595.678527:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967354 00000100:00100000:1.0:1789708595.678561:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1876645365501952:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789708595.678588:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708595.678603:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789708595.678620:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365501952 00000100:00100000:2.0:1789708595.678626:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365501952 00000100:00100000:2.0:1789708595.678654:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789708595.678663:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6485:x1876645365501952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789708595.678783:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6485:x1876645365501952:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (190us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789708595.678790:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789708595.678819:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1876645365501952:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789708595.678843:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678852:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678858:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678863:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708595.678867:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678873:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678882:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:1.0:1789708595.678884:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708595.678888:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678893:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d34b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678928:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d279 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678941:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d279 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678947:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d279 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678952:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708595.678955:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d279 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678961:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d279 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678970:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708595.678973:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708595.678976:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d279 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678982:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d279 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.678999:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.679008:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e00e expref: 18 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.679016:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.679034:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e00e expref: 18 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.679051:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e00e expref: 18 pid: 8421 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.679060:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365502080:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708595.679103:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708595.679860:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365502080:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708595.679873:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708595.680043:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708595.680087:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357068288 00000100:00100000:2.0:1789708595.680092:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357068288 00010000:00010000:2.0:1789708595.680123:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e00e expref: 19 pid: 8421 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.680155:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:2.0:1789708595.680168:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08576850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+19:2395:x1876645357068288:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708595.680178:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708595.680183:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e00e expref: 19 pid: 8421 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.680194:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e00e expref: 19 pid: 8421 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.680215:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d295 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e00e expref: 19 pid: 8421 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.680225:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:2.0:1789708595.680229:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.680236:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.680243:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708595.680285:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708595.680304:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680313:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.680319:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08576850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+18:2395:x1876645357068288:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 152us (274us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708595.680325:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708595.680331:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00010000:00010000:1.0:1789708595.680338:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680345:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680351:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708595.680355:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680362:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680387:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708595.680390:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708595.680394:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680400:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d352 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680411:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680416:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680422:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680427:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708595.680430:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680436:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680442:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bed08848d00) 00010000:00010000:1.0:1789708595.680444:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789708595.680447:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.680452:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d344 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.680560:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+17:11285:x1876645357067904:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 5160us (5242us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789708595.680568:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000020:00080000:1.0:1789708595.680572:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789708595.680594:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708595.680598:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708595.680618:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789708595.680628:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789708595.681508:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708595.681547:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357068544 00000100:00100000:1.0:1789708595.681553:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357068544 00000100:00100000:1.0:1789708595.681589:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1789708595.681600:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+17:11285:x1876645357068544:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789708595.681801:0:14125:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789708595.681832:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00010000:00010000:1.0:1789708595.681857:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.681867:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.681876:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.681883:0:14125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.681889:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.681895:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708595.681912:0:14125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708595.681936:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708595.681944:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.681954:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708595.681958:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.681967:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708595.681979:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00000100:00100000:1.0:1789708595.681981:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+19:11285:x1876645357068544:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 381us (471us total) trans 4294967357 rc 0/0 00010000:00010000:3.0:1789708595.681983:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789708595.681988:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708595.681995:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00010000:00010000:3.0:1789708595.681998:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d359 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789708595.682002:0:14125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789708595.682013:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708595.682016:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708595.682026:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708595.814459:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708596.070407:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708596.070430:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365502336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708596.070492:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708596.070528:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365502336 00000100:00100000:3.0:1789708596.070537:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365502336 00000100:00100000:2.0:1789708596.070566:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365502208:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789708596.070571:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708596.070594:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789708596.070596:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708596.070604:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1876645365502336:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708596.070627:0:13774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365502208 00000100:00100000:1.0:1789708596.070634:0:13774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365502208 00002000:00000024:3.0:1789708596.070636:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789708596.070674:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789708596.070683:0:13774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365502208:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708596.070694:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1876645365502336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (200us total) trans 0 rc 0/0 00002000:00000024:1.0:1789708596.070698:0:13774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789708596.070705:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789708596.070723:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365502336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708596.070757:0:13774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365502208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.070767:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789708596.070768:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365502208:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789708596.070787:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708596.071357:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365502464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708596.071397:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365502592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708596.071404:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708596.071431:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708596.071455:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365502720:0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.071470:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365502464 00000100:00100000:0.0:1789708596.071474:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365502464 00000100:00100000:1.0:1789708596.071490:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708596.071508:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365502592 00000100:00100000:0.0:1789708596.071512:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365502592 00000100:00100000:1.0:1789708596.071534:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365503232:0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.071541:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789708596.071550:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365502464:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708596.071553:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365502848:0@lo:400:kworker.0 00000100:00100000:1.0:1789708596.071562:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789708596.071564:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789708596.071592:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365503744:0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.071606:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365502464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.071611:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789708596.071625:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789708596.071630:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876645365502592:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708596.071631:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365502720 00000100:00100000:1.0:1789708596.071636:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365502720 00002000:00000024:0.0:1789708596.071641:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789708596.071648:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708596.071671:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789708596.071679:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365502720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.071685:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876645365502592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.071686:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365503360:0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.071693:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789708596.071716:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708596.071743:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365502720:12345-0@lo:400:kworker.0 Request processed in 52us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.071743:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365502976:0@lo:400:kworker.0 00000100:00100000:1.0:1789708596.071767:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789708596.071770:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708596.071782:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708596.071806:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365503232 00000100:00100000:1.0:1789708596.071810:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365503232 00000100:00100000:0.0:1789708596.071811:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365503488:0@lo:400:kworker.0 00000100:00100000:3.0:1789708596.071818:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365502848 00000100:00100000:3.0:1789708596.071825:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365502848 00000100:00100000:0.0:1789708596.071843:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708596.071846:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365502976 00000100:00100000:1.0:1789708596.071852:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365502976 00000100:00100000:3.0:1789708596.071875:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365503360 00000100:00100000:0.0:1789708596.071879:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365502464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708596.071881:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365503360 00000100:00100000:1.0:1789708596.071882:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789708596.071897:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365503232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.071901:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789708596.071910:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365503104:0@lo:400:kworker.0 00000100:00100000:3.0:1789708596.071921:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365503488 00000100:00100000:3.0:1789708596.071925:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365503488 00000100:00100000:0.0:1789708596.071947:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708596.071953:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365503104 00000100:00100000:3.0:1789708596.071958:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365503104 00000100:00100000:1.0:1789708596.071958:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365503232:12345-0@lo:400:kworker.0 Request processed in 62us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.071963:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365503616:0@lo:400:kworker.0 00000100:00100000:1.0:1789708596.071973:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789708596.071984:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789708596.071990:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708596.071993:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789708596.071998:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365502848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708596.072005:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365502976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.072010:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365503616 00000100:00100000:0.0:1789708596.072013:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365503616 00000100:00100000:0.0:1789708596.072037:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789708596.072047:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365503360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708596.072054:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365502848:12345-0@lo:400:kworker.0 Request processed in 59us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.072055:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365502976:12345-0@lo:400:kworker.0 Request processed in 52us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.072068:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789708596.072069:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789708596.072089:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365503360:12345-0@lo:400:kworker.0 Request processed in 45us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.072093:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789708596.072102:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789708596.072107:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708596.072116:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365503488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.072122:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365503744 00000100:00100000:0.0:1789708596.072127:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365503744 00000100:00100000:1.0:1789708596.072139:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365503232:0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.072157:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789708596.072158:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365502720:0@lo:400:kworker.0 00000100:00100000:3.0:1789708596.072171:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365503488:12345-0@lo:400:kworker.0 Request processed in 64us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.072171:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365503104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708596.072182:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789708596.072204:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789708596.072213:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365503616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708596.072215:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365502976:0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.072218:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365503104:12345-0@lo:400:kworker.0 Request processed in 51us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.072228:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:1.0:1789708596.072237:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fa91180 x1876645365503488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708596.072247:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789708596.072251:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365503488:0@lo:400:kworker.0 00000100:00100000:3.0:1789708596.072276:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365503616:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.072285:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789708596.072294:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365503744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708596.072314:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365503104:0@lo:400:kworker.0 00000100:00080000:3.0:1789708596.072315:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708596.072322:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708596.072335:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365503616:0@lo:400:kworker.0 00000100:00100000:3.0:1789708596.072348:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365502848:0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.072353:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365503744:12345-0@lo:400:kworker.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.072361:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789708596.072367:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365503360:0@lo:400:kworker.0 00010000:00080000:1.0:1789708596.072385:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fa90380 x1876645365503744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708596.072397:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365503744:0@lo:400:kworker.0 00000100:00100000:0.0:1789708596.072412:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365502592:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789708596.309381:0:14215:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708596.309389:0:14215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708596.309426:0:14215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789708596.309439:0:14215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789708596.343376:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.343430:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357068672 00000100:00100000:3.0:1789708596.343441:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357068672 00000100:00100000:3.0:1789708596.343504:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1789708596.343516:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+19:11302:x1876645357068672:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:3.0:1789708596.343585:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d360 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343601:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343611:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343622:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d367 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343635:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343639:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343714:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343739:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343747:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708596.343788:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343798:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343802:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d360 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343807:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d360 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343811:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.343814:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d360 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343819:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d360 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343835:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:3.0:1789708596.343837:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.343841:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d360 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343846:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d360 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343854:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343858:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d367 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343862:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343865:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.343867:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343870:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d367 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343874:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee02bcb600) 00010000:00010000:3.0:1789708596.343876:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.343878:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d367 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343882:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d367 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343909:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343916:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343922:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343928:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.343931:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343938:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343946:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee02bcba00) 00010000:00010000:3.0:1789708596.343949:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.343952:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.343958:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d36e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.344033:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+19:11302:x1876645357068672:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 518us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.344042:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:0.0:1789708596.359222:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.359254:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357068928 00000100:00100000:0.0:1789708596.359278:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357068928 00000100:00100000:0.0:1789708596.359324:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:0.0:1789708596.359332:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+19:11305:x1876645357068928:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708596.359347:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708596.359363:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d375 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e046 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359428:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d37c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359439:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d37c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359448:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d37c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359458:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d383 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359463:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359477:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359576:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359584:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359592:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708596.359601:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789708596.359661:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d37c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359666:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d37c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359670:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d37c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359674:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.359677:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d37c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359683:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d37c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359691:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708596.359693:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.359701:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d37c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359705:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d37c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359713:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359717:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d383 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359720:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359736:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.359738:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359742:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d383 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359749:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48800) 00010000:00010000:0.0:1789708596.359750:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.359752:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d383 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359756:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d383 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359783:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d375 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e046 expref: 22 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359800:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e046 expref: 21 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.359804:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:0.0:1789708596.359806:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708596.359807:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0200, rc 0) 00000100:00100000:0.0:1789708596.359849:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+21:11305:x1876645357068928:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 519us (637us total) trans 4294967358 rc 0/0 00000100:00100000:0.0:1789708596.359854:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:2.0:1789708596.360961:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.360989:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357069056 00000100:00100000:3.0:1789708596.360994:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357069056 00000100:00100000:3.0:1789708596.361023:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:3.0:1789708596.361034:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+21:11305:x1876645357069056:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1789708596.361060:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.361068:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.361076:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.361095:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.361102:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d398 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.361109:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.361115:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.361118:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.361124:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.361133:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:3.0:1789708596.361136:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708596.361140:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d398 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.361146:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.361191:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+21:11305:x1876645357069056:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 156us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.361197:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:2.0:1789708596.361754:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.361798:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357069312 00000100:00100000:0.0:1789708596.361802:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357069312 00000100:00100000:0.0:1789708596.361837:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:0.0:1789708596.361846:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+21:11305:x1876645357069312:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789708596.361951:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+22:11305:x1876645357069312:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 106us (195us total) trans 4294967359 rc 0/0 00000100:00100000:0.0:1789708596.361958:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:0.0:1789708596.372754:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708596.372793:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357069568 00000100:00100000:2.0:1789708596.372802:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357069568 00000100:00100000:2.0:1789708596.372844:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:2.0:1789708596.372852:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+22:10825:x1876645357069568:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708596.372873:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708596.372897:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d39f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e04d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.372979:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.372990:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e046 expref: 23 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.372995:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.373019:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e046 expref: 23 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.373027:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e046 expref: 23 pid: 13656 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.373037:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365503872:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708596.373106:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.373778:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365503872:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708596.373796:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.373990:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.374025:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357069696 00000100:00100000:3.0:1789708596.374065:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357069696 00010000:00010000:3.0:1789708596.374085:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e046 expref: 24 pid: 13656 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.374110:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:3.0:1789708596.374117:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+24:2395:x1876645357069696:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708596.374127:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708596.374133:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e046 expref: 24 pid: 13656 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.374141:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e046 expref: 24 pid: 13656 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.374154:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d38a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e046 expref: 24 pid: 13656 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.374163:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:3.0:1789708596.374166:0:7427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.374179:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.374186:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.374208:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708596.374226:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.374233:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.374239:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+23:2395:x1876645357069696:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 121us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.374246:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000004:00200000:2.0:1789708596.374246:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789708596.374374:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d39f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e04d expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.374387:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e04d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.374395:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:2.0:1789708596.374398:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708596.374401:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd800, rc 0) 00000100:00100000:2.0:1789708596.374432:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+23:10825:x1876645357069568:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1580us (1684us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789708596.374438:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:0.0:1789708596.375203:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.375233:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357069824 00000100:00100000:3.0:1789708596.375237:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357069824 00000100:00100000:3.0:1789708596.375274:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:3.0:1789708596.375282:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+23:10825:x1876645357069824:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708596.375291:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.375298:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e054 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.375313:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d3bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.375319:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d3bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.375325:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d3bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.375379:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e054 expref: 25 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.375395:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d3bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e054 expref: 24 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.375401:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:3.0:1789708596.375403:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789708596.375405:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8e00, rc 0) 00000100:00100000:3.0:1789708596.375426:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+24:10825:x1876645357069824:12345-192.168.201.52@tcp:101:bash.0 Request processed in 147us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.375430:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:3.0:1789708596.376095:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.376140:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357070080 00000100:00100000:0.0:1789708596.376144:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357070080 00000100:00100000:0.0:1789708596.376169:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:0.0:1789708596.376175:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+24:10825:x1876645357070080:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:0.0:1789708596.376288:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.376307:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.376313:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789708596.376345:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000004:00010000:0.0:1789708596.376360:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055d57000 reply state 00000000bb055ad8 transno 4294967362 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.376367:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.376371:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:0.0:1789708596.376372:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708596.376374:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789708596.376397:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:0.0:1789708596.376439:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+28:10825:x1876645357070080:12345-192.168.201.52@tcp:36:bash.0 Request processed in 264us (345us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789708596.376444:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 95 00000020:00080000:0.0:1789708596.376447:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789708596.376969:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.376995:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357070208 00000100:00100000:3.0:1789708596.376999:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357070208 00000100:00100000:3.0:1789708596.377021:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:3.0:1789708596.377026:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+28:10825:x1876645357070208:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708596.377033:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.377040:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d3c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e05b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.377059:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e05b expref: 29 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.377065:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e05b expref: 29 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.377075:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:3.0:1789708596.377081:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708596.377083:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9400, rc 0) 00000100:00100000:3.0:1789708596.377106:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+29:10825:x1876645357070208:12345-192.168.201.52@tcp:101:bash.0 Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.377110:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:2.0:1789708596.377833:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.377863:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357070336 00000100:00100000:3.0:1789708596.377867:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357070336 00000100:00100000:3.0:1789708596.377890:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1789708596.377894:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:10825:x1876645357070336:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708596.377902:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.377915:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d3d0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e062 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708596.377934:0:8398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aacc932, atime: 0x6aacc931, ctime: 0x6aacc932, blocks: 0x8 00010000:00010000:3.0:1789708596.377945:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=167s v=(0 0) 00010000:00010000:3.0:1789708596.377948:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708596.377953:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d3d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e062 expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.377962:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d3d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e062 expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.377968:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8000, rc 0) 00000100:00100000:3.0:1789708596.377989:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+7:10825:x1876645357070336:12345-192.168.201.52@tcp:101:bash.0 Request processed in 95us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.377993:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:2.0:1789708596.378569:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.378607:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357070464 00000100:00100000:0.0:1789708596.378611:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357070464 00002000:00010000:0.0:1789708596.378626:0:8402:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789708596.378629:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086f8e00 with x1876645357070464 ext(0->18446744073709551615) 00002000:00010000:0.0:1789708596.378634:0:8402:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee086f8e00. 00000100:00100000:0.0:1789708596.378648:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:0.0:1789708596.378652:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2397:x1876645357070464:12345-192.168.201.52@tcp:10:bash.0 00002000:00010000:0.0:1789708596.378832:0:8402:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789708596.378834:0:8402:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789708594 -> 1789708596 00002000:00010000:0.0:1789708596.378836:0:8402:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789708593 -> 1789708593 00002000:00010000:0.0:1789708596.378838:0:8402:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789708594 -> 1789708596 00002000:00010000:0.0:1789708596.378839:0:8402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789708596.378860:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2397:x1876645357070464:12345-192.168.201.52@tcp:10:bash.0 Request processed in 207us (293us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789708596.378864:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00002000:00010000:0.0:1789708596.378867:0:8402:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789708596.378868:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086f8e00 with x1876645357070464 ext(0->18446744073709551615) 00002000:00010000:0.0:1789708596.378871:0:8402:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee086f8e00. 00000100:00100000:0.0:1789708596.402482:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.402541:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357070592 00000100:00100000:3.0:1789708596.402550:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357070592 00000100:00100000:3.0:1789708596.402602:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:3.0:1789708596.402614:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+29:11319:x1876645357070592:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:3.0:1789708596.402676:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402690:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402700:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402715:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d3de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402735:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d3de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402743:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d3de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402806:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402815:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402822:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708596.402861:0:13656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402886:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402892:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402899:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402904:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.402908:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402915:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402926:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:3.0:1789708596.402928:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.402933:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402939:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d3d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402951:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d3de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402957:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d3de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402962:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d3de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402973:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.402976:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d3de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402982:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d3de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.402990:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee02bcbc00) 00010000:00010000:3.0:1789708596.402993:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.402996:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d3de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.403001:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d3de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.403016:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.403022:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.403027:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.403032:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.403035:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.403040:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.403056:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:3.0:1789708596.403058:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.403061:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.403066:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d3e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.403144:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+29:11319:x1876645357070592:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 532us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.403152:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:2.0:1789708596.419225:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.420806:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357070848 00000100:00100000:1.0:1789708596.420815:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357070848 00000100:00100000:1.0:1789708596.420875:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:1.0:1789708596.420886:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+29:11322:x1876645357070848:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708596.420906:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708596.420922:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d3ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e069 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.420977:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d3f3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.420987:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d3f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.420995:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d3f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421005:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d3fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421009:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d3fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421013:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d3fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421113:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d401 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421119:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421123:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708596.421130:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789708596.421183:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d3f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421188:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d3f3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421192:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d3f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421196:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708596.421198:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d3f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421203:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d3f3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421211:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:1.0:1789708596.421213:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708596.421216:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d3f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421227:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d3f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421236:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d3fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421239:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d3fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421243:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d3fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421246:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708596.421247:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d3fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421251:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d3fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421254:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bed08848d00) 00010000:00010000:1.0:1789708596.421256:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708596.421287:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d3fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421292:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d3fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421319:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d3ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e069 expref: 32 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421328:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e069 expref: 31 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.421338:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:1.0:1789708596.421340:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789708596.421342:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948800, rc 0) 00000100:00100000:1.0:1789708596.421387:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+31:11322:x1876645357070848:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 504us (2172us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789708596.421394:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:2.0:1789708596.422638:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.422678:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357070976 00000100:00100000:3.0:1789708596.422685:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357070976 00000100:00100000:3.0:1789708596.422735:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:3.0:1789708596.422746:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+31:11322:x1876645357070976:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1789708596.422781:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.422791:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e04d expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.422797:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.422828:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e04d expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.422837:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e04d expref: 31 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.422853:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365504000:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708596.422910:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857180 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.423626:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365504000:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708596.423704:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.423756:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.423786:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357071232 00000100:00100000:1.0:1789708596.423791:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357071232 00000100:00100000:1.0:1789708596.423819:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:1.0:1789708596.423824:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+32:6618:x1876645357071232:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789708596.423974:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+33:6618:x1876645357071232:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 149us (219us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789708596.423979:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:0.0:1789708596.425026:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.425073:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357071360 00000100:00100000:1.0:1789708596.425079:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357071360 00010000:00010000:1.0:1789708596.425100:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e04d expref: 33 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.425130:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:1.0:1789708596.425138:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+33:2396:x1876645357071360:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708596.425150:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708596.425157:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e04d expref: 33 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.425170:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e04d expref: 33 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.425198:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d3a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e04d expref: 33 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.425211:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:1.0:1789708596.425215:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.425224:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.425231:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.425252:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708596.425304:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+32:2396:x1876645357071360:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 165us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.425313:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00010000:00010000:3.0:1789708596.425317:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.425327:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.425351:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.425358:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.425365:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.425370:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.425374:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.425395:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.425405:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:3.0:1789708596.425414:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708596.425418:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.425424:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d40f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.425508:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+31:11322:x1876645357070976:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 2764us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.425517:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:0.0:1789708596.426249:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708596.426312:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357071616 00000100:00100000:2.0:1789708596.426316:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357071616 00000100:00100000:2.0:1789708596.426342:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789708596.426348:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+31:11322:x1876645357071616:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789708596.426472:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+32:11322:x1876645357071616:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 122us (222us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789708596.426486:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789708596.457015:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.457079:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357071872 00000100:00100000:0.0:1789708596.457088:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357071872 00000100:00100000:0.0:1789708596.457137:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:0.0:1789708596.457144:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+32:11333:x1876645357071872:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1789708596.457165:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708596.457182:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d416 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e070 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457283:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d41d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457296:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d41d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457330:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d41d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457346:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d424 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457351:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457356:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457443:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d42b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457449:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d42b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457454:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d42b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708596.457467:0:8421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789708596.457526:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d41d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457531:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d41d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457536:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d41d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457539:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.457547:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d41d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457552:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d41d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457562:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708596.457564:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.457567:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d41d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457572:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d41d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457580:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457583:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d424 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457586:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457590:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.457592:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457595:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d424 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457598:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48800) 00010000:00010000:0.0:1789708596.457599:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.457604:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d424 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457608:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d424 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457638:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d416 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e070 expref: 35 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457646:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d42b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e070 expref: 34 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.457651:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:0.0:1789708596.457652:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708596.457654:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0e00, rc 0) 00000100:00100000:0.0:1789708596.457701:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+34:11333:x1876645357071872:12345-192.168.201.52@tcp:101:cat.0 Request processed in 558us (698us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789708596.457706:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:3.0:1789708596.460202:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.460300:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357072128 00000100:00100000:1.0:1789708596.460309:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357072128 00000100:00100000:1.0:1789708596.460358:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:1.0:1789708596.460369:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+34:11333:x1876645357072128:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:1.0:1789708596.460610:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+35:11333:x1876645357072128:12345-192.168.201.52@tcp:35:cat.0 Request processed in 243us (416us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1789708596.460619:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1789708596.471004:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.471072:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357072384 00000100:00100000:0.0:1789708596.471084:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357072384 00000100:00100000:0.0:1789708596.471154:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:0.0:1789708596.471164:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+35:11334:x1876645357072384:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:0.0:1789708596.471226:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789708596.471254:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d3c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e05b expref: 35 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471305:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d42b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e070 expref: 34 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471342:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d401 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e069 expref: 33 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471356:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d3bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e054 expref: 32 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471363:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:0.0:1789708596.471367:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708596.471389:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d439 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471404:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d439 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471415:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d439 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471433:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471441:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471447:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471538:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d447 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471548:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d447 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471578:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d447 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708596.471801:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:0.0:1789708596.471842:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471849:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471853:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471858:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471862:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471865:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471879:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708596.471892:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d447 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471896:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d447 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471900:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d447 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.471902:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708596.471909:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471914:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.471921:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d447 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.471922:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708596.471929:0:7426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471930:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d447 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471948:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:0.0:1789708596.471951:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789708596.471953:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d447 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.471957:0:7426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471958:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d447 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.471982:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:3.0:1789708596.471985:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789708596.471985:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d439 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.471990:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.471999:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d439 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.472000:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d44e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.472018:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d439 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.472020:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708596.472024:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708596.472026:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.472030:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d439 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.472036:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d439 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.472038:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708596.472059:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708596.472061:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.472065:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d439 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.472070:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d439 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708596.472078:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000119e3e9f reply state 0000000093c5231c transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.472085:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.472089:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48800) 00010000:00010000:0.0:1789708596.472090:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708596.472092:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708596.472161:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+33:11334:x1876645357072384:12345-192.168.201.52@tcp:36:rm.0 Request processed in 997us (1175us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789708596.472168:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:2.0:1789708596.486974:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.487028:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357072640 00000100:00100000:0.0:1789708596.487037:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357072640 00000100:00100000:0.0:1789708596.487081:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:0.0:1789708596.487089:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+33:11340:x1876645357072640:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708596.487110:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708596.487126:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d455 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e077 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487214:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d45c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487238:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d45c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487245:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d45c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487254:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487273:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487278:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789708596.487557:0:6483:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789708596.487696:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487702:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487707:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487747:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d45c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487752:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d45c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487757:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d45c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487766:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.487769:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d45c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487775:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d45c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487789:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708596.487791:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.487794:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d45c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487798:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d45c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708596.487806:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d138cdad reply state 000000000020a889 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487813:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487816:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48800) 00010000:00010000:0.0:1789708596.487818:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708596.487819:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789708596.487839:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d455 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e077 expref: 36 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487847:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e077 expref: 35 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.487859:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48200) 00010000:00010000:0.0:1789708596.487861:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708596.487863:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0800, rc 0) 00000100:00100000:0.0:1789708596.487908:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+36:11340:x1876645357072640:12345-192.168.201.52@tcp:101:bash.0 Request processed in 820us (943us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789708596.487919:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:3.0:1789708596.489442:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.489492:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357072768 00000100:00100000:1.0:1789708596.489499:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357072768 00000100:00080000:3.0:1789708596.489536:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708596.489552:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:1.0:1789708596.489578:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:2397:x1876645357072768:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708596.489589:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708596.489603:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008c9cc9a/0xf45f43947e47d478 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e07e expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708596.489623:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708596.489637:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=167s v=(0 0) 00010000:00010000:1.0:1789708596.489641:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708596.489650:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008c9cc9a/0xf45f43947e47d478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e07e expref: 8 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.489665:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008c9cc9a/0xf45f43947e47d478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e07e expref: 8 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.489676:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949800, rc 0) 00000100:00100000:1.0:1789708596.489717:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+8:2397:x1876645357072768:12345-192.168.201.52@tcp:101:bash.0 Request processed in 142us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.489736:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:2.0:1789708596.490620:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.490653:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357072896 00000100:00100000:0.0:1789708596.490658:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357072896 00000100:00100000:0.0:1789708596.490682:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:0.0:1789708596.490687:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+8:11340:x1876645357072896:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708596.490693:0:9145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708596.490703:0:9145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e085 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.490729:0:9145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008c9cc9a/0xf45f43947e47d478 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e07e expref: 9 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.490739:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708596.490742:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708596.490747:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 9 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.490783:0:9145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008c9cc9a/0xf45f43947e47d478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e07e expref: 9 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.490806:0:9145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008c9cc9a/0xf45f43947e47d478 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e07e expref: 9 pid: 8399 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.490816:0:9145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9145:1876645365504128:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708596.490873:0:9145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708596.491504:0:9145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9145:1876645365504128:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708596.491521:0:9145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 9 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.491529:0:9145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1600, rc 0) 00000100:00100000:0.0:1789708596.491555:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+9:11340:x1876645357072896:12345-192.168.201.52@tcp:101:bash.0 Request processed in 867us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.491568:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:3.0:1789708596.491706:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.491757:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357073024 00000100:00100000:1.0:1789708596.491761:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357073024 00010000:00010000:1.0:1789708596.491776:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008c9cc9a/0xf45f43947e47d478 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e07e expref: 9 pid: 8399 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.491797:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:1.0:1789708596.491801:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+9:2395:x1876645357073024:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708596.491808:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708596.491824:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008c9cc9a/0xf45f43947e47d478 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e07e expref: 9 pid: 8399 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.491833:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008c9cc9a/0xf45f43947e47d478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e07e expref: 9 pid: 8399 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.491843:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008c9cc9a/0xf45f43947e47d478 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e07e expref: 9 pid: 8399 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.491851:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708596.491853:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708596.491857:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.491862:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.491879:0:6469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.491886:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6469:1876645365504256:192.168.201.52@tcp:105: 00000100:00100000:1.0:1789708596.491916:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708596.492763:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6469:1876645365504256:192.168.201.52@tcp:105: 00010000:00010000:1.0:1789708596.492782:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708596.492813:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357073024:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 1010us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.492832:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:2.0:1789708596.493044:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.493091:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357073280 00000100:00100000:0.0:1789708596.493095:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357073280 00000100:00100000:0.0:1789708596.493130:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1789708596.493139:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2c79a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+36:11340:x1876645357073280:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1789708596.493366:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2c79a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+37:11340:x1876645357073280:12345-192.168.201.52@tcp:35:bash.0 Request processed in 228us (322us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789708596.493371:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:3.0:1789708596.546782:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.546862:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357073408 00000100:00100000:0.0:1789708596.546873:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357073408 00000100:00100000:0.0:1789708596.546932:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:0.0:1789708596.546943:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+37:11356:x1876645357073408:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708596.546983:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708596.547003:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d486 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e08c expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.547079:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d48d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.547092:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d48d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.547116:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d48d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708596.547158:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789708596.547162:0:13656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708596.547181:0:13656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d48d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.547205:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e08c expref: 39 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.547224:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d48d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e08c expref: 38 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.547231:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708596.547233:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708596.547236:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0a00, rc 0) 00000100:00100000:0.0:1789708596.547339:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+38:11356:x1876645357073408:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 396us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.547346:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:2.0:1789708596.549420:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.549524:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357073664 00000100:00100000:1.0:1789708596.549533:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357073664 00000100:00100000:1.0:1789708596.549595:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:1.0:1789708596.549605:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+38:11356:x1876645357073664:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708596.549631:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708596.549649:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d494 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e093 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.549757:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d49b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.549772:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e077 expref: 39 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.549790:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d49b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.549827:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e077 expref: 39 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.549842:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e077 expref: 39 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.549855:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365504384:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708596.549979:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708596.550947:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365504384:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708596.550972:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d49b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.551116:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.551154:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357073792 00000100:00100000:1.0:1789708596.551158:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357073792 00010000:00010000:1.0:1789708596.551178:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e077 expref: 40 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.551201:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:1.0:1789708596.551208:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+40:2395:x1876645357073792:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708596.551216:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708596.551220:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e077 expref: 40 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.551228:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e077 expref: 40 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.551241:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d46a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e077 expref: 40 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.551252:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48200) 00010000:00010000:1.0:1789708596.551255:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d49b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.551292:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d49b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.551301:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d49b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.551324:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708596.551335:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d49b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.551342:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d49b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708596.551353:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000100:00100000:1.0:1789708596.551354:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+39:2395:x1876645357073792:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 147us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.551362:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00010000:00010000:3.0:1789708596.551456:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d494 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e093 expref: 40 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.551548:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d49b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e093 expref: 39 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.551553:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48200) 00010000:00010000:3.0:1789708596.551555:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789708596.551557:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948e00, rc 0) 00000100:00100000:3.0:1789708596.551597:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+39:11356:x1876645357073664:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1994us (2188us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789708596.551604:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:2.0:1789708596.552738:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.552770:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357074048 00000100:00100000:3.0:1789708596.552775:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357074048 00000100:00100000:3.0:1789708596.552803:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:3.0:1789708596.552814:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+39:11356:x1876645357074048:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708596.552826:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.552834:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789708596.552844:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d49b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e093 expref: 39 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.552852:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48200) 00010000:00010000:3.0:1789708596.552858:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708596.552866:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d4a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e09a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.552932:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d4b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.552943:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.552951:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708596.552958:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789708596.552999:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d4a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e09a expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.553007:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d4b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e09a expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.553012:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee02bcbc00) 00010000:00010000:3.0:1789708596.553014:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789708596.553015:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9600, rc 0) 00000100:00100000:3.0:1789708596.553040:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+40:11356:x1876645357074048:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 227us (305us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789708596.553064:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:2.0:1789708596.554708:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.554770:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357074176 00000100:00100000:3.0:1789708596.554784:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357074176 00000100:00100000:3.0:1789708596.554822:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:3.0:1789708596.554831:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+40:11356:x1876645357074176:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708596.554845:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.554857:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d4be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0a1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.554891:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d4be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a1 expref: 41 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.554902:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d4be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a1 expref: 41 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.554917:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee02bcbc00) 00010000:00010000:3.0:1789708596.554920:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708596.554922:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8800, rc 0) 00000100:00100000:3.0:1789708596.554958:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+41:11356:x1876645357074176:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 128us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.554965:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:2.0:1789708596.556549:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.556577:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357074304 00000100:00100000:3.0:1789708596.556583:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357074304 00000100:00100000:3.0:1789708596.556617:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1789708596.556625:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357074304:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:3.0:1789708596.556654:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.556681:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.556689:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708596.556693:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789708596.556697:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.556742:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.556754:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 8 pid: 9145 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.556769:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8398:1876645365504512:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708596.556831:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed088573c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.557500:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8398:1876645365504512:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708596.557516:0:8398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.557768:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.557831:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357074432 00000100:00100000:3.0:1789708596.557836:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357074432 00002000:00100000:3.0:1789708596.557862:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9bee086fbb80 x1876645357074432/t0(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:737/0 lens 504/0 e 0 to 0 dl 1789708607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708596.557882:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086fbb80 with x1876645357074432 ext(0->8) 00010000:00010000:3.0:1789708596.557889:0:8404:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 9 pid: 9145 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.557901:0:8404:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 9 pid: 9145 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708596.557907:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bee086fbb80 00000100:00100000:3.0:1789708596.557932:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:3.0:1789708596.557940:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+9:2396:x1876645357074432:12345-192.168.201.52@tcp:4:lfs.0 00000100:00100000:3.0:1789708596.558485:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+11:2396:x1876645357074432:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 544us (715us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789708596.558493:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00002000:00100000:3.0:1789708596.558500:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9bee086fbb80 x1876645357074432/t4294967303(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:737/0 lens 504/448 e 0 to 0 dl 1789708607 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708596.558508:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086fbb80 with x1876645357074432 ext(0->8) 00010000:00010000:3.0:1789708596.558514:0:8404:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 11 pid: 9145 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.558524:0:8404:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 11 pid: 9145 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708596.558531:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bee086fbb80 00000100:00100000:2.0:1789708596.562712:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.562779:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357074560 00000100:00100000:1.0:1789708596.562788:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357074560 00010000:00010000:1.0:1789708596.562822:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 11 pid: 9145 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.562856:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:1.0:1789708596.562862:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+11:2395:x1876645357074560:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708596.562873:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789708596.562886:0:6470:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789708596.562889:0:6470:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789708596 00002000:00010000:1.0:1789708596.562890:0:6470:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789708596 00002000:00010000:1.0:1789708596.562892:0:6470:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789708596 00002000:00010000:1.0:1789708596.562894:0:6470:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789708596.562900:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 11 pid: 9145 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.562914:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 11 pid: 9145 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.562935:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47d47f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e085 expref: 11 pid: 9145 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.562967:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708596.562970:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708596.562975:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.562982:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.563006:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708596.563033:0:8398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.563049:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+10:2395:x1876645357074560:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 185us (342us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708596.563056:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.563062:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00010000:00010000:3.0:1789708596.563085:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.563094:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.563100:0:8398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.563106:0:8398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708596.563110:0:8398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.563115:0:8398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.563128:0:8398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.563133:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47d4c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.563219:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+9:2395:x1876645357074304:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 6595us (6672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.563227:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:2.0:1789708596.563895:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.563942:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357074816 00000100:00100000:1.0:1789708596.563947:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357074816 00000100:00100000:1.0:1789708596.563980:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:1.0:1789708596.563989:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+41:11356:x1876645357074816:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:1.0:1789708596.564040:0:14125:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d4b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e09a expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708596.564309:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967374 00000001:00080000:1.0:1789708596.564354:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967375 00000001:00080000:1.0:1789708596.564675:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967376 00010000:00010000:1.0:1789708596.564731:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.564747:0:14125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d4be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a1 expref: 45 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.564767:0:14125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.564795:0:14125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d4be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a1 expref: 45 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.564805:0:14125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d4be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a1 expref: 45 pid: 8421 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.564815:0:14125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14125:1876645365504640:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708596.564865:0:14125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789708596.565845:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.565851:0:14125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14125:1876645365504640:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708596.565872:0:14125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.565879:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357074944 00000100:00100000:3.0:1789708596.565884:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357074944 00010000:00010000:3.0:1789708596.565950:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d4be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a1 expref: 46 pid: 8421 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.565973:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:3.0:1789708596.565980:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+46:2396:x1876645357074944:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708596.565990:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708596.565994:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d4be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a1 expref: 46 pid: 8421 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.566002:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d4be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a1 expref: 46 pid: 8421 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.566013:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d4be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a1 expref: 46 pid: 8421 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.566023:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee02bcbc00) 00010000:00010000:3.0:1789708596.566026:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.566032:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.566043:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.566061:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708596.566085:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+45:2396:x1876645357074944:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 105us (243us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708596.566089:0:14125:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.566091:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00010000:00010000:1.0:1789708596.566101:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708596.566156:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967377 00000001:00080000:1.0:1789708596.566253:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967378 00000100:00100000:1.0:1789708596.566353:0:14125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365504768:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789708596.566397:0:14125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708596.566421:0:14125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708596.566440:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365504768 00000100:00100000:0.0:1789708596.566444:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365504768 00000100:00100000:0.0:1789708596.566473:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789708596.566478:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14125:x1876645365504768:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789708596.566537:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14125:x1876645365504768:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.566542:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789708596.566555:0:14125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365504768:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789708596.566668:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967379 00000100:00100000:1.0:1789708596.566697:0:14125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365504896:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789708596.566735:0:14125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708596.566753:0:14125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.566770:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365504896 00000100:00100000:3.0:1789708596.566775:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365504896 00000100:00100000:3.0:1789708596.566799:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789708596.566807:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14125:x1876645365504896:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789708596.566892:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14125:x1876645365504896:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 85us (155us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789708596.566898:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789708596.566920:0:14125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365504896:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789708596.566949:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00010000:00010000:1.0:1789708596.566970:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.566976:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.566981:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.566985:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708596.566988:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.566993:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.566999:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee02bcbc00) 00010000:00010000:1.0:1789708596.567001:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789708596.567003:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.567007:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d4cc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708596.567073:0:14125:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789708596.567132:0:14125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789708596.567141:0:14125:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 167376880131ns, next at 168376878246ns, rc = 0 00000001:00080000:1.0:1789708596.567146:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00010000:00010000:1.0:1789708596.567160:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee02bcbc00) 00010000:00010000:1.0:1789708596.567162:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789708596.567166:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d4b0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e09a expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.567235:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+48:11356:x1876645357074816:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 3247us (3339us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1789708596.567243:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000020:00080000:1.0:1789708596.567247:0:14125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789708596.568007:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.568047:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357075072 00000100:00100000:0.0:1789708596.568052:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357075072 00000100:00100000:0.0:1789708596.568087:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:0.0:1789708596.568096:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+48:11356:x1876645357075072:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708596.568108:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708596.568125:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d4d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0a8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.568158:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d4d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a8 expref: 49 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.568167:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d4d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a8 expref: 49 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.568177:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:0.0:1789708596.568179:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708596.568181:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708596.568204:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+49:11356:x1876645357075072:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 111us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.568208:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:2.0:1789708596.569336:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.569386:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357075328 00000100:00100000:0.0:1789708596.569390:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357075328 00000100:00100000:0.0:1789708596.569416:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:0.0:1789708596.569424:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+49:11356:x1876645357075328:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789708596.569550:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+50:11356:x1876645357075328:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 127us (216us total) trans 4294967383 rc 0/0 00000100:00100000:0.0:1789708596.569554:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789708596.596118:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.596165:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357075456 00000100:00100000:0.0:1789708596.596175:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357075456 00000100:00100000:0.0:1789708596.596226:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:0.0:1789708596.596234:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+50:11366:x1876645357075456:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:0.0:1789708596.596341:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4da lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596354:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596362:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596370:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596374:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596378:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596436:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596447:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596451:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708596.596488:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596496:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596500:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4da lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596505:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596508:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.596511:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596515:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4da lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596522:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708596.596524:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.596527:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596530:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596543:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596547:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596550:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596553:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.596554:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596558:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596561:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48800) 00010000:00010000:0.0:1789708596.596563:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.596565:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596568:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596572:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596576:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596579:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596585:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.596587:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596591:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596594:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:0.0:1789708596.596596:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.596597:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.596600:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.596657:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+50:11366:x1876645357075456:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 424us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.596662:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:2.0:1789708596.611967:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.612027:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357075712 00000100:00100000:0.0:1789708596.612036:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357075712 00000100:00100000:0.0:1789708596.612080:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:0.0:1789708596.612087:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+50:11369:x1876645357075712:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708596.612109:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708596.612129:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0af expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612189:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612213:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612221:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612228:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612233:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612237:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612345:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612350:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612354:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708596.612361:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789708596.612419:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612425:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612429:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612437:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.612440:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612445:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612455:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708596.612458:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.612463:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612468:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d4f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612482:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612487:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612493:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612497:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.612500:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612506:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612527:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48800) 00010000:00010000:0.0:1789708596.612530:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.612534:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612539:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d4fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612579:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d4ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0af expref: 53 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612590:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0af expref: 52 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.612596:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:0.0:1789708596.612597:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708596.612599:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1400, rc 0) 00000100:00100000:0.0:1789708596.612645:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+52:11369:x1876645357075712:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 558us (687us total) trans 4294967384 rc 0/0 00000100:00100000:0.0:1789708596.612649:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:2.0:1789708596.613677:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.613730:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357075840 00000100:00100000:3.0:1789708596.613735:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357075840 00000100:00100000:3.0:1789708596.613769:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:3.0:1789708596.613785:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+52:11369:x1876645357075840:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1789708596.613816:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d512 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.613826:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d512 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.613834:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d512 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.613851:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d512 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.613863:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d512 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.613868:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d512 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.613873:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.613876:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d512 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.613882:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d512 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.613889:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.613892:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708596.613895:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d512 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.613900:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d512 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.613938:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+52:11369:x1876645357075840:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 162us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.613945:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:2.0:1789708596.614560:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.614618:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357076096 00000100:00100000:1.0:1789708596.614623:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357076096 00000100:00100000:1.0:1789708596.614652:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:1.0:1789708596.614660:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+52:11369:x1876645357076096:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789708596.614782:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+53:11369:x1876645357076096:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 123us (231us total) trans 4294967385 rc 0/0 00000100:00100000:1.0:1789708596.614790:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1789708596.643151:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.643198:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357076352 00000100:00100000:3.0:1789708596.643207:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357076352 00000100:00100000:3.0:1789708596.643254:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:3.0:1789708596.643276:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+53:11379:x1876645357076352:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708596.643315:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.643332:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789708596.643358:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d48d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e08c expref: 53 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.643372:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:3.0:1789708596.643375:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708596.643396:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d519 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0b6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.643483:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.643492:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0af expref: 53 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.643497:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.643520:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0af expref: 53 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.643529:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0af expref: 53 pid: 13656 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.643538:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365505024:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708596.643618:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed088573c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.644543:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365505024:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708596.644626:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.644683:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.644712:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357076480 00000100:00100000:3.0:1789708596.644729:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357076480 00010000:00010000:3.0:1789708596.644794:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0af expref: 54 pid: 13656 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.644824:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:3.0:1789708596.644833:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08574450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+54:2395:x1876645357076480:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708596.644844:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708596.644850:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0af expref: 54 pid: 13656 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.644861:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0af expref: 54 pid: 13656 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.644876:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d504 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0af expref: 54 pid: 13656 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.644886:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.644890:0:7427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.644898:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.644905:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.644927:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708596.644946:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.644952:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708596.644970:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000100:00100000:3.0:1789708596.644976:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08574450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+53:2395:x1876645357076480:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 140us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.644986:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00010000:00010000:2.0:1789708596.645072:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d519 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0b6 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.645088:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0b6 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.645096:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:2.0:1789708596.645099:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708596.645101:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8200, rc 0) 00000100:00100000:2.0:1789708596.645134:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+53:11379:x1876645357076352:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1873us (1992us total) trans 4294967386 rc 0/0 00000100:00100000:2.0:1789708596.645141:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:2.0:1789708596.646140:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.646169:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357076608 00000100:00100000:3.0:1789708596.646175:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357076608 00000100:00100000:3.0:1789708596.646211:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:3.0:1789708596.646220:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+53:11379:x1876645357076608:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708596.646234:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.646246:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d52e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0bd expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.646295:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.646306:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.646315:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.646398:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d52e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0bd expref: 55 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.646412:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0bd expref: 54 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.646419:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.646422:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789708596.646425:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9600, rc 0) 00000100:00100000:3.0:1789708596.646463:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+54:11379:x1876645357076608:12345-192.168.201.52@tcp:101:bash.0 Request processed in 245us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.646470:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:3.0:1789708596.647353:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.647398:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357076864 00000100:00100000:0.0:1789708596.647404:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357076864 00000100:00100000:0.0:1789708596.647437:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:0.0:1789708596.647446:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+54:11379:x1876645357076864:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:0.0:1789708596.647597:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.647605:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.647617:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789708596.647650:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000004:00010000:0.0:1789708596.647671:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000967ef89f reply state 00000000f01e8750 transno 4294967388 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.647683:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.647689:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:0.0:1789708596.647691:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708596.647694:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708596.647757:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+57:11379:x1876645357076864:12345-192.168.201.52@tcp:36:bash.0 Request processed in 312us (405us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789708596.647764:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 113 00000020:00080000:0.0:1789708596.647768:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789708596.650016:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.650072:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357076992 00000100:00100000:3.0:1789708596.650080:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357076992 00000100:00100000:3.0:1789708596.650122:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:3.0:1789708596.650130:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+57:11379:x1876645357076992:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708596.650146:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.650160:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d543 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0c4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.650224:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.650237:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0b6 expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.650245:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.650296:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0b6 expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.650310:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0b6 expref: 58 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.650323:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1876645365505152:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708596.650404:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.651389:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1876645365505152:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708596.651406:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.651743:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.651805:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357077120 00000100:00100000:1.0:1789708596.651812:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357077120 00010000:00010000:1.0:1789708596.651838:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0b6 expref: 59 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.651869:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:1.0:1789708596.651878:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+59:2396:x1876645357077120:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708596.651889:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708596.651903:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0b6 expref: 59 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.651915:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0b6 expref: 59 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.651933:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d520 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0b6 expref: 59 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.651947:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708596.651952:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.651960:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.651968:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.651995:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708596.652011:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.652020:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.652036:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+58:2396:x1876645357077120:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 159us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.652045:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000004:00200000:3.0:1789708596.652059:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789708596.652065:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708596.652082:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.652126:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d543 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0c4 expref: 58 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.652140:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0c4 expref: 57 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.652148:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.652151:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708596.652154:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9400, rc 0) 00000100:00100000:3.0:1789708596.652228:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+57:11379:x1876645357076992:12345-192.168.201.52@tcp:101:bash.0 Request processed in 2098us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.652235:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:0.0:1789708596.653570:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708596.653642:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357077376 00000100:00100000:2.0:1789708596.653650:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357077376 00000100:00100000:2.0:1789708596.653691:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1789708596.653704:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+57:11379:x1876645357077376:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:2.0:1789708596.653882:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+58:11379:x1876645357077376:12345-192.168.201.52@tcp:35:bash.0 Request processed in 182us (313us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789708596.653890:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1789708596.673448:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.673511:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357077504 00000100:00100000:0.0:1789708596.673521:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357077504 00000100:00100000:0.0:1789708596.673569:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:0.0:1789708596.673576:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+58:11385:x1876645357077504:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708596.673598:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708596.673615:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0cb expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.673665:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d558 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.673691:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.673702:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708596.673770:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789708596.673774:0:13656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708596.673793:0:13656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.673817:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47d551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0cb expref: 60 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.673835:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0cb expref: 59 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.673844:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708596.673847:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708596.673851:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0600, rc 0) 00000100:00100000:0.0:1789708596.673901:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+59:11385:x1876645357077504:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 324us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.673908:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:3.0:1789708596.676317:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.676390:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357077632 00000100:00100000:1.0:1789708596.676401:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357077632 00000100:00100000:1.0:1789708596.676446:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:1.0:1789708596.676456:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+59:11385:x1876645357077632:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708596.676468:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708596.676483:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d55f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0d2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676533:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d566 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676544:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d566 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676553:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d566 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676564:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d56d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676571:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d56d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676577:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d56d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676639:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d574 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676648:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676656:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708596.676686:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789708596.676690:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708596.676704:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676739:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676747:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d566 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676754:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d566 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676760:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d566 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676766:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708596.676779:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d566 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676790:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d566 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676800:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:1.0:1789708596.676803:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708596.676807:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d566 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676814:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d566 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676825:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d56d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676831:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d56d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676842:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d56d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676848:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708596.676851:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d56d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676857:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d56d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676864:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48800) 00010000:00010000:1.0:1789708596.676866:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708596.676869:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d56d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676875:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d56d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676897:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d55f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d2 expref: 61 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676909:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d574 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d2 expref: 60 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.676915:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708596.676918:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708596.676920:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949400, rc 0) 00000100:00100000:1.0:1789708596.676964:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+60:11385:x1876645357077632:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 510us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.676978:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:2.0:1789708596.677985:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.678020:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357077760 00000100:00100000:1.0:1789708596.678025:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357077760 00000100:00100000:1.0:1789708596.678054:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:1.0:1789708596.678059:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+60:2397:x1876645357077760:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708596.678067:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708596.678078:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d574 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d2 expref: 60 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.678087:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708596.678089:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708596.678119:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+59:2397:x1876645357077760:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 59us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.678126:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789708596.678365:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.678398:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357078016 00000100:00100000:3.0:1789708596.678404:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357078016 00000100:00100000:3.0:1789708596.678431:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:3.0:1789708596.678437:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+59:11385:x1876645357078016:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708596.678446:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.678455:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d57b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.678506:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.678514:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0c4 expref: 60 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.678520:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.678542:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0c4 expref: 60 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.678550:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0c4 expref: 60 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.678559:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365505280:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708596.678611:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708596.679285:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365505280:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708596.679314:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.679470:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.679511:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357078144 00000100:00100000:1.0:1789708596.679515:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357078144 00010000:00010000:1.0:1789708596.679529:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0c4 expref: 61 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.679548:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:1.0:1789708596.679555:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+61:2395:x1876645357078144:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708596.679563:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708596.679569:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0c4 expref: 61 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.679580:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0c4 expref: 61 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.679603:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d54a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0c4 expref: 61 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.679614:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708596.679618:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.679626:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.679634:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.679653:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708596.679678:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.679683:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+60:2395:x1876645357078144:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 126us (211us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708596.679695:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.679697:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00000004:00200000:2.0:1789708596.679713:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789708596.679817:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d57b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d9 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.679831:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d9 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.679839:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:2.0:1789708596.679842:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708596.679845:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8200, rc 0) 00000100:00100000:2.0:1789708596.679876:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+60:11385:x1876645357078016:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1438us (1511us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789708596.679884:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:2.0:1789708596.680845:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.680882:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357078400 00000100:00100000:1.0:1789708596.680888:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357078400 00000100:00100000:1.0:1789708596.680919:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1789708596.680927:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+60:11385:x1876645357078400:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:1.0:1789708596.680935:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708596.680947:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d4d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0a8 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.680959:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708596.680962:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708596.680990:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+59:11385:x1876645357078400:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 64us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.680997:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1789708596.681530:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.681558:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357078528 00000100:00100000:3.0:1789708596.681563:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357078528 00000100:00100000:3.0:1789708596.681588:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:3.0:1789708596.681592:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+59:11385:x1876645357078528:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:3.0:1789708596.681646:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.681654:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.681660:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708596.681730:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789708596.681776:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+59:11385:x1876645357078528:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 181us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.681783:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:0.0:1789708596.682399:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.682427:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357078656 00000100:00100000:3.0:1789708596.682431:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357078656 00000100:00100000:3.0:1789708596.682454:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:3.0:1789708596.682459:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+59:11385:x1876645357078656:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708596.682466:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.682473:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d597 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0e0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.682494:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.682500:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d597 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e0 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.682510:0:6484:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.682530:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d597 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e0 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.682542:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.682545:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708596.682549:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d597 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e0 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.682556:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8800, rc 0) 00000100:00100000:3.0:1789708596.682585:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+60:11385:x1876645357078656:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 124us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.682592:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 119 00000040:00080000:3.0:1789708596.710504:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708596.710512:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708596.710547:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789708596.710571:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789708596.710730:0:13754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365505408:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789708596.710851:0:13754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857480 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.712418:0:13754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365505408:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708596.713068:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.713257:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357078784 00000100:00100000:0.0:1789708596.713282:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357078784 00000100:00100000:0.0:1789708596.713337:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:0.0:1789708596.713347:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+60:11386:x1876645357078784:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789708596.713401:0:6483:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708596.713494:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+60:11386:x1876645357078784:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 148us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.713502:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:0.0:1789708596.717765:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.717826:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357078912 00000100:00100000:3.0:1789708596.717836:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357078912 00000100:00100000:3.0:1789708596.717890:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:3.0:1789708596.717903:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+60:11386:x1876645357078912:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789708596.717972:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d59e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718006:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d59e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718018:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d59e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718035:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d5a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718042:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718062:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718089:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718098:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718105:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708596.718147:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789708596.718152:0:13656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708596.718163:0:13656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718173:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d59e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718187:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d59e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718193:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d59e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718199:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.718202:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d59e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718209:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d59e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718220:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:3.0:1789708596.718223:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.718228:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d59e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718233:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d59e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718247:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718253:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d5a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718313:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718319:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.718329:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718336:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d5a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718346:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9bee02bcb100) 00010000:00010000:3.0:1789708596.718365:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.718370:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d5a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718377:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d5a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718397:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718403:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718409:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718414:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebee00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.718417:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718422:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718428:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.718431:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.718441:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.718447:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d5ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.718546:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+60:11386:x1876645357078912:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 646us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.718554:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:3.0:1789708596.719828:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.719888:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357079168 00000100:00100000:1.0:1789708596.719895:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357079168 00000100:00100000:1.0:1789708596.719938:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:1.0:1789708596.719947:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+60:11386:x1876645357079168:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708596.719961:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708596.719975:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d5b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0e7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720062:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d5ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720075:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d5ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720084:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d5ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708596.720093:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789708596.720169:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d5ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720176:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d5ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720182:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d5ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720187:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708596.720199:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d5ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720206:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d5ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720215:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708596.720218:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789708596.720221:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d5ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720227:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d5ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720296:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d5b3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e7 expref: 62 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720311:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:1.0:1789708596.720313:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708596.720318:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d5b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e7 expref: 62 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.720327:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949400, rc 0) 00000100:00100000:1.0:1789708596.720366:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+61:11386:x1876645357079168:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 421us (541us total) trans 4294967391 rc 301/301 00000100:00100000:1.0:1789708596.720373:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:2.0:1789708596.721580:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.721617:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357079296 00000100:00100000:3.0:1789708596.721624:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357079296 00000100:00100000:3.0:1789708596.721673:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:3.0:1789708596.721683:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+61:11386:x1876645357079296:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789708596.721709:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789708596.721812:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+61:11386:x1876645357079296:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 130us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.721820:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:0.0:1789708596.723121:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.723155:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357079552 00000100:00100000:3.0:1789708596.723162:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357079552 00000100:00100000:3.0:1789708596.723206:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:3.0:1789708596.723215:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+61:11386:x1876645357079552:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708596.723227:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.723230:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789708596.723252:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d558 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0cb expref: 61 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.723304:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:3.0:1789708596.723321:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708596.723334:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d5c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0ee expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708596.723667:0:8421:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789708596.723843:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d5cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.723855:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d5cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.723874:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d5cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.723917:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d5c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0ee expref: 63 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.723930:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d5cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0ee expref: 62 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.723938:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee02bcbd00) 00010000:00010000:3.0:1789708596.723941:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708596.723944:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509e00, rc 0) 00000100:00100000:3.0:1789708596.723985:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+62:11386:x1876645357079552:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 771us (865us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789708596.723997:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:2.0:1789708596.725431:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.725458:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357079808 00000100:00100000:3.0:1789708596.725464:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357079808 00000100:00100000:3.0:1789708596.725494:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:3.0:1789708596.725500:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+62:11386:x1876645357079808:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708596.725544:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708596.725560:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d5cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0ee expref: 62 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725573:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee02bcbd00) 00010000:00010000:3.0:1789708596.725582:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708596.725596:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d5dd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725606:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d5dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725614:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d5dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725627:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d5e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x62845dae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725634:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x62845dae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725640:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x62845dae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725678:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d5dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725685:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d5dd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725692:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d5dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725704:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.725709:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d5dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725729:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d5dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725739:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:3.0:1789708596.725741:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.725745:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d5dd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725750:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d5dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725760:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x62845dae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725766:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d5e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x62845dae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725771:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d5e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x62845dae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725776:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.725779:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d5e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x62845dae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725785:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d5e4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x62845dae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725816:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x62845dae (ffff9bee02bcb300) 00010000:00010000:3.0:1789708596.725819:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.725823:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d5e4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x62845dae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.725829:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d5e4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x62845dae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.725884:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+61:11386:x1876645357079808:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 383us (455us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708596.725890:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:2.0:1789708596.726710:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.726771:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357079936 00000100:00100000:0.0:1789708596.726776:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357079936 00000100:00100000:0.0:1789708596.726811:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:0.0:1789708596.726820:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+61:11386:x1876645357079936:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708596.726830:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708596.726844:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d5eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0f5 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.726868:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.726877:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.726885:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.726955:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d5eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0f5 expref: 63 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.726969:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0f5 expref: 62 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.726988:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708596.726990:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708596.726993:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1000, rc 0) 00000100:00100000:0.0:1789708596.727024:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+62:11386:x1876645357079936:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 206us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.727031:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:0.0:1789708596.727839:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.727876:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357080192 00000100:00100000:3.0:1789708596.727881:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357080192 00000100:00100000:3.0:1789708596.727908:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:3.0:1789708596.727913:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+62:11386:x1876645357080192:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708596.727966:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.727974:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.727979:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708596.728083:0:13656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1789708596.728090:0:13656:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167537828624ns, next at 168537826590ns, rc = 0 00000004:00010000:3.0:1789708596.728120:0:13656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e895dad5 reply state 00000000bbc59a3a transno 4294967393 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.728142:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.728149:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:3.0:1789708596.728152:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789708596.728154:0:13656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708596.728209:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+64:11386:x1876645357080192:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 294us (371us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789708596.728216:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:2.0:1789708596.728926:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.728972:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357080320 00000100:00100000:1.0:1789708596.728978:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357080320 00000100:00100000:1.0:1789708596.729009:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:1.0:1789708596.729018:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+64:11386:x1876645357080320:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708596.729035:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708596.729044:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d600 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e0fc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.729070:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d600 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0fc expref: 65 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.729080:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d600 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0fc expref: 65 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.729093:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:1.0:1789708596.729096:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708596.729098:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949400, rc 0) 00000100:00100000:1.0:1789708596.729126:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+65:11386:x1876645357080320:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 110us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.729132:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:2.0:1789708596.729995:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.730041:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357080448 00000100:00100000:1.0:1789708596.730047:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357080448 00000100:00100000:1.0:1789708596.730078:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:1.0:1789708596.730086:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357080448:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789708596.730209:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+9:2396:x1876645357080448:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 124us (215us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789708596.730218:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:0.0:1789708596.730942:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.730986:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357080704 00000100:00100000:1.0:1789708596.730991:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357080704 00000100:00100000:1.0:1789708596.731021:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:1.0:1789708596.731030:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2c798c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+65:11386:x1876645357080704:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789708596.731145:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2c798c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+66:11386:x1876645357080704:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 116us (202us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789708596.731152:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:2.0:1789708596.731767:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.731811:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357080960 00000100:00100000:3.0:1789708596.731815:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357080960 00000100:00100000:3.0:1789708596.731841:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:3.0:1789708596.731849:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+66:11386:x1876645357080960:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789708596.731900:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+66:11386:x1876645357080960:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.731907:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:2.0:1789708596.732577:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.732613:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357081088 00000100:00100000:0.0:1789708596.732617:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357081088 00000100:00100000:0.0:1789708596.732643:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:0.0:1789708596.732649:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+66:11386:x1876645357081088:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708596.732657:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708596.732668:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d607 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e103 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.732706:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d60e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.732726:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d60e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.732735:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d60e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708596.732757:0:8421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708596.732771:0:8421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d60e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.732794:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d607 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e103 expref: 68 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.732803:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d60e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e103 expref: 67 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.732809:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708596.732811:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789708596.732813:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0600, rc 0) 00000100:00100000:0.0:1789708596.732837:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+67:11386:x1876645357081088:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 188us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.732841:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:0.0:1789708596.733617:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.733647:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357081216 00000100:00100000:3.0:1789708596.733652:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357081216 00000100:00100000:3.0:1789708596.733675:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:3.0:1789708596.733680:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+9:2395:x1876645357081216:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708596.733687:0:9145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.733697:0:9145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d615 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e10a expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708596.733712:0:9145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacc934, blocks: 0x0 00010000:00010000:3.0:1789708596.733738:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=167s v=(0 0) 00010000:00010000:3.0:1789708596.733746:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708596.733752:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d615 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e10a expref: 10 pid: 9145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.733763:0:9145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d615 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e10a expref: 10 pid: 9145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.733771:0:9145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508c00, rc 0) 00000100:00100000:3.0:1789708596.733793:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+10:2395:x1876645357081216:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 113us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.733797:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:2.0:1789708596.734601:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.734636:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357081472 00000100:00100000:3.0:1789708596.734641:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357081472 00000100:00100000:3.0:1789708596.734684:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:3.0:1789708596.734692:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+67:11386:x1876645357081472:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789708596.734755:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+67:11386:x1876645357081472:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 64us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.734763:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:2.0:1789708596.735585:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.735620:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357081600 00000100:00100000:3.0:1789708596.735626:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357081600 00000100:00100000:3.0:1789708596.735656:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:3.0:1789708596.735664:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+10:11386:x1876645357081600:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708596.735671:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.735679:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e111 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.735707:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d615 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e10a expref: 11 pid: 9145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.735727:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708596.735730:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708596.735736:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 11 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.735766:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d615 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e10a expref: 11 pid: 9145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.735777:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d615 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e10a expref: 11 pid: 9145 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.735791:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8398:1876645365505536:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708596.735870:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.736529:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8398:1876645365505536:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708596.736549:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 11 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.736561:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509200, rc 0) 00000100:00100000:3.0:1789708596.736591:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+11:11386:x1876645357081600:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 929us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.736597:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:2.0:1789708596.736842:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.736876:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357081728 00000100:00100000:3.0:1789708596.736882:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357081728 00010000:00010000:3.0:1789708596.736900:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d615 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e10a expref: 11 pid: 9145 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.736927:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:3.0:1789708596.736933:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+11:2396:x1876645357081728:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708596.736942:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708596.736958:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d615 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e10a expref: 11 pid: 9145 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.736971:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d615 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e10a expref: 11 pid: 9145 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.736989:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d615 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e10a expref: 11 pid: 9145 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.737002:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708596.737005:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708596.737011:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 10 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.737019:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 10 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.737040:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 10 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.737058:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:8413:1876645365505664:192.168.201.52@tcp:105: 00000100:00100000:3.0:1789708596.737097:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.737906:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:8413:1876645365505664:192.168.201.52@tcp:105: 00010000:00010000:3.0:1789708596.737916:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708596.737942:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+10:2396:x1876645357081728:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 1009us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.737949:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:0.0:1789708596.738469:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708596.738521:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357081856 00000100:00100000:2.0:1789708596.738527:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357081856 00002000:00100000:2.0:1789708596.738557:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9bed0a24e300 x1876645357081856/t0(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:737/0 lens 504/0 e 0 to 0 dl 1789708607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789708596.738568:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bed0a24e300 with x1876645357081856 ext(0->12) 00002000:00010000:2.0:1789708596.738573:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bed0a24e300 00000100:00100000:2.0:1789708596.738597:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:2.0:1789708596.738606:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68824747-448a-469b-b2cf-e27bc037ded7+10:2396:x1876645357081856:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789708596.739166:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68824747-448a-469b-b2cf-e27bc037ded7+12:2396:x1876645357081856:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 560us (695us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789708596.739174:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00002000:00100000:2.0:1789708596.739181:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9bed0a24e300 x1876645357081856/t4294967309(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:737/0 lens 504/448 e 0 to 0 dl 1789708607 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789708596.739190:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bed0a24e300 with x1876645357081856 ext(0->12) 00002000:00010000:2.0:1789708596.739193:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bed0a24e300 00000100:00100000:2.0:1789708596.739875:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.739917:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357081984 00000100:00100000:0.0:1789708596.739921:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357081984 00000100:00100000:0.0:1789708596.739946:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:0.0:1789708596.739951:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+67:11386:x1876645357081984:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789708596.740984:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000004:00080000:3.0:1789708596.740996:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1789708596.741022:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708596.741032:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:0.0:1789708596.741034:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741041:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708596.741058:0:6463:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bed07e3ef00 refcount 2 committed 0 result 0 batchid 3 00010000:00010000:0.0:1789708596.741058:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1800 already unused, calling callback (ffffffffc1a211b0) 00000020:00080000:3.0:1789708596.741065:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee3e980100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bed07e3ed80 00010000:00010000:0.0:1789708596.741066:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708596.741071:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee3e980a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bed08a8e800 00010000:00010000:0.0:1789708596.741081:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741099:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bee08f48100) 00010000:00010000:0.0:1789708596.741103:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.741108:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741115:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d32f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708596.741131:0:6463:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bed07e3e480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789708596.741136:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee3e980500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bed07e3ee40 00010000:00010000:0.0:1789708596.741138:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708596.741140:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee3e980c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bee3fad9c00 00000020:00080000:2.0:1789708596.741150:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:0.0:1789708596.741150:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789708596.741157:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 0 00010000:00010000:0.0:1789708596.741159:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708596.741163:0:6463:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:0.0:1789708596.741163:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.741169:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.741172:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365505792:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789708596.741174:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741196:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bee08f48000) 00010000:00010000:0.0:1789708596.741203:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.741206:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789708596.741208:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1789708596.741212:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d3c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741226:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.741228:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708596.741235:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741239:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741242:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.741244:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741250:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.741282:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365505792 00010000:00010000:0.0:1789708596.741282:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48800) 00010000:00010000:0.0:1789708596.741288:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789708596.741289:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365505792 00010000:00010000:0.0:1789708596.741293:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741301:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47d440 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.741312:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365505920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789708596.741330:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1789708596.741334:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.741344:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365505792:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789708596.741345:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.741354:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708596.741361:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789708596.741367:0:8399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1789708596.741368:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.741375:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.741380:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365505920 00000100:00100000:1.0:1789708596.741383:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789708596.741384:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.741387:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365505920 00010000:00010000:2.0:1789708596.741388:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.741395:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365506048:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789708596.741401:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee08f48800) 00010000:00010000:0.0:1789708596.741407:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.741411:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741416:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d463 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.741418:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d3d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e062 expref: 11 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.741427:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1789708596.741429:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.741432:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1789708596.741436:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708596.741442:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00000100:00100000:3.0:1789708596.741443:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3615:x1876645365505920:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789708596.741445:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.741450:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741461:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789708596.741467:0:9145:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00000100:00100000:1.0:1789708596.741472:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365506048 00010000:00010000:0.0:1789708596.741477:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1200 already unused, calling callback (ffffffffc1a211b0) 00000100:00100000:1.0:1789708596.741479:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365506048 00010000:00010000:0.0:1789708596.741481:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.741486:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d3d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e062 expref: 11 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741489:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708596.741495:0:9145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aacc934, atime: 0x6aacc934, ctime: 0x6aacc934, blocks: 0x8 00010000:00010000:0.0:1789708596.741509:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.741512:0:9145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003bc17f1/0xf45f43947e47d62a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741512:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.741515:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.741517:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d3d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e062 expref: 11 pid: 8398 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.741519:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1789708596.741533:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d53c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.741535:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3701b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365506048:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789708596.741544:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=167s v=(0 0) 00010000:00010000:3.0:1789708596.741553:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1789708596.741554:0:8399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8399:1876645365506176:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708596.741557:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.741561:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003bc17f1/0xf45f43947e47d62a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741568:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741581:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741585:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.741586:0:9145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003bc17f1/0xf45f43947e47d62a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741588:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741602:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.741607:0:9145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003bc17f1/0xf45f43947e47d62a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.741612:0:8399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acf240 going to sleep for 11 seconds 00002000:00010000:1.0:1789708596.741616:0:8398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789708596.741625:0:8398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789708596 00010000:00010000:0.0:1789708596.741626:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:3.0:1789708596.741629:0:9145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003bc17f1/0xf45f43947e47d62a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.741633:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00002000:00010000:1.0:1789708596.741634:0:8398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:0.0:1789708596.741638:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708596.741642:0:8398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789708596 -> 1789708596 00002000:00010000:1.0:1789708596.741651:0:8398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789708596.741652:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d5f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.741670:0:9145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789708596.741692:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3701b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3615:x1876645365506048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (259us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789708596.741701:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789708596.741732:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+16:11386:x1876645357081984:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 1777us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.741741:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 132 00010000:00010000:2.0:1789708596.741744:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708596.741752:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003bc17f1/0xf45f43947e47d62a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.741766:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509c00 already unused, calling callback (ffffffffc0d676c0) 00000004:00080000:1.0:1789708596.741768:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bee3fac3480/2, rc 0, transno 4294967310 00010000:00010000:2.0:1789708596.741771:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003bc17f1/0xf45f43947e47d62a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.741777:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365506048:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789708596.741790:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003bc17f1/0xf45f43947e47d62a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708596.741802:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bed0a2cca80/2, rc 0, transno 4294967305 00000100:00100000:3.0:1789708596.741804:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3615:x1876645365505920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 365us (453us total) trans 4294967305 rc 0/0 00010000:00010000:2.0:1789708596.741808:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003bc17f1/0xf45f43947e47d62a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.741816:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789708596.741820:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365505920:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789708596.741828:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003bc17f1/0xf45f43947e47d62a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.741852:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708596.741854:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708596.741857:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708596.742701:0:8399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8399:1876645365506176:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708596.742732:0:8399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.742907:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.742936:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708596.742958:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357082112 00000100:00100000:2.0:1789708596.742965:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357082112 00000100:00100000:1.0:1789708596.742989:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357082240 00000100:00100000:1.0:1789708596.742995:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357082240 00000100:00100000:2.0:1789708596.743002:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1789708596.743013:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+13:2396:x1876645357082112:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789708596.743019:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d3d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e062 expref: 13 pid: 8398 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.743056:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:1.0:1789708596.743065:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+13:2396:x1876645357082240:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708596.743077:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708596.743083:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d3d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e062 expref: 13 pid: 8398 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.743094:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d3d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e062 expref: 13 pid: 8398 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.743107:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47d3d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e062 expref: 13 pid: 8398 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.743116:0:7427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708596.743119:0:7427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708596.743123:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.743130:0:7427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.743170:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708596.743193:0:8399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.743203:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708596.743212:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.743216:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+12:2396:x1876645357082240:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 151us (276us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708596.743226:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.743231:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 75 00010000:00010000:2.0:1789708596.743249:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708596.743285:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708596.743292:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.743302:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708596.743311:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.743321:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.743332:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.743337:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47d623 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.743348:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708596.743349:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708596.743351:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708596.743495:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3618:x1876645365505792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2155us (2268us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789708596.743503:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:1.0:1789708596.743556:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bee3fac1180/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789708596.743564:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365505792:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789708596.743980:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789708596.743987:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1789708596.744068:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+6:2396:x1876645357082112:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 1057us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708596.744075:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1789708596.744968:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.745010:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357082496 00000100:00100000:0.0:1789708596.745016:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357082496 00000100:00100000:0.0:1789708596.745046:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:0.0:1789708596.745053:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+16:11386:x1876645357082496:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789708596.745093:0:13656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708596.745110:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d60e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e103 expref: 16 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.745126:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708596.745129:0:13656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708596.745150:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.745159:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.745165:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708596.745256:0:13656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c232774 reply state 00000000faf1ba11 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.745288:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.745296:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708596.745299:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708596.745303:0:13656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708596.745366:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+17:11386:x1876645357082496:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 314us (400us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789708596.745371:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:0.0:1789708596.746127:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.746167:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357082624 00000100:00100000:1.0:1789708596.746174:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357082624 00000100:00100000:1.0:1789708596.746210:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:1.0:1789708596.746217:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357082624:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789708596.746324:0:8397:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789708596.746328:0:8397:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789708596 -> 1789708596 00002000:00010000:1.0:1789708596.746331:0:8397:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789708596 00002000:00010000:1.0:1789708596.746333:0:8397:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789708596 -> 1789708596 00002000:00010000:1.0:1789708596.746335:0:8397:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789708596.746368:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357082624:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 150us (241us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789708596.746376:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:2.0:1789708596.747133:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.747193:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357082880 00000100:00100000:1.0:1789708596.747199:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357082880 00000100:00100000:1.0:1789708596.747231:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:1.0:1789708596.747239:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+17:11386:x1876645357082880:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789708596.747299:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.747324:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0f5 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.747332:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.747361:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0f5 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.747374:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0f5 expref: 17 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.747386:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11041c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365506304:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708596.747439:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708596.748105:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11041c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365506304:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708596.748118:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.748251:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.748292:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357083008 00000100:00100000:0.0:1789708596.748296:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357083008 00010000:00010000:0.0:1789708596.748319:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0f5 expref: 18 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.748340:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:0.0:1789708596.748346:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08575850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+18:2395:x1876645357083008:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708596.748354:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708596.748358:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0f5 expref: 18 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.748365:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0f5 expref: 18 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.748386:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d5f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0f5 expref: 18 pid: 6483 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.748394:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708596.748397:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.748402:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.748406:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.748421:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708596.748438:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.748446:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08575850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+17:2395:x1876645357083008:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 99us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708596.748451:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.748458:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00010000:00010000:1.0:1789708596.748486:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.748495:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.748508:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.748514:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708596.748518:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.748526:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.748535:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:1.0:1789708596.748539:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789708596.748542:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.748549:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d638 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.748584:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+16:11386:x1876645357082880:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 1347us (1453us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789708596.748590:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:2.0:1789708596.749177:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.749197:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357083136 00000100:00100000:3.0:1789708596.749202:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357083136 00000100:00100000:3.0:1789708596.749231:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:3.0:1789708596.749237:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357083136:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789708596.749256:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.749296:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.749311:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708596.749314:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789708596.749317:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.749333:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.749341:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 7 pid: 8398 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.749349:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8398:1876645365506432:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708596.749379:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708596.749984:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8398:1876645365506432:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708596.749996:0:8398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.750210:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.750241:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357083264 00000100:00100000:1.0:1789708596.750245:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357083264 00010000:00010000:1.0:1789708596.750281:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 8 pid: 8398 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.750316:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:1.0:1789708596.750326:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357083264:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708596.750335:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708596.750350:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 8 pid: 8398 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.750357:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 8 pid: 8398 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.750367:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47d61c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e111 expref: 8 pid: 8398 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.750375:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708596.750377:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708596.750380:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.750385:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.750400:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708596.750410:0:8398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.750418:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.750425:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357083264:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 99us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.750435:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 77 00010000:00010000:3.0:1789708596.750438:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.750447:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.750463:0:8398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.750467:0:8398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708596.750470:0:8398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.750475:0:8398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.750484:0:8398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.750488:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47d63f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.750524:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357083136:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 1286us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.750567:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:2.0:1789708596.751035:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.751057:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357083520 00000100:00100000:3.0:1789708596.751063:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357083520 00000100:00100000:3.0:1789708596.751092:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:3.0:1789708596.751099:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+16:11386:x1876645357083520:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789708596.751132:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.751144:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0bd expref: 16 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.751149:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.751162:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0bd expref: 16 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.751168:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0bd expref: 16 pid: 8421 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.751175:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365506560:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708596.751204:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857180 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.751896:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365506560:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708596.751908:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.752098:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.752140:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357083648 00000100:00100000:0.0:1789708596.752146:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357083648 00010000:00010000:0.0:1789708596.752164:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0bd expref: 17 pid: 8421 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.752192:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:0.0:1789708596.752200:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+17:2396:x1876645357083648:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708596.752209:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708596.752214:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0bd expref: 17 pid: 8421 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.752235:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0bd expref: 17 pid: 8421 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.752247:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d535 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0bd expref: 17 pid: 8421 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.752273:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:0.0:1789708596.752278:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d597 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e0 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.752286:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.752292:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.752298:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.752315:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708596.752328:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.752337:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.752345:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+16:2396:x1876645357083648:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 145us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.752353:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 78 00010000:00010000:3.0:1789708596.752540:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.752552:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d600 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0fc expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.752575:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.752592:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d600 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0fc expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.752601:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d600 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0fc expref: 16 pid: 6485 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.752611:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365506688:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708596.752647:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857840 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.753455:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365506688:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708596.753472:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.753497:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708596.753544:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357083776 00000100:00100000:1.0:1789708596.753550:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357083776 00010000:00010000:1.0:1789708596.753569:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d600 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0fc expref: 17 pid: 6485 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.753590:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:1.0:1789708596.753598:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+17:2395:x1876645357083776:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708596.753607:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708596.753611:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d600 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0fc expref: 17 pid: 6485 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.753620:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d600 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0fc expref: 17 pid: 6485 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.753633:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d600 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0fc expref: 17 pid: 6485 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.753645:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:1.0:1789708596.753649:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.753656:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.753676:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.753694:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708596.753704:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.753712:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.753747:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+16:2395:x1876645357083776:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 149us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708596.753763:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00000001:00080000:3.0:1789708596.753776:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000001:00080000:3.0:1789708596.753903:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967397 00000001:00080000:3.0:1789708596.753940:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967398 00000100:00100000:3.0:1789708596.754006:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6512:1876645365506816:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789708596.754049:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708596.754071:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed088570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708596.754082:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365506816 00000100:00100000:0.0:1789708596.754087:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365506816 00000100:00100000:0.0:1789708596.754114:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789708596.754118:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1876645365506816:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789708596.754181:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1876645365506816:12345-0@lo:1000:mdt00_003.0 Request processed in 61us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.754187:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789708596.754202:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789708596.754208:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1789708596.754229:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bee3fac3480, transno 4294967310 00000100:00100000:3.0:1789708596.754246:0:6512:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9bee3fac1180 x1876645365505792/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789708612 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708596.754256:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6512:1876645365506816:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789708596.754383:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967399 00000100:00100000:3.0:1789708596.754417:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6512:1876645365506944:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789708596.754449:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708596.754474:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed088576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708596.754501:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365506944 00000100:00100000:0.0:1789708596.754506:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365506944 00000100:00100000:0.0:1789708596.754534:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789708596.754541:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1876645365506944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789708596.754628:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6512:x1876645365506944:12345-0@lo:1000:mdt00_003.0 Request processed in 87us (177us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789708596.754636:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789708596.754648:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6512:1876645365506944:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789708596.754671:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754679:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754684:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754689:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.754693:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754699:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754708:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:3.0:1789708596.754711:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708596.754734:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754740:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d64d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754758:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754764:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754769:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754773:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.754776:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754781:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754788:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.754791:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708596.754795:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d597 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e0 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754804:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d597 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e0 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754812:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d597 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e0 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.754842:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d597 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e0 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.754852:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365507072:192.168.201.52@tcp:105: 00000100:00100000:3.0:1789708596.754892:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee182cc000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.755665:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365507072:192.168.201.52@tcp:105: 00010000:00010000:3.0:1789708596.755678:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755685:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d590 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755704:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d654 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755797:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d654 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755807:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d654 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755816:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d654 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755822:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d654 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755829:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d654 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.755837:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:3.0:1789708596.755846:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.755885:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d654 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755893:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d654 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.755893:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357083904 00000100:00100000:0.0:1789708596.755899:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357083904 00010000:00010000:3.0:1789708596.755906:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.755910:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708596.755914:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d654 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755920:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d654 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755933:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755939:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.755942:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00010000:00010000:3.0:1789708596.755951:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.755956:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+20:11385:x1876645357083904:12345-192.168.201.52@tcp:49:lfs.0 00010000:00010000:3.0:1789708596.755962:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708596.755966:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755972:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.755989:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.755992:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789708596.755995:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.756001:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d646 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708596.756032:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+20:11385:x1876645357083904:12345-192.168.201.52@tcp:49:lfs.0 Request processed in 80us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.756040:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:3.0:1789708596.756112:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+19:11386:x1876645357083520:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 5013us (5076us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789708596.756121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 135 00000020:00080000:3.0:1789708596.756125:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789708596.756169:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708596.756175:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708596.756652:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789708596.756665:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789708596.756954:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708596.756973:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.756979:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357084288 00000100:00100000:3.0:1789708596.756985:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357084288 00000100:00100000:1.0:1789708596.757004:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357084416 00000100:00100000:1.0:1789708596.757008:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357084416 00000100:00100000:3.0:1789708596.757024:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:3.0:1789708596.757037:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+20:11385:x1876645357084288:12345-192.168.201.52@tcp:58:lfs.0 00000100:00100000:1.0:1789708596.757041:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1789708596.757051:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+20:11386:x1876645357084416:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1789708596.757132:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789708596.757177:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+21:11385:x1876645357084288:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 145us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708596.757186:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 136 00000004:00080000:1.0:1789708596.757209:0:14125:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789708596.757235:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967401 00010000:00010000:1.0:1789708596.757257:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.757296:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.757305:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.757313:0:14125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.757319:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.757324:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708596.757345:0:14125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708596.757374:0:10362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708596.757381:0:10362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.757389:0:10362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708596.757393:0:10362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.757400:0:10362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708596.757406:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+21:11386:x1876645357084416:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 354us (427us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789708596.757417:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000020:00080000:1.0:1789708596.757424:0:14125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789708596.757433:0:10362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708596.757437:0:10362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789708596.757441:0:10362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.757447:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d65b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.757458:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708596.757460:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708596.757462:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708596.767250:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.767306:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357084544 00000100:00100000:3.0:1789708596.767316:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357084544 00000100:00100000:3.0:1789708596.767371:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:3.0:1789708596.767383:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+21:11388:x1876645357084544:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708596.767406:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708596.767427:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d662 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e118 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767510:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d669 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767524:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d669 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767536:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d669 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767551:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d670 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767567:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d670 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767574:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d670 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767645:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767655:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d9 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767664:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767696:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d9 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.767732:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d9 expref: 22 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.767756:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365507200:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708596.767841:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee182cc240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708596.768579:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365507200:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708596.768596:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708596.768976:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708596.769023:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357084800 00000100:00100000:0.0:1789708596.769028:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357084800 00000100:00100000:0.0:1789708596.769056:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1789708596.769061:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+23:6618:x1876645357084800:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789708596.769194:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+24:6618:x1876645357084800:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 132us (219us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789708596.769199:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:2.0:1789708596.769830:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708596.769868:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357084928 00000100:00100000:3.0:1789708596.769873:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357084928 00010000:00010000:3.0:1789708596.769895:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d9 expref: 24 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.769927:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:3.0:1789708596.769934:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+24:2398:x1876645357084928:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708596.769946:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708596.769952:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d9 expref: 24 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.769964:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d9 expref: 24 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.769982:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d582 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0d9 expref: 24 pid: 6512 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.770006:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708596.770009:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.770014:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.770019:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708596.770037:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708596.770062:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+23:2398:x1876645357084928:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 129us (234us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708596.770066:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708596.770069:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00010000:00010000:0.0:1789708596.770079:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708596.770111:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789708596.770116:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708596.770131:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770154:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770164:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d669 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770171:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d669 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770177:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d669 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770182:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.770186:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d669 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770194:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d669 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770203:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:0.0:1789708596.770206:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.770210:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d669 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770216:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d669 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770227:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d670 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770233:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d670 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770244:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d670 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770250:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708596.770252:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d670 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770296:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d670 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770307:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bee03fe7400) 00010000:00010000:0.0:1789708596.770310:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708596.770314:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d670 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770320:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d670 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770358:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d662 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e118 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770371:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e118 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708596.770378:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:0.0:1789708596.770380:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708596.770383:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508c00, rc 0) 00000100:00100000:0.0:1789708596.770412:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+22:11388:x1876645357084544:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 3032us (3170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708596.770428:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 137 00010000:00010000:3.0:1789708596.842491:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789708597.064885:0:14266:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708597.064892:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708597.064934:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789708597.064947:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789708597.094412:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365507328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708597.094475:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708597.094508:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365507328 00000100:00100000:2.0:1789708597.094516:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365507328 00000100:00100000:2.0:1789708597.094555:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789708597.094564:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365507328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789708597.094592:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789708597.094635:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365507328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708597.094641:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789708597.094674:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365507328:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789708597.798475:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708597.798483:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708597.798519:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789708597.798531:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789708597.798646:0:13754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11043800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365507456:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789708597.798747:0:13754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0872fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708597.799817:0:13754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11043800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365507456:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708597.799976:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708597.800026:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357085056 00000100:00100000:0.0:1789708597.800033:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357085056 00000100:00100000:0.0:1789708597.800093:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:0.0:1789708597.800113:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+22:11401:x1876645357085056:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1789708597.800124:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:0.0:1789708597.800144:0:6483:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708597.800219:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+22:11401:x1876645357085056:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 119us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708597.800227:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:2.0:1789708597.801289:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708597.801331:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357085312 00000100:00100000:0.0:1789708597.801337:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357085312 00000100:00100000:0.0:1789708597.801374:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:0.0:1789708597.801380:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+22:11401:x1876645357085312:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708597.801391:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708597.801410:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d67e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e11f expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708597.801494:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d685 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708597.801508:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708597.801521:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708597.801533:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789708597.801620:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d67e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e11f expref: 25 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708597.801633:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d685 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e11f expref: 24 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708597.801640:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:0.0:1789708597.801643:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708597.801647:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0e00, rc 0) 00000100:00100000:0.0:1789708597.801681:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+24:11401:x1876645357085312:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 301us (393us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1789708597.801689:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:2.0:1789708597.802658:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708597.802723:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357085440 00000100:00100000:1.0:1789708597.802729:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357085440 00000100:00100000:1.0:1789708597.802771:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:1.0:1789708597.802780:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+24:2397:x1876645357085440:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708597.802790:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708597.802806:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d685 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e11f expref: 24 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708597.802819:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708597.802823:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708597.802854:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+23:2397:x1876645357085440:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708597.802872:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789708597.803142:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708597.803178:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357085696 00000100:00100000:1.0:1789708597.803183:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357085696 00000100:00100000:1.0:1789708597.803212:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:1.0:1789708597.803217:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+23:11401:x1876645357085696:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789708597.803249:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d693 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708597.803274:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708597.803281:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708597.803364:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708597.803369:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d693 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708597.803373:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d693 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708597.803376:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708597.803380:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d693 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708597.803387:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d693 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708597.803395:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708597.803404:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789708597.803409:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d693 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708597.803415:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d693 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708597.803489:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+24:11401:x1876645357085696:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 269us (347us total) trans 4294967405 rc 0/0 00000100:00100000:1.0:1789708597.803497:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 140 00000040:00080000:3.0:1789708597.803563:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708597.803569:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708597.804143:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789708597.804158:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789708597.804291:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708597.804316:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357085952 00000100:00100000:1.0:1789708597.804322:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357085952 00000100:00100000:1.0:1789708597.804347:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:1.0:1789708597.804352:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+24:11401:x1876645357085952:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789708597.804459:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+25:11401:x1876645357085952:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 106us (169us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789708597.804467:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00010000:00010000:2.0:1789708597.863723:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789708598.354145:0:14317:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708598.354154:0:14317:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708598.354194:0:14317:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789708598.354208:0:14317:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789708598.415037:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708598.415078:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357086208 00000100:00100000:3.0:1789708598.415087:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357086208 00000100:00100000:3.0:1789708598.415149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:3.0:1789708598.415159:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+25:11421:x1876645357086208:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708598.415185:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708598.415203:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d69a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e126 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.415308:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d6a1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.415320:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.415330:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708598.415339:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789708598.415447:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d69a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e126 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.415465:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e126 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.415473:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708598.415475:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789708598.415478:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509c00, rc 0) 00000100:00100000:3.0:1789708598.415524:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+27:11421:x1876645357086208:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 367us (493us total) trans 4294967407 rc 0/0 00000100:00100000:3.0:1789708598.415540:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:0.0:1789708598.416638:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708598.416678:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357086336 00000100:00100000:3.0:1789708598.416695:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357086336 00000100:00100000:3.0:1789708598.416741:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:3.0:1789708598.416751:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+27:11421:x1876645357086336:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1789708598.416794:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.416804:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.416812:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.416840:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.416847:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.416854:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.416861:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708598.416865:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.416873:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.416885:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:3.0:1789708598.416895:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708598.416900:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708598.416907:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708598.416960:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+27:11421:x1876645357086336:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 211us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708598.416970:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:2.0:1789708598.449723:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708598.449838:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357086464 00000100:00100000:0.0:1789708598.449848:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357086464 00000100:00080000:3.0:1789708598.449909:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708598.449934:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:0.0:1789708598.449941:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+6:2398:x1876645357086464:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1789708598.449955:0:10054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708598.449971:0:10054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47d6b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e12d expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708598.449995:0:10054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aacc934, atime: 0x6aacc934, ctime: 0x6aacc934, blocks: 0x8 00010000:00010000:0.0:1789708598.450015:0:10054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=169s v=(0 0) 00010000:00010000:0.0:1789708598.450020:0:10054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708598.450027:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47d6b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e12d expref: 7 pid: 10054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708598.450057:0:10054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47d6b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e12d expref: 7 pid: 10054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708598.450068:0:10054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0000, rc 0) 00000100:00100000:0.0:1789708598.450128:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:68824747-448a-469b-b2cf-e27bc037ded7+7:2398:x1876645357086464:12345-192.168.201.52@tcp:101:cat.0 Request processed in 182us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708598.450135:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:0.0:1789708598.451463:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708598.451508:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357086592 00000100:00100000:3.0:1789708598.451515:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357086592 00002000:00100000:3.0:1789708598.451553:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9bed0a24f800 x1876645357086592/t0(0) o3->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:739/0 lens 488/0 e 0 to 0 dl 1789708609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708598.451564:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bed0a24f800 with x1876645357086592 ext(0->4095) 00002000:00010000:3.0:1789708598.451568:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bed0a24f800 00000100:00100000:3.0:1789708598.451590:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1789708598.451598:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:2397:x1876645357086592:12345-192.168.201.52@tcp:3:cat.0 00000100:00100000:3.0:1789708598.451743:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:2397:x1876645357086592:12345-192.168.201.52@tcp:3:cat.0 Request processed in 146us (280us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789708598.451752:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00002000:00100000:3.0:1789708598.451759:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9bed0a24f800 x1876645357086592/t0(0) o3->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:739/0 lens 488/4536 e 0 to 0 dl 1789708609 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708598.451768:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bed0a24f800 with x1876645357086592 ext(0->4095) 00002000:00010000:3.0:1789708598.451771:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bed0a24f800 00010000:00010000:3.0:1789708598.886402:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708599.009167:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708599.009208:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708599.009244:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708599.009245:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357086720 00000100:00100000:3.0:1789708599.009257:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357086720 00000100:00100000:1.0:1789708599.009317:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357086976 00000100:00100000:1.0:1789708599.009322:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357086976 00000100:00100000:3.0:1789708599.009326:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 343 00000100:00100000:3.0:1789708599.009338:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:2396:x1876645357086720:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708599.009367:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:1.0:1789708599.009375:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+9:2396:x1876645357086976:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708599.009408:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:2396:x1876645357086720:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708599.009414:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+9:2396:x1876645357086976:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 39us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708599.009425:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 343 00000100:00100000:1.0:1789708599.009425:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00080000:1.0:1789708599.009456:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708599.009464:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708599.009496:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357087232 00000100:00100000:1.0:1789708599.009501:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357087232 00000100:00100000:1.0:1789708599.009540:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357086848 00000100:00100000:1.0:1789708599.009554:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357086848 00000100:00100000:3.0:1789708599.009660:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:2.0:1789708599.009666:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708599.009688:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2396:x1876645357087232:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708599.009706:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357087104 00000100:00100000:2.0:1789708599.009717:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357087104 00000100:00100000:3.0:1789708599.009733:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2396:x1876645357087232:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 61us (487us total) trans 0 rc 0/0 00000100:00080000:0.0:1789708599.010817:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789708599.010821:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789708599.010919:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:1.0:1789708599.010928:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:2396:x1876645357086848:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708599.010964:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:1.0:1789708599.010970:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:2396:x1876645357086848:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 40us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708599.010978:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:3.0:1789708599.010988:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:3.0:1789708599.010998:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2396:x1876645357087104:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708599.011027:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2396:x1876645357087104:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 32us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708599.011033:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 129 00010000:00010000:0.0:1789708599.910448:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708600.167871:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365507584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789708600.167980:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708600.168037:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365507584 00000100:00100000:1.0:1789708600.168053:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365507584 00000100:00100000:1.0:1789708600.168138:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789708600.168156:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365507584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708600.168192:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789708600.168538:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365507584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 389us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708600.168545:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789708600.168621:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365507584:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1789708600.169060:0:9480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789708600.169074:0:9480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1789708600.237441:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708600.237532:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357087360 00000100:00100000:0.0:1789708600.237546:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357087360 00000100:00080000:1.0:1789708600.237621:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708600.237643:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:0.0:1789708600.237668:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+27:11066:x1876645357087360:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789708600.237797:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+27:11066:x1876645357087360:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 Request processed in 144us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708600.237806:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:2.0:1789708600.238589:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708600.238629:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357087488 00000100:00100000:1.0:1789708600.238634:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357087488 00000100:00100000:1.0:1789708600.238676:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:1.0:1789708600.238682:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:11066:x1876645357087488:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789708600.238731:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:11066:x1876645357087488:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708600.238742:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:2.0:1789708600.239456:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708600.239521:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357087744 00000100:00100000:0.0:1789708600.239525:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357087744 00000100:00100000:0.0:1789708600.239552:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:0.0:1789708600.239559:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+27:11066:x1876645357087744:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789708600.239766:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+28:11066:x1876645357087744:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 207us (311us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789708600.239790:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000001:02000400:0.0:1789708600.900604:0:14513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:16:40 (1789708600) 00010000:00010000:3.0:1789708600.934349:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708601.190466:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365508096:0@lo:400:kworker.0 00000100:00100000:2.0:1789708601.190507:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365508352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708601.190514:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365508480:0@lo:400:kworker.0 00000100:00100000:1.0:1789708601.190583:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708601.190588:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708601.190593:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708601.190598:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365508224:0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.190648:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708601.190667:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365507712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708601.190677:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365508864:0@lo:400:kworker.0 00000100:00100000:2.0:1789708601.190680:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365508992:0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.190693:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365508736:0@lo:400:kworker.0 00000100:00100000:1.0:1789708601.190703:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708601.190706:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708601.190731:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708601.190731:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365508480 00000100:00100000:2.0:1789708601.190740:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365508480 00000100:00100000:1.0:1789708601.190740:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365507968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708601.190740:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876645365509376:0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.190756:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365509248:0@lo:400:kworker.0 00000100:00100000:1.0:1789708601.190778:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708601.190778:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708601.190790:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708601.190798:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365508736 00000100:00100000:2.0:1789708601.190802:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365508736 00000100:00100000:1.0:1789708601.190819:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365507840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708601.190819:0:13774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365508352 00000100:00100000:0.0:1789708601.190824:0:13774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365508352 00000100:00100000:2.0:1789708601.190827:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789708601.190829:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee10fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365509760:0@lo:400:kworker.0 00000100:00100000:2.0:1789708601.190840:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365508480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.190865:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708601.190865:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708601.190877:0:13774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365507712 00000100:00100000:0.0:1789708601.190883:0:13774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365507712 00000100:00100000:1.0:1789708601.190889:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365508608:0@lo:400:kworker.0 00000100:00100000:0.0:1789708601.190907:0:13774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365507968 00000100:00100000:0.0:1789708601.190912:0:13774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365507968 00000100:00100000:2.0:1789708601.190913:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365508480:12345-0@lo:400:kworker.0 Request processed in 72us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708601.190914:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365508224 00000100:00100000:3.0:1789708601.190919:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365508224 00000100:00100000:1.0:1789708601.190923:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708601.190927:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789708601.190930:0:13774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365507840 00000100:00100000:0.0:1789708601.190935:0:13774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365507840 00000100:00100000:2.0:1789708601.190954:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789708601.190955:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365509120:0@lo:400:kworker.0 00000100:00100000:0.0:1789708601.190961:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789708601.190963:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365508864 00000100:00100000:2.0:1789708601.190967:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365508736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.190968:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365508864 00000100:00100000:0.0:1789708601.190974:0:13774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365508352:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708601.190980:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708601.191002:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee10fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365509632:0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.191003:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365509376 00000100:00100000:3.0:1789708601.191009:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365509376 00000100:00100000:2.0:1789708601.191012:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365508736:12345-0@lo:400:kworker.0 Request processed in 49us (283us total) trans 0 rc 0/0 00002000:00000024:0.0:1789708601.191016:0:13774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789708601.191021:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789708601.191036:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708601.191044:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365508608 00000100:00100000:2.0:1789708601.191048:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789708601.191049:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365508608 00000100:00100000:0.0:1789708601.191057:0:13774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365508352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708601.191058:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365507712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708601.191068:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789708601.191073:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789708601.191078:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365508224:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789708601.191086:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789708601.191089:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365508096 00000100:00100000:0.0:1789708601.191093:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789708601.191094:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365508096 00000100:00100000:0.0:1789708601.191102:0:13774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365507968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789708601.191116:0:13774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789708601.191120:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365508224:12345-0@lo:400:kworker.0 Request processed in 44us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708601.191121:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365507712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708601.191130:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789708601.191135:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789708601.191142:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3615:x1876645365508096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708601.191143:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789708601.191156:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789708601.191164:0:13774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365507968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708601.191165:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789708601.191166:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365508864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708601.191176:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365507840:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708601.191180:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789708601.191181:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3615:x1876645365508096:12345-0@lo:400:kworker.0 Request processed in 40us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708601.191188:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00002000:00000024:2.0:1789708601.191192:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708601.191210:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365508864:12345-0@lo:400:kworker.0 Request processed in 47us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708601.191216:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789708601.191220:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365507840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708601.191227:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789708601.191227:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365509248 00000100:00100000:3.0:1789708601.191232:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789708601.191233:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365509248 00000100:00100000:3.0:1789708601.191242:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876645365509376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708601.191243:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365509760 00000100:00100000:0.0:1789708601.191248:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365509760 00000100:00100000:2.0:1789708601.191287:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789708601.191291:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365509120 00000100:00100000:1.0:1789708601.191295:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365509632 00000100:00100000:0.0:1789708601.191296:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365509120 00000100:00100000:2.0:1789708601.191298:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365508608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708601.191300:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365509632 00000100:00100000:3.0:1789708601.191302:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876645365509376:12345-0@lo:400:kworker.0 Request processed in 63us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708601.191315:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708601.191316:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789708601.191327:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3616:x1876645365509248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708601.191328:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789708601.191336:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365508608:12345-0@lo:400:kworker.0 Request processed in 41us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708601.191338:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365509760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.191352:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789708601.191352:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789708601.191362:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365509120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708601.191371:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3616:x1876645365509248:12345-0@lo:400:kworker.0 Request processed in 46us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708601.191376:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365509760:12345-0@lo:400:kworker.0 Request processed in 42us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708601.191382:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708601.191382:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789708601.191389:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789708601.191405:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789708601.191410:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365509120:12345-0@lo:400:kworker.0 Request processed in 48us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708601.191410:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee10fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365509504:0@lo:400:kworker.0 00000100:00100000:0.0:1789708601.191418:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365509632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.191422:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789708601.191442:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708601.191457:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365508608:0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.191460:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365508992 00000100:00100000:3.0:1789708601.191465:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365508992 00000100:00100000:0.0:1789708601.191467:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365509632:12345-0@lo:400:kworker.0 Request processed in 52us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708601.191475:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789708601.191476:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365509120:0@lo:400:kworker.0 00000100:00100000:2.0:1789708601.191484:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365508352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708601.191492:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee10fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365509632:0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.191496:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365509504 00000100:00100000:3.0:1789708601.191501:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365509504 00000100:00100000:0.0:1789708601.191504:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789708601.191506:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365508096:0@lo:400:kworker.0 00000100:00100000:0.0:1789708601.191514:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365508992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708601.191519:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789708601.191525:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000100:00100000:3.0:1789708601.191529:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789708601.191532:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365508864:0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.191540:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365509504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708601.191547:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876645365509376:0@lo:400:kworker.0 00000004:00080000:1.0:1789708601.191563:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bed09b82a00, transno 4294967302 00000100:00100000:0.0:1789708601.191563:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365508992:12345-0@lo:400:kworker.0 Request processed in 49us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708601.191566:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365508480:0@lo:400:kworker.0 00000100:00100000:0.0:1789708601.191576:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000004:00080000:1.0:1789708601.191577:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000100:00100000:3.0:1789708601.191583:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365509504:12345-0@lo:400:kworker.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708601.191589:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1789708601.191601:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1789708601.191603:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bed0a2cca80, transno 4294967305 00000100:00080000:0.0:1789708601.191607:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789708601.191611:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789708601.191616:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708601.191617:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365507712:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789708601.191620:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086f8a80 x1876645365508992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708601.191622:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365508224:0@lo:400:kworker.0 00000100:00100000:2.0:1789708601.191632:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365508992:0@lo:400:kworker.0 00000100:00100000:1.0:1789708601.191656:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365507968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708601.191657:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365508736:0@lo:400:kworker.0 00010000:00080000:2.0:1789708601.191668:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee10fa1180 x1876645365509504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708601.191677:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee10fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365509504:0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.191681:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365509248:0@lo:400:kworker.0 00000100:00100000:1.0:1789708601.191685:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365507840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708601.191694:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee10fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365509760:0@lo:400:kworker.0 00000100:00100000:3.0:1789708601.429940:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708601.430024:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357088000 00000100:00100000:0.0:1789708601.430038:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357088000 00000100:00100000:0.0:1789708601.430134:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:0.0:1789708601.430147:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+28:12137:x1876645357088000:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708601.430181:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708601.430209:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d6bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e134 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430333:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d6c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430348:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d6c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430359:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d6c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430371:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d6cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430375:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d6cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430380:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d6cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430505:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d6d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430511:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430515:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708601.430531:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789708601.430608:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d6c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430614:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d6c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430619:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d6c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430623:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708601.430627:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d6c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430646:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d6c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430656:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bee2c76c700) 00010000:00010000:0.0:1789708601.430659:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708601.430663:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d6c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430668:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d6c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430679:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d6cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430683:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d6cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430693:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d6cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430696:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708601.430698:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d6cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430702:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d6cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430706:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bee08f48100) 00010000:00010000:0.0:1789708601.430707:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708601.430709:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d6cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.430712:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d6cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.431560:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d6bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e134 expref: 31 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.431580:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e134 expref: 30 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.431589:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:0.0:1789708601.431592:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708601.431595:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0600, rc 0) 00000100:00100000:0.0:1789708601.431686:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+30:12137:x1876645357088000:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1541us (1765us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789708601.431708:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:2.0:1789708601.433360:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708601.433404:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708601.433411:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357088128 00000100:00100000:0.0:1789708601.433422:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357088128 00000100:00100000:3.0:1789708601.433455:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357088256 00000100:00100000:3.0:1789708601.433461:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357088256 00000100:00100000:0.0:1789708601.433496:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1789708601.433510:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+31:2398:x1876645357088128:12345-192.168.201.52@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789708601.433515:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:3.0:1789708601.433531:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+31:12137:x1876645357088256:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00010000:00010000:0.0:1789708601.433532:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708601.433560:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d6d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e134 expref: 31 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708601.433580:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:0.0:1789708601.433586:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708601.433647:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+30:2398:x1876645357088128:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 141us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708601.433650:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+30:12137:x1876645357088256:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 122us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708601.433663:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1789708601.433666:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:2.0:1789708601.434710:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708601.434764:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357088384 00000100:00100000:0.0:1789708601.434781:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357088384 00000100:00100000:0.0:1789708601.434842:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00080000:1.0:1789708601.434855:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708601.434857:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:12137:x1876645357088384:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789708601.434931:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+5:12137:x1876645357088384:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708601.434939:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 147 00000040:00080000:0.0:1789708601.767834:0:13756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789708601.894491:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708601.894499:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708601.894957:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789708601.894974:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789708601.959365:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708602.124861:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.124905:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357088512 00000100:00100000:3.0:1789708602.124914:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357088512 00000100:00080000:1.0:1789708602.124972:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708602.124988:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:3.0:1789708602.124999:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+29:12179:x1876645357088512:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708602.125016:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708602.125033:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d6e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e13b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125081:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125091:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125098:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125111:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d6ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125118:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125125:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125161:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125171:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125176:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125180:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.125182:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125187:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125196:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48c00) 00010000:00010000:3.0:1789708602.125199:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.125203:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125209:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d6e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125220:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125226:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d6ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125232:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d6ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125237:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.125245:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d6ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125249:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d6ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125254:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bee03fe7e00) 00010000:00010000:3.0:1789708602.125255:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.125280:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d6ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125288:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d6ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125316:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d6e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e13b expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125323:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48c00) 00010000:00010000:3.0:1789708602.125325:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.125328:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d6e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e13b expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.125336:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509e00, rc 0) 00000100:00100000:3.0:1789708602.125392:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+29:12179:x1876645357088512:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 396us (539us total) trans 0 rc 301/301 00000100:00100000:3.0:1789708602.125400:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:2.0:1789708602.127388:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.127426:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357088768 00000100:00100000:3.0:1789708602.127433:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357088768 00000100:00100000:3.0:1789708602.127477:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 149 00000100:00100000:3.0:1789708602.127487:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+29:12179:x1876645357088768:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:3.0:1789708602.127532:0:13656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708602.127549:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d073 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df74 expref: 29 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.127563:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee08f48c00) 00010000:00010000:3.0:1789708602.127572:0:13656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708602.127629:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d6f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.127640:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.127649:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.127665:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.127672:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.127680:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128189:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128199:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128207:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708602.128229:0:13656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce558c4d reply state 000000005bc7e64b transno 4294967410 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128240:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128246:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee03fe7500) 00010000:00010000:3.0:1789708602.128249:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708602.128252:0:13656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789708602.128256:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789708602.128287:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128295:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d6f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128304:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128311:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.128315:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128322:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d6f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128331:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee03fe7300) 00010000:00010000:3.0:1789708602.128334:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.128338:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d6f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128354:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d6f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708602.128371:0:13656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce558c4d reply state 000000005bc7e64b transno 4294967410 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128379:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.128386:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bee03fe7f00) 00010000:00010000:3.0:1789708602.128389:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708602.128391:0:13656:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789708602.128499:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+30:12179:x1876645357088768:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 1012us (1112us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1789708602.128516:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 149 00000001:00080000:3.0:1789708602.129445:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00010000:00010000:0.0:1789708602.129464:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129473:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708602.129478:0:6463:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bed08857540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789708602.129486:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee2f543a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bee03339780 00010000:00010000:0.0:1789708602.129488:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708602.129492:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee2f543200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bee1107d200 00010000:00010000:0.0:1789708602.129495:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.129500:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129505:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708602.129518:0:6463:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1789708602.129518:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708602.129524:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.129528:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789708602.129532:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00010000:00010000:0.0:1789708602.129535:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d631 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129553:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129559:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129564:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129569:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebee00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.129572:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789708602.129578:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1789708602.129589:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129600:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bee03fe7f00) 00010000:00010000:0.0:1789708602.129602:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.129604:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129609:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebee00/0xf45f43947e47d6fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129632:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129637:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129641:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129646:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.129648:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129654:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129663:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee03fe7500) 00010000:00010000:0.0:1789708602.129665:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.129669:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.129680:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d703 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.156065:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.156106:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357088896 00000100:00100000:2.0:1789708602.156116:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357088896 00000100:00100000:2.0:1789708602.156177:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00100000:2.0:1789708602.156189:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+12:12187:x1876645357088896:12345-192.168.201.52@tcp:101:lctl.0 00010000:00010000:2.0:1789708602.156213:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708602.156232:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47d70a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e142 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.156316:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47d711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.156330:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47d711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.156355:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47d711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708602.156397:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789708602.156401:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708602.156423:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47d711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.156446:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47d70a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e142 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.156461:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47d711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e142 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.156470:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c76cf00) 00010000:00010000:2.0:1789708602.156473:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708602.156476:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd600, rc 0) 00000100:00100000:2.0:1789708602.156534:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+13:12187:x1876645357088896:12345-192.168.201.52@tcp:101:lctl.0 Request processed in 348us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708602.156542:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00100000:3.0:1789708602.177359:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.177500:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357089024 00000100:00100000:2.0:1789708602.177510:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357089024 00000100:00100000:2.0:1789708602.177566:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 151 00000100:00100000:2.0:1789708602.177577:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+13:12193:x1876645357089024:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708602.177595:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708602.177624:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47d718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e149 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177700:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d71f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177712:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d71f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177722:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d71f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177735:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d726 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177742:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177748:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177822:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d72d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177830:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d72d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177837:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d72d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708602.177871:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789708602.177874:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708602.177890:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d72d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177908:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d71f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177912:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d71f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177917:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d71f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177920:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708602.177923:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d71f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177928:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d71f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177936:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c76cf00) 00010000:00010000:2.0:1789708602.177938:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708602.177940:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d71f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177944:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47d71f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177951:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177954:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d726 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177957:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177963:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708602.177965:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177969:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177973:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bee2c76c100) 00010000:00010000:2.0:1789708602.177974:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708602.177976:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d726 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.177979:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47d726 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.178005:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47d718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e149 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.178017:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d72d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e149 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.178023:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:2.0:1789708602.178025:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789708602.178027:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc200, rc 0) 00000100:00100000:2.0:1789708602.178081:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+14:12193:x1876645357089024:12345-192.168.201.52@tcp:101:bash.0 Request processed in 506us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708602.178088:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 151 00000100:00100000:0.0:1789708602.179683:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.179729:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357089280 00000100:00100000:1.0:1789708602.179737:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357089280 00000100:00100000:1.0:1789708602.179784:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00100000:1.0:1789708602.179793:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+14:12193:x1876645357089280:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708602.179806:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708602.179829:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d734 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e150 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.179899:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d73b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.179907:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d73b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.179914:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d73b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.179939:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.179944:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.179948:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708602.180204:0:6484:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789708602.180368:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180377:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180384:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180411:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d73b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180427:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d73b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180433:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d73b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180439:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708602.180443:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d73b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180450:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d73b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180460:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:1.0:1789708602.180463:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708602.180467:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d73b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180473:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d73b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708602.180484:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd95eff6 reply state 000000009191298f transno 4294967411 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180494:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180505:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bed08847f00) 00010000:00010000:1.0:1789708602.180507:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708602.180510:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789708602.180534:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d734 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e150 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180549:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e150 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.180554:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847d00) 00010000:00010000:1.0:1789708602.180555:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708602.180557:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949800, rc 0) 00000100:00100000:1.0:1789708602.180595:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+17:12193:x1876645357089280:12345-192.168.201.52@tcp:101:bash.0 Request processed in 805us (918us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789708602.180600:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00100000:0.0:1789708602.184178:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.184224:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357089408 00000100:00100000:1.0:1789708602.184233:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357089408 00000100:00080000:0.0:1789708602.184277:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708602.184326:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:1.0:1789708602.184336:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2397:x1876645357089408:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708602.184352:0:8397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708602.184369:0:8397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089bac77a/0xf45f43947e47d757 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e157 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708602.184401:0:8397:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708602.184418:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=172s v=(0 0) 00010000:00010000:1.0:1789708602.184421:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708602.184430:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089bac77a/0xf45f43947e47d757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e157 expref: 6 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.184445:0:8397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089bac77a/0xf45f43947e47d757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e157 expref: 6 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.184473:0:8397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948800, rc 0) 00000100:00100000:1.0:1789708602.184521:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2397:x1876645357089408:12345-192.168.201.52@tcp:101:bash.0 Request processed in 187us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708602.184528:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:3.0:1789708602.185627:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.185673:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357089536 00000100:00100000:0.0:1789708602.185679:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357089536 00000100:00100000:0.0:1789708602.185705:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:0.0:1789708602.185711:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+6:12193:x1876645357089536:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708602.185718:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708602.185726:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e15e expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.185741:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089bac77a/0xf45f43947e47d757 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e157 expref: 7 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.185747:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708602.185749:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708602.185752:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.185774:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089bac77a/0xf45f43947e47d757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e157 expref: 7 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.185787:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089bac77a/0xf45f43947e47d757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e157 expref: 7 pid: 8397 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.185811:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8398:1876645365509888:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708602.185874:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18a68cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708602.186610:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8398:1876645365509888:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708602.186642:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.186656:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1800, rc 0) 00000100:00100000:3.0:1789708602.186689:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+7:12193:x1876645357089536:12345-192.168.201.52@tcp:101:bash.0 Request processed in 977us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.186697:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:0.0:1789708602.186808:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.186849:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357089664 00000100:00100000:1.0:1789708602.186854:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357089664 00010000:00010000:1.0:1789708602.186872:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089bac77a/0xf45f43947e47d757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e157 expref: 7 pid: 8397 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.186892:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:1.0:1789708602.186897:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee40ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2396:x1876645357089664:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708602.186904:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708602.186916:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089bac77a/0xf45f43947e47d757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e157 expref: 7 pid: 8397 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.186923:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089bac77a/0xf45f43947e47d757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e157 expref: 7 pid: 8397 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.186937:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089bac77a/0xf45f43947e47d757 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e157 expref: 7 pid: 8397 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.186945:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708602.186948:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708602.186952:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.186963:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.186980:0:6469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.186987:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6469:1876645365510016:192.168.201.52@tcp:105: 00000100:00100000:1.0:1789708602.187017:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708602.187855:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6469:1876645365510016:192.168.201.52@tcp:105: 00010000:00010000:1.0:1789708602.187867:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708602.187897:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee40ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2396:x1876645357089664:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 998us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708602.187905:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:0.0:1789708602.188149:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.188203:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357089920 00000100:00100000:1.0:1789708602.188208:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357089920 00000100:00100000:1.0:1789708602.188247:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:1.0:1789708602.188257:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10254050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+17:12193:x1876645357089920:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:1.0:1789708602.188557:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10254050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+18:12193:x1876645357089920:12345-192.168.201.52@tcp:35:bash.0 Request processed in 301us (406us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789708602.188565:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:0.0:1789708602.214446:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365510144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789708602.214524:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708602.214558:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365510144 00000100:00100000:1.0:1789708602.214568:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365510144 00000100:00100000:1.0:1789708602.214631:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789708602.214641:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3408b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365510144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789708602.214681:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789708602.214749:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3408b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365510144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708602.214757:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789708602.214809:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365510144:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1789708602.215446:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1789708602.215464:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:0.0:1789708602.219045:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.219101:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357090176 00000100:00100000:1.0:1789708602.219110:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357090176 00000100:00100000:1.0:1789708602.219162:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 153 00000100:00100000:1.0:1789708602.219172:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+18:12203:x1876645357090176:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708602.219194:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708602.219213:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e165 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708602.219321:0:8421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789708602.219428:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d765 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e165 expref: 20 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.219444:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c76cf00) 00010000:00010000:1.0:1789708602.219447:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708602.219453:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e165 expref: 20 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.219465:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949400, rc 0) 00000100:00100000:1.0:1789708602.219515:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+19:12203:x1876645357090176:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 344us (477us total) trans 4294967413 rc 301/301 00000100:00100000:1.0:1789708602.219522:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 153 00000100:00100000:2.0:1789708602.220414:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.220471:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357090432 00000100:00100000:0.0:1789708602.220481:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357090432 00000100:00100000:0.0:1789708602.220518:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:0.0:1789708602.220527:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+19:12203:x1876645357090432:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789708602.220655:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+20:12203:x1876645357090432:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 128us (239us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789708602.220663:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:0.0:1789708602.244421:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.244471:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357090560 00000100:00100000:3.0:1789708602.244479:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357090560 00000100:00100000:3.0:1789708602.244533:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 154 00000100:00100000:3.0:1789708602.244544:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+20:12209:x1876645357090560:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708602.244569:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708602.244586:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e16c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.244651:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d77a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.244661:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d77a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.244670:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d77a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708602.244707:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789708602.244712:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708602.244729:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d77a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.244757:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e16c expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.244774:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d77a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e16c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.244782:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:3.0:1789708602.244786:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708602.244803:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9600, rc 0) 00000100:00100000:3.0:1789708602.244857:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+21:12209:x1876645357090560:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 315us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.244865:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 154 00000100:00100000:2.0:1789708602.246573:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.248729:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357090816 00000100:00100000:0.0:1789708602.248741:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357090816 00000100:00100000:0.0:1789708602.248806:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00100000:0.0:1789708602.248815:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+21:12209:x1876645357090816:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708602.248833:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708602.248853:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d781 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e173 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.248996:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d788 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.249012:0:13656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e150 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.249020:0:13656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d788 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.249060:0:13656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e150 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.249073:0:13656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e150 expref: 22 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.249085:0:13656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13656:1876645365510272:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708602.249177:0:13656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18a68600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708602.250373:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.250412:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357090944 00000100:00100000:0.0:1789708602.250418:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357090944 00010000:00010000:0.0:1789708602.250444:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e150 expref: 23 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.250482:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:0.0:1789708602.250491:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+23:2396:x1876645357090944:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708602.250502:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708602.250508:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e150 expref: 23 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.250528:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e150 expref: 23 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.250547:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847d00) 00010000:00010000:0.0:1789708602.250552:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d788 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.250559:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d788 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.250566:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d788 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.250583:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708602.250630:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+23:2396:x1876645357090944:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 140us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.250639:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00010000:00010000:1.0:1789708602.253709:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d749 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e150 expref: 22 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.253750:0:13656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13656:1876645365510272:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708602.253769:0:13656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d788 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.253778:0:13656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d788 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.253784:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d788 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708602.253800:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789708602.253919:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d781 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e173 expref: 23 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.253933:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d788 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e173 expref: 22 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.253941:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847d00) 00010000:00010000:1.0:1789708602.253944:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708602.253946:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0c00, rc 0) 00000100:00100000:1.0:1789708602.254004:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+22:12209:x1876645357090816:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 5190us (7437us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789708602.254012:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00100000:2.0:1789708602.257052:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.257103:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357091200 00000100:00100000:3.0:1789708602.257113:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357091200 00000100:00100000:3.0:1789708602.257169:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 156 00000100:00100000:3.0:1789708602.257180:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+22:12209:x1876645357091200:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708602.257200:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708602.257204:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789708602.257225:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47d788 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e173 expref: 22 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.257241:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847d00) 00010000:00010000:3.0:1789708602.257252:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708602.257287:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d796 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e17a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.257372:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d79d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.257385:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d79d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.257394:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d79d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708602.257405:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789708602.257494:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d796 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e17a expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.257521:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d79d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e17a expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.257528:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee03fe7e00) 00010000:00010000:3.0:1789708602.257530:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789708602.257533:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8000, rc 0) 00000100:00100000:3.0:1789708602.257579:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+23:12209:x1876645357091200:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 402us (534us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789708602.257587:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 156 00000100:00100000:2.0:1789708602.259535:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.259582:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357091328 00000100:00100000:0.0:1789708602.259588:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357091328 00000100:00100000:0.0:1789708602.259640:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 157 00000100:00100000:0.0:1789708602.259649:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+23:12209:x1876645357091328:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708602.259662:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708602.259673:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d7ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e181 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.259715:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d7ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e181 expref: 24 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.259741:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d7ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e181 expref: 24 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.259757:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee03fe7e00) 00010000:00010000:0.0:1789708602.259760:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708602.259763:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708602.259802:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+24:12209:x1876645357091328:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 153us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.259808:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 157 00000100:00100000:2.0:1789708602.261635:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.261692:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357091456 00000100:00100000:0.0:1789708602.261699:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357091456 00000100:00100000:0.0:1789708602.261735:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:0.0:1789708602.261744:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+6:2397:x1876645357091456:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:0.0:1789708602.261775:0:9145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.261792:0:9145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.261800:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789708602.261804:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708602.261808:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.261838:0:9145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.261860:0:9145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 6 pid: 8398 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.261874:0:9145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9145:1876645365510400:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708602.261951:0:9145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18a68f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708602.263093:0:9145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9145:1876645365510400:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708602.263113:0:9145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.264327:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.264380:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357091584 00000100:00100000:0.0:1789708602.264387:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357091584 00002000:00100000:0.0:1789708602.264428:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9bee086f8a80 x1876645357091584/t0(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:743/0 lens 504/0 e 0 to 0 dl 1789708613 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708602.264436:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086f8a80 with x1876645357091584 ext(0->12) 00010000:00010000:0.0:1789708602.264445:0:8402:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 7 pid: 8398 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.264459:0:8402:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 7 pid: 8398 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708602.264467:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bee086f8a80 00000100:00100000:0.0:1789708602.264502:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789708602.264511:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357091584:12345-192.168.201.52@tcp:4:lfs.0 00000100:00100000:0.0:1789708602.265155:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68824747-448a-469b-b2cf-e27bc037ded7+9:2395:x1876645357091584:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 644us (830us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789708602.265163:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00002000:00100000:0.0:1789708602.265172:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9bee086f8a80 x1876645357091584/t4294967306(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:743/0 lens 504/448 e 0 to 0 dl 1789708613 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708602.265181:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086f8a80 with x1876645357091584 ext(0->12) 00010000:00010000:0.0:1789708602.265187:0:8402:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 9 pid: 8398 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.265199:0:8402:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 9 pid: 8398 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708602.265207:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bee086f8a80 00000100:00100000:2.0:1789708602.266526:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.266595:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357091712 00000100:00100000:1.0:1789708602.266601:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357091712 00010000:00010000:1.0:1789708602.266640:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 9 pid: 8398 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.266689:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:1.0:1789708602.266699:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+9:2396:x1876645357091712:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708602.266711:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789708602.266724:0:6470:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789708602.266727:0:6470:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789708601 00002000:00010000:1.0:1789708602.266729:0:6470:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789708602 00002000:00010000:1.0:1789708602.266731:0:6470:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789708601 00002000:00010000:1.0:1789708602.266733:0:6470:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789708602.266739:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 9 pid: 8398 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.266751:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 9 pid: 8398 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.266774:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038233ea1/0xf45f43947e47d75e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e15e expref: 9 pid: 8398 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.266789:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708602.266793:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708602.266800:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.266809:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.266846:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708602.266866:0:9145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.266874:0:9145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.266881:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357091712:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 181us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708602.266892:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 83 00010000:00010000:0.0:1789708602.266892:0:9145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.266900:0:9145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.266913:0:9145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.266918:0:9145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708602.266921:0:9145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.266927:0:9145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.266938:0:9145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.266943:0:9145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47d7b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.266991:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:2397:x1876645357091456:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 5249us (5360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.266997:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:2.0:1789708602.267867:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.267908:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357091968 00000100:00100000:1.0:1789708602.267913:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357091968 00000100:00100000:1.0:1789708602.267937:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:1.0:1789708602.267942:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+24:12209:x1876645357091968:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:1.0:1789708602.267978:0:14125:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d79d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e17a expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708602.268107:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967417 00000001:00080000:1.0:1789708602.268150:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967418 00000001:00080000:1.0:1789708602.268441:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967419 00010000:00010000:1.0:1789708602.268466:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.268476:0:14125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d7ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e181 expref: 28 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.268482:0:14125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.268501:0:14125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d7ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e181 expref: 28 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.268510:0:14125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d7ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e181 expref: 28 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.268526:0:14125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14125:1876645365510528:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708602.268571:0:14125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708602.269701:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.269701:0:14125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14125:1876645365510528:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708602.269722:0:14125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.269831:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357092096 00000100:00100000:3.0:1789708602.269838:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357092096 00010000:00010000:3.0:1789708602.269861:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d7ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e181 expref: 29 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.269891:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:3.0:1789708602.269900:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+29:2395:x1876645357092096:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708602.269910:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708602.269916:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d7ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e181 expref: 29 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.269927:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d7ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e181 expref: 29 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.269943:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d7ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e181 expref: 29 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.269968:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee03fe7e00) 00010000:00010000:3.0:1789708602.269972:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.269980:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.269986:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.270007:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708602.270023:0:14125:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.270030:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.270084:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+28:2395:x1876645357092096:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 184us (389us total) trans 0 rc 0/0 00000001:00080000:1.0:1789708602.270092:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967420 00000100:00100000:3.0:1789708602.270093:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00000001:00080000:1.0:1789708602.270189:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967421 00000100:00100000:1.0:1789708602.270244:0:14125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365510656:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789708602.270341:0:14125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708602.270364:0:14125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02bc13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708602.270387:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365510656 00000100:00100000:2.0:1789708602.270392:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365510656 00000100:00100000:2.0:1789708602.270422:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789708602.270427:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14125:x1876645365510656:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789708602.270483:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14125:x1876645365510656:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 56us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708602.270488:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789708602.270507:0:14125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365510656:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789708602.270581:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967422 00000100:00100000:1.0:1789708602.270607:0:14125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365510784:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789708602.270642:0:14125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708602.270657:0:14125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708602.270681:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365510784 00000100:00100000:2.0:1789708602.270686:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365510784 00000100:00100000:2.0:1789708602.270715:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789708602.270722:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14125:x1876645365510784:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789708602.270791:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14125:x1876645365510784:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 70us (148us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789708602.270795:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789708602.270819:0:14125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365510784:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789708602.270842:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00010000:00010000:1.0:1789708602.270862:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.270872:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.270877:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.270880:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708602.270883:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.270888:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.270895:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee03fe7e00) 00010000:00010000:1.0:1789708602.270897:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789708602.270899:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.270903:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7b9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708602.270954:0:14125:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789708602.271001:0:14125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1789708602.271013:0:14125:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173080751873ns, next at 174080749334ns, rc = 0 00000001:00080000:1.0:1789708602.271019:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00010000:00010000:1.0:1789708602.271034:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee03fe7e00) 00010000:00010000:1.0:1789708602.271036:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789708602.271040:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d79d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e17a expref: 32 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.271113:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+31:12209:x1876645357091968:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 3168us (3246us total) trans 4294967425 rc 0/0 00000100:00100000:1.0:1789708602.271122:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000020:00080000:1.0:1789708602.271126:0:14125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789708602.272074:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.272096:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357092224 00000100:00100000:1.0:1789708602.272101:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357092224 00000100:00100000:1.0:1789708602.272135:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 158 00000100:00100000:1.0:1789708602.272143:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+31:12209:x1876645357092224:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708602.272157:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708602.272172:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d7c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e188 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.272201:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e188 expref: 32 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.272209:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e188 expref: 32 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.272220:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:1.0:1789708602.272222:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708602.272224:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949400, rc 0) 00000100:00100000:1.0:1789708602.272249:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+32:12209:x1876645357092224:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 107us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708602.272255:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 158 00000100:00100000:2.0:1789708602.273318:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.273389:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357092480 00000100:00100000:0.0:1789708602.273394:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357092480 00000100:00100000:0.0:1789708602.273427:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:0.0:1789708602.273435:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+32:12209:x1876645357092480:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789708602.273561:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+33:12209:x1876645357092480:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 127us (243us total) trans 4294967426 rc 0/0 00000100:00100000:0.0:1789708602.273574:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:2.0:1789708602.300436:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.300538:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357092736 00000100:00100000:1.0:1789708602.300547:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357092736 00000100:00100000:1.0:1789708602.300624:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 159 00000100:00100000:1.0:1789708602.300635:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+33:12219:x1876645357092736:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708602.300658:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708602.300677:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e18f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.300774:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d7ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.300786:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d7ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.300793:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d7ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708602.300801:0:8421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789708602.300876:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d7c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e18f expref: 36 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.300887:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d7ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e18f expref: 35 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.300893:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:1.0:1789708602.300895:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708602.300897:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949c00, rc 0) 00000100:00100000:1.0:1789708602.300943:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+35:12219:x1876645357092736:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 311us (516us total) trans 4294967427 rc 0/0 00000100:00100000:1.0:1789708602.300947:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 159 00000100:00100000:2.0:1789708602.302120:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.302164:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357092864 00000100:00100000:3.0:1789708602.302171:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357092864 00000100:00100000:3.0:1789708602.302212:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 160 00000100:00100000:3.0:1789708602.302222:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+35:12219:x1876645357092864:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:3.0:1789708602.302290:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d7dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302302:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d7dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302311:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d7dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302321:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d7e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302335:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302341:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302399:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302407:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302414:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708602.302445:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302457:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d7dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302464:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d7dc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302470:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d7dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302477:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.302481:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d7dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302488:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d7dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302504:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:3.0:1789708602.302506:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.302510:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d7dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302517:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d7dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302527:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302533:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d7e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302539:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302544:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.302547:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302553:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d7e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302561:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bed08847f00) 00010000:00010000:3.0:1789708602.302564:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.302567:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d7e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302573:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d7e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302593:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302599:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302605:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302610:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.302627:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302635:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302643:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.302645:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.302648:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.302654:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d7ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.302703:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+35:12219:x1876645357092864:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 482us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.302711:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 160 00000100:00100000:2.0:1789708602.316854:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.316920:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357093120 00000100:00100000:0.0:1789708602.316930:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357093120 00000100:00100000:0.0:1789708602.316987:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 161 00000100:00100000:0.0:1789708602.316995:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+35:12222:x1876645357093120:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708602.317012:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708602.317029:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d7f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e196 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317082:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d7f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317093:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317099:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317106:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d7ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317110:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d7ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317114:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d7ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317216:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317236:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317240:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708602.317247:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789708602.317326:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317331:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d7f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317336:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d7f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317340:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.317342:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d7f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317347:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d7f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317354:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:0.0:1789708602.317356:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.317359:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d7f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317363:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d7f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317371:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d7ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317380:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d7ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317383:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d7ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317386:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.317388:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d7ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317391:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d7ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317395:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bed08847f00) 00010000:00010000:0.0:1789708602.317396:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.317398:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d7ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317401:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d7ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317423:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d7f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e196 expref: 38 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317430:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e196 expref: 37 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.317434:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.317436:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708602.317441:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0600, rc 0) 00000100:00100000:0.0:1789708602.317494:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+37:12222:x1876645357093120:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 498us (649us total) trans 4294967428 rc 0/0 00000100:00100000:0.0:1789708602.317502:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 161 00000100:00100000:2.0:1789708602.318593:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.318643:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357093248 00000100:00100000:3.0:1789708602.318651:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357093248 00000100:00100000:3.0:1789708602.318691:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 162 00000100:00100000:3.0:1789708602.318707:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+37:12222:x1876645357093248:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1789708602.318743:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d814 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.318754:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.318763:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.318782:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.318789:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d814 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.318795:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d814 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.318800:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.318803:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d814 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.318810:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d814 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.318818:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.318821:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708602.318824:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d814 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.318830:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d814 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.318885:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+37:12222:x1876645357093248:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 179us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.318893:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 162 00000100:00100000:2.0:1789708602.319586:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.319643:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357093504 00000100:00100000:1.0:1789708602.319654:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357093504 00000100:00100000:1.0:1789708602.319689:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:1.0:1789708602.319699:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+37:12222:x1876645357093504:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789708602.319825:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+38:12222:x1876645357093504:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 127us (239us total) trans 4294967429 rc 0/0 00000100:00100000:1.0:1789708602.319832:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1789708602.412372:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.412538:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357093760 00000100:00100000:0.0:1789708602.412548:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357093760 00000100:00100000:0.0:1789708602.412604:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 163 00000100:00100000:0.0:1789708602.412625:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+38:12253:x1876645357093760:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1789708602.412650:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708602.412678:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d81b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e19d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.412790:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d822 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.412803:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d822 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.412814:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d822 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708602.412824:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789708602.412918:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d81b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e19d expref: 41 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.412935:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d822 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e19d expref: 40 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.412943:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.412959:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789708602.412963:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1400, rc 0) 00000100:00100000:0.0:1789708602.413016:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+40:12253:x1876645357093760:12345-192.168.201.52@tcp:101:cat.0 Request processed in 404us (655us total) trans 4294967430 rc 0/0 00000100:00100000:0.0:1789708602.413024:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 163 00000100:00100000:2.0:1789708602.441524:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.441593:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357094016 00000100:00100000:1.0:1789708602.441605:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357094016 00000100:00100000:1.0:1789708602.441689:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 164 00000100:00100000:1.0:1789708602.441704:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+40:12259:x1876645357094016:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:1.0:1789708602.441731:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708602.441733:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789708602.441758:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d77a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e16c expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.441774:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:1.0:1789708602.441779:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708602.441792:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d830 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1a4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.441888:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.441902:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e196 expref: 40 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.441911:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.441956:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e196 expref: 40 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.441966:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e196 expref: 40 pid: 13656 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.441987:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365510912:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708602.442089:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708602.443213:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365510912:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708602.443227:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.443368:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.443440:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357094144 00000100:00100000:3.0:1789708602.443446:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357094144 00010000:00010000:3.0:1789708602.443525:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e196 expref: 41 pid: 13656 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.443556:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:3.0:1789708602.443563:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+41:2396:x1876645357094144:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708602.443574:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708602.443580:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e196 expref: 41 pid: 13656 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.443591:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e196 expref: 41 pid: 13656 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.443606:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d806 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e196 expref: 41 pid: 13656 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.443629:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.443634:0:7427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.443642:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.443669:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.443699:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708602.443743:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+40:2396:x1876645357094144:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 179us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.443750:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00010000:00010000:1.0:1789708602.443857:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.443865:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708602.443878:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789708602.443977:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d830 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1a4 expref: 41 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.443990:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1a4 expref: 40 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.444006:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:1.0:1789708602.444009:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708602.444017:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948800, rc 0) 00000100:00100000:1.0:1789708602.444039:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+40:12259:x1876645357094016:12345-192.168.201.52@tcp:101:dd.0 Request processed in 2338us (2525us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1789708602.444046:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 164 00000100:00100000:2.0:1789708602.445348:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.445382:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357094272 00000100:00100000:1.0:1789708602.445389:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357094272 00000100:00100000:1.0:1789708602.445422:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 165 00000100:00100000:1.0:1789708602.445428:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+40:12259:x1876645357094272:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:1.0:1789708602.445441:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708602.445454:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d845 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1ab expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.445480:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.445492:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.445501:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.445566:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d845 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ab expref: 42 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.445575:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ab expref: 41 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.445581:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:1.0:1789708602.445582:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789708602.445588:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949a00, rc 0) 00000100:00100000:1.0:1789708602.445627:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+41:12259:x1876645357094272:12345-192.168.201.52@tcp:101:dd.0 Request processed in 200us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708602.445632:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 165 00000100:00100000:2.0:1789708602.446573:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.446640:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357094528 00000100:00100000:3.0:1789708602.446646:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357094528 00000100:00100000:3.0:1789708602.446679:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 166 00000100:00100000:3.0:1789708602.446688:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+41:12259:x1876645357094528:12345-192.168.201.52@tcp:36:dd.0 00010000:00010000:3.0:1789708602.446826:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.446837:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.446845:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708602.446883:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00000004:00010000:3.0:1789708602.446904:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a7d5735 reply state 00000000c61b6fce transno 4294967433 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.446916:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.446922:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.446925:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708602.446934:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708602.446995:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+44:12259:x1876645357094528:12345-192.168.201.52@tcp:36:dd.0 Request processed in 308us (423us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789708602.447003:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 166 00000020:00080000:3.0:1789708602.447007:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789708602.540884:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.540958:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357094656 00000100:00100000:0.0:1789708602.540969:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357094656 00000100:00100000:0.0:1789708602.541031:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 167 00000100:00100000:0.0:1789708602.541041:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+44:12273:x1876645357094656:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:0.0:1789708602.541068:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708602.541092:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d85a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1b2 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541152:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d861 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541167:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d861 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541178:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d861 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541189:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d868 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541197:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541203:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541321:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541332:0:13656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1a4 expref: 45 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541339:0:13656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541370:0:13656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1a4 expref: 45 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.541382:0:13656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1a4 expref: 45 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.541395:0:13656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13656:1876645365511040:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708602.541481:0:13656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18a68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708602.542421:0:13656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13656:1876645365511040:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708602.542451:0:13656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.542663:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.542764:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357094912 00000100:00100000:0.0:1789708602.542770:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357094912 00000100:00100000:0.0:1789708602.542853:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:0.0:1789708602.542862:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10254850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+46:6153:x1876645357094912:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789708602.543096:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10254850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+47:6153:x1876645357094912:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 234us (432us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789708602.543113:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:2.0:1789708602.544037:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.544083:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357095040 00000100:00100000:0.0:1789708602.544088:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357095040 00010000:00010000:0.0:1789708602.544118:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1a4 expref: 47 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.544152:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:0.0:1789708602.544160:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+47:2395:x1876645357095040:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708602.544173:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708602.544181:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1a4 expref: 47 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.544194:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1a4 expref: 47 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.544216:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d837 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1a4 expref: 47 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.544230:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.544235:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.544243:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.544251:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.544322:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708602.544349:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+46:2395:x1876645357095040:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 191us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.544355:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00010000:00010000:1.0:1789708602.544367:0:13656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544379:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708602.544532:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789708602.544537:0:13656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708602.544556:0:13656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544568:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544578:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d861 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544585:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d861 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544592:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d861 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544598:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708602.544603:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d861 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544622:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d861 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544640:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:1.0:1789708602.544643:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708602.544647:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d861 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544653:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d861 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544665:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544671:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d868 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544676:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d868 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544682:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708602.544685:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d868 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544692:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d868 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544699:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bed08847f00) 00010000:00010000:1.0:1789708602.544702:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708602.544704:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d868 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544710:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47d868 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544746:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d85a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b2 expref: 46 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544759:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b2 expref: 45 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.544767:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:1.0:1789708602.544769:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708602.544771:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0800, rc 0) 00000100:00100000:1.0:1789708602.544805:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+45:12273:x1876645357094656:12345-192.168.201.52@tcp:101:stat.0 Request processed in 3767us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708602.544812:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 167 00000100:00100000:2.0:1789708602.566090:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.566137:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357095296 00000100:00100000:3.0:1789708602.566148:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357095296 00000100:00100000:3.0:1789708602.566197:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 168 00000100:00100000:3.0:1789708602.566204:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+45:12279:x1876645357095296:12345-192.168.201.52@tcp:36:truncate.0 00010000:00010000:3.0:1789708602.566289:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708602.566313:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d86f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b2 expref: 45 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.566327:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.566331:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708602.566478:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.566489:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.566495:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708602.566523:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967435 00000004:00010000:3.0:1789708602.566537:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c43ec1a reply state 00000000e6d802fc transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.566545:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.566557:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.566559:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708602.566561:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708602.566643:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+47:12279:x1876645357095296:12345-192.168.201.52@tcp:36:truncate.0 Request processed in 439us (561us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789708602.566649:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 168 00000020:00080000:3.0:1789708602.566653:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789708602.623568:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.623644:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357095424 00000100:00100000:0.0:1789708602.623653:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357095424 00000100:00100000:0.0:1789708602.623708:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 169 00000100:00100000:0.0:1789708602.623718:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+47:12293:x1876645357095424:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:0.0:1789708602.623742:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708602.623763:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d87d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1b9 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623810:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d884 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623820:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d884 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623826:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d884 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623833:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d88b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623837:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d88b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623841:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d88b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623910:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623916:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623920:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708602.623950:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789708602.623954:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708602.623976:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623986:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.623995:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d884 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624000:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d884 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624008:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d884 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624014:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.624018:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d884 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624026:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d884 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624043:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:0.0:1789708602.624046:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.624051:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d884 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624057:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d884 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624068:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d88b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624072:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d88b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624076:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d88b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624078:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.624080:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d88b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624083:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d88b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624087:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bed08847f00) 00010000:00010000:0.0:1789708602.624088:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.624090:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d88b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624093:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d88b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624117:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d87d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b9 expref: 49 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624125:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b9 expref: 48 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.624130:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.624131:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708602.624133:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0400, rc 0) 00000100:00100000:0.0:1789708602.624181:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+48:12293:x1876645357095424:12345-192.168.201.52@tcp:101:stat.0 Request processed in 465us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.624191:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 169 00000100:00100000:2.0:1789708602.671113:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.671172:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357095680 00000100:00100000:1.0:1789708602.671180:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357095680 00000100:00100000:1.0:1789708602.671230:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 170 00000100:00100000:1.0:1789708602.671236:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+48:12309:x1876645357095680:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708602.671253:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708602.671294:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d899 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1c0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.671376:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.671387:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b9 expref: 49 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.671394:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.671429:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b9 expref: 49 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.671446:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b9 expref: 49 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.671456:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365511168:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708602.671524:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708602.672215:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365511168:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708602.672229:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.672365:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.672397:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357095808 00000100:00100000:1.0:1789708602.672402:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357095808 00010000:00010000:1.0:1789708602.672417:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b9 expref: 50 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.672435:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:1.0:1789708602.672440:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+50:2396:x1876645357095808:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708602.672447:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708602.672452:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b9 expref: 50 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.672460:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b9 expref: 50 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.672482:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47d892 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1b9 expref: 50 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.672492:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:1.0:1789708602.672494:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.672500:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.672509:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.672522:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708602.672544:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.672549:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+49:2396:x1876645357095808:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 108us (184us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708602.672562:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.672563:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 87 00000004:00200000:3.0:1789708602.672578:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789708602.672735:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47d899 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c0 expref: 50 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.672751:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c0 expref: 49 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.672759:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.672762:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789708602.672765:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949800, rc 0) 00000100:00100000:3.0:1789708602.672797:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+49:12309:x1876645357095680:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1560us (1691us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789708602.672803:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 170 00000100:00100000:2.0:1789708602.673727:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.673771:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357096064 00000100:00100000:1.0:1789708602.673777:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357096064 00000100:00100000:1.0:1789708602.673811:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 171 00000100:00100000:1.0:1789708602.673819:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+49:12309:x1876645357096064:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:1.0:1789708602.673954:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.673966:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.673988:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708602.674035:0:8421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967438 00000004:00010000:1.0:1789708602.674055:0:8421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001acb4022 reply state 00000000eb307daa transno 4294967439 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.674066:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.674073:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:1.0:1789708602.674075:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708602.674078:0:8421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708602.674132:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+52:12309:x1876645357096064:12345-192.168.201.52@tcp:36:bash.0 Request processed in 314us (406us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789708602.674139:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 171 00000020:00080000:1.0:1789708602.674143:0:8421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789708602.676333:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.676374:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357096192 00000100:00100000:3.0:1789708602.676390:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357096192 00000100:00100000:3.0:1789708602.676434:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 172 00000100:00100000:3.0:1789708602.676443:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+52:12309:x1876645357096192:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708602.676459:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708602.676473:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d8b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.676539:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.676554:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c0 expref: 53 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.676562:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.676590:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c0 expref: 53 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.676603:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c0 expref: 53 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.676629:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee10fa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365511296:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708602.676692:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee10fa46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708602.677458:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee10fa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6512:1876645365511296:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708602.677474:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.677642:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.677673:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357096320 00000100:00100000:0.0:1789708602.677677:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357096320 00010000:00010000:0.0:1789708602.677698:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c0 expref: 54 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.677727:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:0.0:1789708602.677744:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee40ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+54:2395:x1876645357096320:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708602.677753:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708602.677757:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c0 expref: 54 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.677766:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c0 expref: 54 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.677792:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d8a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c0 expref: 54 pid: 6484 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.677805:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.677809:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.677817:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.677824:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.677842:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708602.677855:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.677868:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee40ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+53:2395:x1876645357096320:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 134us (226us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708602.677872:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.677876:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 88 00000004:00200000:3.0:1789708602.677907:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789708602.677912:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708602.677927:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.677951:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d8b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c7 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.677965:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c7 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.677972:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.677975:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708602.677978:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9600, rc 0) 00000100:00100000:3.0:1789708602.678050:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+52:12309:x1876645357096192:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1606us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.678057:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 172 00000100:00100000:2.0:1789708602.678915:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.678954:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357096576 00000100:00100000:1.0:1789708602.678959:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357096576 00000100:00100000:1.0:1789708602.678997:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1789708602.679011:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+52:12309:x1876645357096576:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:1.0:1789708602.679137:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+53:12309:x1876645357096576:12345-192.168.201.52@tcp:35:bash.0 Request processed in 125us (217us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1789708602.679143:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:2.0:1789708602.704736:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.704787:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357096704 00000100:00100000:0.0:1789708602.704805:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357096704 00000100:00100000:0.0:1789708602.704856:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 173 00000100:00100000:0.0:1789708602.704866:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+53:12319:x1876645357096704:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:0.0:1789708602.704933:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d8c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.704946:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d8c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.704954:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d8c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.704972:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d8ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.704979:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d8ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.704986:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d8ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705052:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705059:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705063:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708602.705097:0:13656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705105:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d8c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705109:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d8c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705113:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705117:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.705120:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705129:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d8c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705137:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:0.0:1789708602.705139:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.705143:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d8c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705147:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47d8c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705155:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d8ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705158:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d8ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705162:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d8ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705165:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.705166:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d8ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705170:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d8ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705173:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bed08847f00) 00010000:00010000:0.0:1789708602.705174:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.705176:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d8ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705185:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47d8ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705191:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705194:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705197:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705200:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.705201:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705204:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705208:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.705209:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.705211:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.705214:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.705291:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+53:12319:x1876645357096704:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 427us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.705299:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 173 00000100:00100000:2.0:1789708602.718338:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.718391:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357096960 00000100:00100000:3.0:1789708602.718400:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357096960 00000100:00100000:3.0:1789708602.718464:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:3.0:1789708602.718473:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+53:12322:x1876645357096960:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708602.718493:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708602.718510:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d8d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718580:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d8df lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718590:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d8df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718598:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d8df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718618:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d8e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718625:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718629:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718717:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d8ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718723:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d8ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718727:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d8ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708602.718733:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789708602.718802:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d8df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718808:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d8df lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718823:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d8df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718827:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.718830:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d8df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718834:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d8df lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718842:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:3.0:1789708602.718845:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.718848:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d8df lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718852:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d8df lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718861:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718864:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d8e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718868:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718871:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.718873:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718882:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d8e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718886:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bed08847f00) 00010000:00010000:3.0:1789708602.718888:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.718889:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d8e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718893:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d8e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718916:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d8d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ce expref: 56 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718924:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d8ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ce expref: 55 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.718929:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.718930:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708602.718932:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509200, rc 0) 00000100:00100000:3.0:1789708602.718974:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+55:12322:x1876645357096960:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 504us (643us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789708602.718979:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:2.0:1789708602.719912:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.719934:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.719961:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357097344 00000100:00100000:0.0:1789708602.719966:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357097344 00000100:00100000:1.0:1789708602.719978:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357097088 00000100:00100000:1.0:1789708602.719997:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357097088 00000100:00100000:0.0:1789708602.720012:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:0.0:1789708602.720021:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+56:12322:x1876645357097344:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789708602.720047:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789708602.720057:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+56:2396:x1876645357097088:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708602.720068:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708602.720084:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d8ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ce expref: 57 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.720103:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:1.0:1789708602.720107:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708602.720114:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+56:12322:x1876645357097344:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 95us (201us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789708602.720120:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:1.0:1789708602.720136:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+55:2396:x1876645357097088:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 80us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708602.720145:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:2.0:1789708602.720797:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.720844:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357097472 00000100:00100000:0.0:1789708602.720854:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357097472 00000100:00100000:0.0:1789708602.720885:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 175 00000100:00100000:0.0:1789708602.720893:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+55:12322:x1876645357097472:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789708602.720925:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.720933:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.720939:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.720951:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.720955:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.720959:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.720962:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.720970:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.720975:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.720983:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.720986:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708602.720989:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.720995:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47d8fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.721037:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+55:12322:x1876645357097472:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 144us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.721042:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 175 00000100:00100000:2.0:1789708602.777146:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.777196:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357097600 00000100:00100000:3.0:1789708602.777206:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357097600 00000100:00100000:3.0:1789708602.777288:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 176 00000100:00100000:3.0:1789708602.777302:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+55:12341:x1876645357097600:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708602.777336:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708602.777357:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1d5 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.777417:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d909 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.777430:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.777440:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708602.777484:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789708602.777488:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708602.777506:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.777528:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1d5 expref: 57 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.777545:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d909 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1d5 expref: 56 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.777553:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:3.0:1789708602.777556:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708602.777559:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509000, rc 0) 00000100:00100000:3.0:1789708602.777636:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+56:12341:x1876645357097600:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 338us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.777643:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 176 00000100:00100000:2.0:1789708602.779236:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.779293:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357097984 00000100:00100000:1.0:1789708602.779298:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357097984 00000100:00100000:1.0:1789708602.779326:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:1.0:1789708602.779333:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+56:12341:x1876645357097984:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789708602.779509:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+57:12341:x1876645357097984:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 175us (272us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789708602.779518:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:2.0:1789708602.780106:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.780141:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357098112 00000100:00100000:3.0:1789708602.780146:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357098112 00000100:00100000:3.0:1789708602.780174:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1789708602.780179:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+57:12341:x1876645357098112:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:3.0:1789708602.780187:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789708602.780202:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d8bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1c7 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.780215:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47d822 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e19d expref: 56 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.780224:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d7c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e188 expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.780229:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.780232:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708602.780255:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+54:12341:x1876645357098112:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.780277:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789708602.780870:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.780920:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357098240 00000100:00100000:1.0:1789708602.780926:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357098240 00000100:00100000:1.0:1789708602.780959:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 177 00000100:00100000:1.0:1789708602.780967:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+54:12341:x1876645357098240:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:1.0:1789708602.781039:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d910 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.781052:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.781062:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789708602.781129:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789708602.781186:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+54:12341:x1876645357098240:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 219us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708602.781194:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 177 00000100:00100000:2.0:1789708602.789389:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.789433:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357098368 00000100:00100000:3.0:1789708602.789445:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357098368 00000100:00100000:3.0:1789708602.789487:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 178 00000100:00100000:3.0:1789708602.789495:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+54:12343:x1876645357098368:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708602.789512:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708602.789527:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d917 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1dc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789591:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d91e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789601:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d91e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789624:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d91e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789634:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d925 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789639:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d925 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789643:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d925 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789707:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789716:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789722:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708602.789759:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789708602.789763:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708602.789780:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789804:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789812:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d91e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789819:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d91e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789825:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d91e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789832:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.789836:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d91e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789843:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d91e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789854:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:3.0:1789708602.789856:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.789861:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d91e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789867:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d91e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789880:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d925 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789886:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d925 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789895:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d925 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789900:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.789903:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d925 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789909:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d925 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789917:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bed08847f00) 00010000:00010000:3.0:1789708602.789919:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.789922:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d925 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789928:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d925 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789953:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d917 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1dc expref: 56 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789967:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1dc expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.789974:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.789976:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708602.789979:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9600, rc 0) 00000100:00100000:3.0:1789708602.790025:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+55:12343:x1876645357098368:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 531us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.790036:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 178 00000040:00080000:1.0:1789708602.918393:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708602.918398:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708602.918426:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789708602.918437:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789708602.918556:0:13754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365511424:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789708602.918649:0:13754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708602.919560:0:13754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09944a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365511424:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708602.920020:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.920058:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357098496 00000100:00100000:0.0:1789708602.920066:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357098496 00000100:00100000:0.0:1789708602.920113:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 179 00000100:00100000:0.0:1789708602.920123:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+55:12354:x1876645357098496:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789708602.920149:0:13656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708602.920230:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+55:12354:x1876645357098496:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 108us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.920239:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 179 00000100:00100000:2.0:1789708602.921164:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.921185:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357098624 00000100:00100000:3.0:1789708602.921190:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357098624 00000100:00100000:3.0:1789708602.921214:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 180 00000100:00100000:3.0:1789708602.921219:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+55:12354:x1876645357098624:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789708602.921270:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d933 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921282:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d933 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921291:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d933 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921333:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d93a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921338:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d93a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921342:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d93a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921356:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921362:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921365:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708602.921391:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789708602.921394:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708602.921404:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921411:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d933 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921414:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d933 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921418:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d933 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921422:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.921425:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d933 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921429:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d933 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921436:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:3.0:1789708602.921438:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.921441:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d933 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921444:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47d933 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921451:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d93a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921460:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d93a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921464:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d93a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921466:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.921468:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d93a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921471:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d93a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921475:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9bee03fe7200) 00010000:00010000:3.0:1789708602.921476:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.921478:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d93a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921481:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47d93a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921490:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921493:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921496:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921499:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.921504:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921507:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921511:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:3.0:1789708602.921512:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.921514:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.921517:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47d941 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.921548:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+55:12354:x1876645357098624:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 329us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.921553:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 180 00000100:00100000:2.0:1789708602.922356:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.922391:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357098880 00000100:00100000:0.0:1789708602.922397:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357098880 00000100:00100000:0.0:1789708602.922438:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 181 00000100:00100000:0.0:1789708602.922447:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+55:12354:x1876645357098880:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708602.922466:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708602.922478:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d948 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1e3 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922540:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d94f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922549:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d94f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922558:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d94f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708602.922566:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789708602.922636:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d94f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922644:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d94f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922649:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d94f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922655:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.922658:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d94f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922665:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d94f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922673:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.922681:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708602.922685:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d94f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922690:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47d94f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922722:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d948 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1e3 expref: 57 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922732:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:0.0:1789708602.922735:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708602.922739:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d948 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1e3 expref: 57 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.922748:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1000, rc 0) 00000100:00100000:0.0:1789708602.922780:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+56:12354:x1876645357098880:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 335us (425us total) trans 4294967444 rc 301/301 00000100:00100000:0.0:1789708602.922787:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 181 00000100:00100000:2.0:1789708602.923704:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.923729:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357099008 00000100:00100000:3.0:1789708602.923735:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357099008 00000100:00100000:3.0:1789708602.923773:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 182 00000100:00100000:3.0:1789708602.923783:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+56:12354:x1876645357099008:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789708602.923803:0:6484:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789708602.923869:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+56:12354:x1876645357099008:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.923876:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 182 00000100:00100000:2.0:1789708602.925101:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.925147:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357099264 00000100:00100000:1.0:1789708602.925153:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357099264 00000100:00100000:1.0:1789708602.925190:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00100000:1.0:1789708602.925198:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+56:12354:x1876645357099264:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708602.925207:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708602.925210:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789708602.925227:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509000/0xf45f43947e47d909 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1d5 expref: 56 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.925241:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:1.0:1789708602.925246:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708602.925256:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d95d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1ea expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708602.925561:0:8421:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789708602.925674:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d964 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.925691:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d964 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.925699:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d964 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.925743:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d95d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ea expref: 58 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.925758:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d964 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ea expref: 57 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.925765:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bed08847700) 00010000:00010000:1.0:1789708602.925768:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708602.925770:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949400, rc 0) 00000100:00100000:1.0:1789708602.925805:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+57:12354:x1876645357099264:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 608us (705us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1789708602.925812:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00100000:2.0:1789708602.926852:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.926892:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357099520 00000100:00100000:3.0:1789708602.926898:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357099520 00000100:00100000:3.0:1789708602.926938:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 184 00000100:00100000:3.0:1789708602.926948:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+57:12354:x1876645357099520:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708602.926984:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708602.926999:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949400/0xf45f43947e47d964 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ea expref: 57 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927012:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bed08847700) 00010000:00010000:3.0:1789708602.927023:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708602.927037:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d972 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927045:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d972 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927053:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d972 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927105:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d979 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc4e456d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927113:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d979 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc4e456d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927121:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d979 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc4e456d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927147:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d972 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927153:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d972 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927159:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d972 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927172:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.927177:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d972 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927184:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d972 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927193:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:3.0:1789708602.927195:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.927199:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d972 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927205:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d972 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927216:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d979 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc4e456d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927222:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d979 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc4e456d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927228:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d979 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc4e456d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927232:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708602.927235:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d979 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc4e456d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927241:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d979 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc4e456d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927283:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc4e456d3 (ffff9bee03fe7a00) 00010000:00010000:3.0:1789708602.927287:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708602.927291:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d979 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc4e456d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.927298:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d979 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc4e456d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.927354:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+56:12354:x1876645357099520:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 407us (500us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708602.927361:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 184 00000100:00100000:2.0:1789708602.927949:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.927985:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357099648 00000100:00100000:0.0:1789708602.927991:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357099648 00000100:00100000:0.0:1789708602.928021:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:0.0:1789708602.928028:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+56:12354:x1876645357099648:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708602.928035:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708602.928045:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d980 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1f1 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.928062:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.928074:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.928079:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.928135:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47d980 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f1 expref: 58 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.928151:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f1 expref: 57 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.928158:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708602.928161:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708602.928165:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1800, rc 0) 00000100:00100000:0.0:1789708602.928198:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+57:12354:x1876645357099648:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 170us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.928205:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:2.0:1789708602.928926:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.928954:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357099904 00000100:00100000:3.0:1789708602.928959:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357099904 00000100:00100000:3.0:1789708602.928985:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 186 00000100:00100000:3.0:1789708602.928992:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+57:12354:x1876645357099904:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708602.929024:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.929031:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.929037:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708602.929134:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789708602.929142:0:6485:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173738880840ns, next at 174738878473ns, rc = 0 00000004:00010000:3.0:1789708602.929172:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ed2bd9f reply state 0000000004d26b93 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.929197:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.929202:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:3.0:1789708602.929204:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789708602.929206:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708602.929250:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+59:12354:x1876645357099904:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 259us (324us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789708602.929255:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 186 00000100:00100000:2.0:1789708602.929797:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.929830:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357100032 00000100:00100000:0.0:1789708602.929834:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357100032 00000100:00100000:0.0:1789708602.929858:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 187 00000100:00100000:0.0:1789708602.929864:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+59:12354:x1876645357100032:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708602.929872:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708602.929879:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d995 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1f8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.929899:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d995 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f8 expref: 60 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.929912:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d995 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f8 expref: 60 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.929923:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708602.929925:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708602.929927:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1000, rc 0) 00000100:00100000:0.0:1789708602.929951:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+60:12354:x1876645357100032:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 88us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.929956:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 187 00000100:00100000:3.0:1789708602.930795:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.930833:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357100160 00000100:00100000:1.0:1789708602.930839:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357100160 00000100:00080000:3.0:1789708602.930870:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708602.930894:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:1.0:1789708602.930906:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2395:x1876645357100160:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789708602.931014:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357100160:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 112us (222us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789708602.931019:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:2.0:1789708602.931676:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.931712:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357100416 00000100:00100000:3.0:1789708602.931718:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357100416 00000100:00100000:3.0:1789708602.931750:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1789708602.931758:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+60:12354:x1876645357100416:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789708602.931839:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+61:12354:x1876645357100416:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 82us (163us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789708602.931844:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:2.0:1789708602.932467:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.932502:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357100672 00000100:00100000:3.0:1789708602.932507:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357100672 00000100:00100000:3.0:1789708602.932542:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 188 00000100:00100000:3.0:1789708602.932549:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+61:12354:x1876645357100672:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789708602.932616:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+61:12354:x1876645357100672:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.932625:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 188 00000100:00100000:2.0:1789708602.933859:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.933907:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357100800 00000100:00100000:1.0:1789708602.933920:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357100800 00000100:00100000:1.0:1789708602.933960:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:1.0:1789708602.933968:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+61:12354:x1876645357100800:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708602.933979:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708602.934003:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d99c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e1ff expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.934054:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d9a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.934065:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.934074:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708602.934115:0:8421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708602.934135:0:8421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.934160:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d99c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ff expref: 63 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.934176:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ff expref: 62 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.934184:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:1.0:1789708602.934187:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789708602.934191:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949800, rc 0) 00000100:00100000:1.0:1789708602.934234:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+62:12354:x1876645357100800:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 266us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708602.934248:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:0.0:1789708602.935319:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.935349:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357100928 00000100:00100000:3.0:1789708602.935362:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357100928 00000100:00100000:3.0:1789708602.935407:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:3.0:1789708602.935418:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+7:2396:x1876645357100928:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708602.935427:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708602.935443:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072aaa00c/0xf45f43947e47d9aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e206 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708602.935463:0:8398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacc93a, blocks: 0x0 00010000:00010000:3.0:1789708602.935478:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=173s v=(0 0) 00010000:00010000:3.0:1789708602.935483:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708602.935492:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072aaa00c/0xf45f43947e47d9aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e206 expref: 8 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.935507:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000072aaa00c/0xf45f43947e47d9aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e206 expref: 8 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.935519:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509000, rc 0) 00000100:00100000:3.0:1789708602.935559:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357100928:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 143us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.935568:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:3.0:1789708602.936379:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.936419:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357101184 00000100:00100000:2.0:1789708602.936425:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357101184 00000100:00100000:2.0:1789708602.936474:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:2.0:1789708602.936484:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+62:12354:x1876645357101184:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789708602.936540:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+62:12354:x1876645357101184:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708602.936548:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:1.0:1789708602.937382:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.937421:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357101312 00000100:00100000:2.0:1789708602.937427:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357101312 00000100:00100000:2.0:1789708602.937459:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1789708602.937468:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+8:12354:x1876645357101312:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708602.937476:0:9145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708602.937487:0:9145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e20d expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.937514:0:9145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072aaa00c/0xf45f43947e47d9aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e206 expref: 9 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.937522:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708602.937525:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708602.937530:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 9 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.937562:0:9145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072aaa00c/0xf45f43947e47d9aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e206 expref: 9 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.937574:0:9145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072aaa00c/0xf45f43947e47d9aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e206 expref: 9 pid: 8398 timeout: 273 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.937587:0:9145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9145:1876645365511552:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708602.937662:0:9145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789708602.938354:0:9145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9145:1876645365511552:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708602.938372:0:9145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 9 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.938381:0:9145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebdc00, rc 0) 00000100:00100000:2.0:1789708602.938406:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+9:12354:x1876645357101312:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 941us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708602.938411:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:3.0:1789708602.938633:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.938666:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357101440 00000100:00100000:1.0:1789708602.938671:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357101440 00010000:00010000:1.0:1789708602.938695:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072aaa00c/0xf45f43947e47d9aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e206 expref: 9 pid: 8398 timeout: 273 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.938730:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:1.0:1789708602.938740:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+9:2395:x1876645357101440:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708602.938752:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708602.938765:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072aaa00c/0xf45f43947e47d9aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e206 expref: 9 pid: 8398 timeout: 273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.938775:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072aaa00c/0xf45f43947e47d9aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e206 expref: 9 pid: 8398 timeout: 273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.938788:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072aaa00c/0xf45f43947e47d9aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e206 expref: 9 pid: 8398 timeout: 273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.938796:0:7427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708602.938798:0:7427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708602.938803:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.938809:0:7427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.938832:0:7427:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.938840:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09945c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7427:1876645365511680:192.168.201.52@tcp:105: 00000100:00100000:1.0:1789708602.938874:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708602.939740:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09945c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7427:1876645365511680:192.168.201.52@tcp:105: 00010000:00010000:3.0:1789708602.939757:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708602.939796:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357101440:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 1058us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708602.939820:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:2.0:1789708602.940294:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.940320:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357101568 00000100:00100000:3.0:1789708602.940327:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357101568 00002000:00100000:3.0:1789708602.940362:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9bee363cea00 x1876645357101568/t0(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:743/0 lens 504/0 e 0 to 0 dl 1789708613 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708602.940371:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee363cea00 with x1876645357101568 ext(0->8) 00002000:00010000:3.0:1789708602.940376:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee363cea00 00000100:00100000:3.0:1789708602.940400:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1789708602.940410:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357101568:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789708602.940975:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+10:2396:x1876645357101568:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 566us (679us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789708602.940983:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00002000:00100000:3.0:1789708602.940991:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9bee363cea00 x1876645357101568/t4294967315(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:743/0 lens 504/448 e 0 to 0 dl 1789708613 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708602.941000:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee363cea00 with x1876645357101568 ext(0->8) 00002000:00010000:3.0:1789708602.941004:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee363cea00 00000100:00100000:2.0:1789708602.941676:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708602.941711:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357101696 00000100:00100000:1.0:1789708602.941717:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357101696 00000100:00100000:1.0:1789708602.941766:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:1.0:1789708602.941776:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+62:12354:x1876645357101696:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789708602.942696:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000004:00080000:3.0:1789708602.942705:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:0.0:1789708602.942722:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942731:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942736:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942742:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.942746:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942751:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708602.942753:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:0.0:1789708602.942764:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bed08847f00) 00010000:00010000:0.0:1789708602.942768:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1789708602.942774:0:6463:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bee02bc1e40 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:0.0:1789708602.942777:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708602.942780:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bed08b6ca00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bee02bc13c0 00010000:00010000:0.0:1789708602.942785:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d742 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708602.942786:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bed08b6c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bed09bf9e00 00000020:00080000:2.0:1789708602.942805:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 3 00010000:00010000:0.0:1789708602.942813:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942818:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942822:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942826:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8e00 already unused, calling callback (ffffffffc1a211b0) 00000020:00080000:3.0:1789708602.942827:0:6463:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00010000:00010000:0.0:1789708602.942828:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942833:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942843:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.942845:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.942847:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789708602.942849:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789708602.942852:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47d853 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942860:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942863:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942872:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942875:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.942877:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942881:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942886:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.942887:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.942889:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942892:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47d876 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942899:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942903:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942907:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942911:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.942912:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942921:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942927:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.942929:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708602.942931:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942934:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47d8ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942943:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942946:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942950:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942952:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.942954:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942957:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942961:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708602.942962:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789708602.942963:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.942972:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47d98e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.943022:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789708602.943032:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708602.943032:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365511808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789708602.943048:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365511936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789708602.943072:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708602.943096:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365511808 00000100:00100000:3.0:1789708602.943097:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708602.943104:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365511808 00000100:00100000:0.0:1789708602.943123:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365511936 00000100:00100000:0.0:1789708602.943127:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365511936 00000100:00100000:2.0:1789708602.943144:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789708602.943156:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365511808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789708602.943156:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789708602.943169:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1876645365511936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789708602.943182:0:8399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1789708602.943204:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aacc939, atime: 0x6aacc93a, ctime: 0x6aacc939, blocks: 0x8 00010000:00010000:0.0:1789708602.943209:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47d9b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.943219:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=173s v=(0 0) 00010000:00010000:0.0:1789708602.943222:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708602.943226:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47d9b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.943235:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47d9b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708602.943236:0:8397:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789708602.943243:0:8397:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789708602 00010000:00010000:0.0:1789708602.943246:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47d9b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708602.943247:0:8397:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789708602.943254:0:8397:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789708602 -> 1789708602 00010000:00010000:0.0:1789708602.943257:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47d9b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708602.943282:0:8397:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789708602.943290:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708602.943300:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708602.943308:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47d9b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.943318:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708602.943323:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47d9b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.943328:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1876645365511808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (254us total) trans 4294967316 rc 0/0 00010000:00010000:3.0:1789708602.943339:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47d9b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.943342:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:3.0:1789708602.943359:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47d9b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.943368:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47d9b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.943380:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3616:x1876645365511936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 215us (286us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789708602.943387:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:3.0:1789708602.943391:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708602.943395:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708602.943398:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708602.943418:0:3617:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1789708602.943422:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bee3fac1180, transno 4294967311 00000004:00080000:0.0:1789708602.943431:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1789708602.943452:0:3617:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9bee363cf800 x1876645365511808/t4294967316(4294967316) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789708618 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789708602.943460:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bee363cf800/2, rc 0, transno 4294967316 00000100:00100000:0.0:1789708602.943463:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365511808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1789708602.943488:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bed09b81880/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789708602.943491:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365511936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789708602.946432:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+20:12354:x1876645357101696:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 4653us (4752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.946442:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:0.0:1789708602.947367:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.947984:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357101824 00000100:00100000:2.0:1789708602.947992:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357101824 00000100:00100000:2.0:1789708602.948037:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:2.0:1789708602.948048:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+10:2396:x1876645357101824:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789708602.948916:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1789708602.948925:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1789708602.949451:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:2396:x1876645357101824:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 1403us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708602.949462:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:2.0:1789708602.950415:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.950439:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357102080 00000100:00100000:3.0:1789708602.950447:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357102080 00000100:00100000:3.0:1789708602.950490:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:3.0:1789708602.950509:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+20:12354:x1876645357102080:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708602.950549:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708602.950574:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949800/0xf45f43947e47d9a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ff expref: 20 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.950590:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:3.0:1789708602.950595:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708602.950637:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.950651:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.950661:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708602.950765:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000213ea7e reply state 00000000569e8dec transno 4294967448 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.950776:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.950782:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:3.0:1789708602.950785:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708602.950788:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708602.950856:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+21:12354:x1876645357102080:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 350us (440us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789708602.950864:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:2.0:1789708602.951511:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.951537:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357102208 00000100:00100000:3.0:1789708602.951543:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357102208 00000100:00100000:3.0:1789708602.951581:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:3.0:1789708602.951590:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357102208:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789708602.951684:0:8397:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789708602.951688:0:8397:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789708602 -> 1789708602 00002000:00010000:3.0:1789708602.951691:0:8397:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789708602 00002000:00010000:3.0:1789708602.951694:0:8397:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789708602 -> 1789708602 00002000:00010000:3.0:1789708602.951696:0:8397:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789708602.951734:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357102208:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 145us (221us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789708602.951741:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:0.0:1789708602.952413:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.952438:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357102464 00000100:00100000:3.0:1789708602.952443:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357102464 00000100:00100000:3.0:1789708602.952479:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:3.0:1789708602.952489:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+21:12354:x1876645357102464:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789708602.952524:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.952536:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f1 expref: 21 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.952545:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.952578:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f1 expref: 21 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.952592:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f1 expref: 21 pid: 13656 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.952630:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1876645365512064:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708602.952702:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee10fa4900 going to sleep for 11 seconds 00000100:00100000:0.0:1789708602.953414:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1876645365512064:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708602.953430:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.953586:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708602.953624:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357102592 00000100:00100000:3.0:1789708602.953630:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357102592 00010000:00010000:3.0:1789708602.953701:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f1 expref: 22 pid: 13656 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.953731:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1789708602.953741:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+22:2395:x1876645357102592:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708602.953752:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708602.953758:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f1 expref: 22 pid: 13656 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.953769:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f1 expref: 22 pid: 13656 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.953786:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47d987 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f1 expref: 22 pid: 13656 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.953797:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:3.0:1789708602.953800:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.953808:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.953826:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708602.953851:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708602.953862:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.953869:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.953884:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+21:2395:x1876645357102592:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 145us (297us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708602.953887:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708602.953896:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00010000:00010000:1.0:1789708602.953896:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.953905:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.953909:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708602.953913:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.953923:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.953930:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:1.0:1789708602.953932:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789708602.953935:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708602.953939:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47d9c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.953973:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+20:12354:x1876645357102464:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 1487us (1561us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789708602.953980:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:1.0:1789708602.954675:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.954725:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357102720 00000100:00100000:2.0:1789708602.954731:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357102720 00000100:00100000:2.0:1789708602.954778:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:2.0:1789708602.954787:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357102720:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789708602.954812:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.954828:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.954836:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708602.954841:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708602.954846:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.954869:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.954881:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 8 pid: 9145 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.954893:0:8399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8399:1876645365512192:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708602.954941:0:8399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789708602.955694:0:8399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8399:1876645365512192:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708602.955707:0:8399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.955880:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.955924:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357102848 00000100:00100000:2.0:1789708602.955930:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357102848 00010000:00010000:2.0:1789708602.955946:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 9 pid: 9145 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.955980:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:2.0:1789708602.955994:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+9:2395:x1876645357102848:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708602.956004:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708602.956020:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 9 pid: 9145 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.956030:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 9 pid: 9145 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.956043:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6216335/0xf45f43947e47d9b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e20d expref: 9 pid: 9145 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.956055:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708602.956058:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708602.956064:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.956072:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.956095:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708602.956115:0:8399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.956125:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.956127:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357102848:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 134us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708602.956142:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00010000:00010000:0.0:1789708602.956152:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.956162:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.956171:0:8399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.956177:0:8399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708602.956181:0:8399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.956189:0:8399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.956201:0:8399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.956214:0:8399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47d9cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.956254:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357102720:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 1470us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708602.956287:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:1.0:1789708602.956976:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.957023:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357103104 00000100:00100000:2.0:1789708602.957029:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357103104 00000100:00100000:2.0:1789708602.957066:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 194 00000100:00100000:2.0:1789708602.957075:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+20:12354:x1876645357103104:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789708602.957131:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.957143:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ab expref: 20 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.957151:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.957173:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ab expref: 20 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.957184:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ab expref: 20 pid: 8421 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.957194:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ad9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365512320:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708602.957240:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789708602.957884:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ad9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365512320:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708602.957894:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.958024:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.958051:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357103232 00000100:00100000:2.0:1789708602.958055:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357103232 00010000:00010000:2.0:1789708602.958070:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ab expref: 21 pid: 8421 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.958096:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:2.0:1789708602.958104:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+21:2396:x1876645357103232:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708602.958113:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708602.958119:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ab expref: 21 pid: 8421 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.958141:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ab expref: 21 pid: 8421 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.958154:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47d84c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1ab expref: 21 pid: 8421 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.958163:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:2.0:1789708602.958166:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.958171:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.958176:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.958192:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708602.958215:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+20:2396:x1876645357103232:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 112us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708602.958220:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00010000:00010000:0.0:1789708602.958222:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.958232:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.958385:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.958397:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d995 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f8 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.958405:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.958426:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d995 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f8 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.958449:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d995 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f8 expref: 20 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.958460:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365512448:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708602.958501:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee03339780 going to sleep for 11 seconds 00000100:00100000:0.0:1789708602.959051:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365512448:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708602.959062:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.959239:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.959290:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357103360 00000100:00100000:2.0:1789708602.959295:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357103360 00010000:00010000:2.0:1789708602.959312:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d995 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f8 expref: 21 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.959335:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:2.0:1789708602.959340:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee40ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+21:2395:x1876645357103360:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708602.959355:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708602.959359:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d995 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f8 expref: 21 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.959365:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d995 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f8 expref: 21 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.959374:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47d995 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1f8 expref: 21 pid: 6483 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.959388:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:2.0:1789708602.959393:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.959398:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.959402:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.959415:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708602.959433:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.959439:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee40ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+20:2395:x1876645357103360:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 98us (199us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708602.959443:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.959448:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 93 00000001:00080000:0.0:1789708602.959503:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000001:00080000:0.0:1789708602.959579:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000001:00080000:0.0:1789708602.959621:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000100:00100000:0.0:1789708602.959679:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1876645365512576:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789708602.959720:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708602.959744:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1d600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708602.959759:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365512576 00000100:00100000:2.0:1789708602.959764:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365512576 00000100:00100000:2.0:1789708602.959802:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789708602.959811:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6484:x1876645365512576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789708602.959873:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6484:x1876645365512576:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708602.959884:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789708602.959897:0:6484:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789708602.959904:0:6484:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bee363cf800, transno 4294967316 00000100:00100000:0.0:1789708602.959920:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1876645365512576:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789708602.960057:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967452 00000100:00100000:0.0:1789708602.960096:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1876645365512704:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789708602.960136:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708602.960157:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708602.960194:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365512704 00000100:00100000:2.0:1789708602.960200:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365512704 00000100:00100000:2.0:1789708602.960232:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789708602.960241:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6484:x1876645365512704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789708602.960350:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6484:x1876645365512704:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (215us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789708602.960356:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789708602.960366:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1876645365512704:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789708602.960386:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960394:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960400:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960407:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.960410:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960418:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960427:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708602.960431:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708602.960433:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960438:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47d9db lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960452:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960458:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d910 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960471:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d910 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960476:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708602.960479:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d910 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960487:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d910 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960496:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.960498:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708602.960500:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d910 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960504:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47d910 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960517:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960524:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1dc expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960529:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960545:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1dc expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.960560:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1dc expref: 23 pid: 6512 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.960567:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09a1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365512832:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708602.960619:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20780 going to sleep for 11 seconds 00000100:00100000:0.0:1789708602.961209:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09a1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365512832:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708602.961219:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708602.961370:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708602.961398:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357103488 00000100:00100000:0.0:1789708602.961404:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357103488 00010000:00010000:0.0:1789708602.961421:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1dc expref: 24 pid: 6512 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.961444:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:0.0:1789708602.961451:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+24:2396:x1876645357103488:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708602.961459:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708602.961465:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1dc expref: 24 pid: 6512 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.961475:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1dc expref: 24 pid: 6512 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.961489:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47d92c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e1dc expref: 24 pid: 6512 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.961506:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:0.0:1789708602.961508:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.961513:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.961517:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.961532:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708602.961545:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961551:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961559:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.961560:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+23:2396:x1876645357103488:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 107us (186us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708602.961566:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961574:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708602.961574:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 94 00010000:00010000:2.0:1789708602.961581:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708602.961583:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961587:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961615:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:2.0:1789708602.961617:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708602.961621:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961625:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47d9e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961634:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961641:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961647:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961652:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebde00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708602.961655:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961661:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961669:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847300) 00010000:00010000:2.0:1789708602.961672:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789708602.961675:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.961681:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47d9d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.961804:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+22:12354:x1876645357103104:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 4730us (4834us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789708602.961813:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 194 00000020:00080000:2.0:1789708602.961818:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789708602.961849:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708602.961853:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708602.962192:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1789708602.962204:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789708602.962878:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708602.962909:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357103744 00000100:00100000:2.0:1789708602.962913:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357103744 00000100:00100000:2.0:1789708602.962937:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:2.0:1789708602.962943:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+22:12354:x1876645357103744:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789708602.963076:0:14125:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789708602.963098:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967454 00010000:00010000:2.0:1789708602.963115:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.963123:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.963128:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.963133:0:14125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.963137:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.963141:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708602.963154:0:14125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708602.963175:0:10362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708602.963183:0:10362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.963191:0:10362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebdc00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708602.963195:0:10362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.963202:0:10362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708602.963204:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+24:12354:x1876645357103744:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 261us (328us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789708602.963213:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000020:00080000:2.0:1789708602.963217:0:14125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789708602.963225:0:10362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708602.963230:0:10362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789708602.963234:0:10362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.963250:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47d9e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708602.963292:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708602.963296:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708602.963298:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708602.982348:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708603.066890:0:14660:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708603.066897:0:14660:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708603.066925:0:14660:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789708603.066934:0:14660:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789708603.102354:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.102417:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357103872 00000100:00100000:1.0:1789708603.102427:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357103872 00000100:00100000:1.0:1789708603.102481:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:1.0:1789708603.102493:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+24:12364:x1876645357103872:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:1.0:1789708603.102581:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d9f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102597:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102620:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102635:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d9f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102642:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102648:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102723:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102731:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102738:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708603.102778:0:8421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102791:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102807:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d9f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102814:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102820:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708603.102824:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102831:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d9f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102842:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:1.0:1789708603.102845:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708603.102851:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d9f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102857:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47d9f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102869:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102875:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d9f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102881:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102886:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708603.102896:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102903:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d9f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102911:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bed08847c00) 00010000:00010000:1.0:1789708603.102914:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708603.102917:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d9f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102923:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47d9f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102940:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102947:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102953:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102958:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708603.102961:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102966:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102974:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bed08847b00) 00010000:00010000:1.0:1789708603.102976:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708603.102986:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.102992:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47d9fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.103073:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+24:12364:x1876645357103872:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 582us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.103082:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:3.0:1789708603.120934:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.120980:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357104128 00000100:00100000:2.0:1789708603.120992:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357104128 00000100:00100000:2.0:1789708603.121059:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:2.0:1789708603.121071:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+24:12368:x1876645357104128:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708603.121092:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.121110:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47da05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e214 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121190:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47da0c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121205:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47da0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121217:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47da0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121230:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121236:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121248:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121371:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121381:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121389:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708603.121399:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789708603.121460:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47da0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121468:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47da0c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121475:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47da0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121481:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.121486:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47da0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121501:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47da0c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121522:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:2.0:1789708603.121526:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.121536:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47da0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121543:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47da0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121554:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121560:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121566:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121571:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebcc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.121573:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121577:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121584:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee2c76c400) 00010000:00010000:2.0:1789708603.121586:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.121590:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121595:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121642:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47da05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e214 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121667:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e214 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.121675:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:2.0:1789708603.121678:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708603.121681:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc000, rc 0) 00000100:00100000:2.0:1789708603.121747:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+26:12368:x1876645357104128:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 670us (813us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789708603.121759:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:2.0:1789708603.123338:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708603.123413:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357104256 00000100:00100000:3.0:1789708603.123422:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357104256 00000100:00100000:3.0:1789708603.123477:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:3.0:1789708603.123489:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+26:12368:x1876645357104256:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1789708603.123538:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.123551:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.123561:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.123588:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.123596:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.123614:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.123627:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708603.123631:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.123639:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.123651:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:3.0:1789708603.123654:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708603.123658:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.123664:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.123732:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+26:12368:x1876645357104256:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 244us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.123741:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:3.0:1789708603.124497:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.124555:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357104512 00000100:00100000:1.0:1789708603.124561:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357104512 00000100:00100000:1.0:1789708603.124623:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1789708603.124635:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10257450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+26:12368:x1876645357104512:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789708603.124811:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10257450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+27:12368:x1876645357104512:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 179us (314us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789708603.124820:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:3.0:1789708603.136391:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.136444:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357104768 00000100:00100000:0.0:1789708603.136454:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357104768 00000100:00100000:0.0:1789708603.136513:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:0.0:1789708603.136524:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+27:11901:x1876645357104768:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708603.136548:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.136565:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47da2f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e21b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.136665:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.136679:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e214 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.136689:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.136721:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e214 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.136731:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e214 expref: 28 pid: 6512 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.136755:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09a1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365512960:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708603.136822:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708603.137579:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09a1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365512960:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708603.137608:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.137874:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.137917:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357104896 00000100:00100000:1.0:1789708603.137923:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357104896 00010000:00010000:1.0:1789708603.137944:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e214 expref: 29 pid: 6512 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.137975:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:1.0:1789708603.137983:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+29:2395:x1876645357104896:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708603.137993:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708603.138000:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e214 expref: 29 pid: 6512 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.138011:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e214 expref: 29 pid: 6512 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.138034:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e214 expref: 29 pid: 6512 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.138047:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:1.0:1789708603.138052:0:7427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.138059:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.138066:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.138088:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708603.138110:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.138117:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708603.138130:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00000100:00100000:1.0:1789708603.138131:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+28:2395:x1876645357104896:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 138us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.138142:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 95 00010000:00010000:0.0:1789708603.138223:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47da2f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e21b expref: 29 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.138237:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e21b expref: 28 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.138242:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:0.0:1789708603.138244:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789708603.138246:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1200, rc 0) 00000100:00100000:0.0:1789708603.138298:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+28:11901:x1876645357104768:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1775us (1916us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789708603.138306:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:3.0:1789708603.139056:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.139084:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357105024 00000100:00100000:0.0:1789708603.139093:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357105024 00000100:00100000:0.0:1789708603.139117:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:0.0:1789708603.139122:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+28:11901:x1876645357105024:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708603.139130:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.139137:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e222 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.139152:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47da4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.139158:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47da4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.139163:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47da4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.139222:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e222 expref: 30 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.139235:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47da4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e222 expref: 29 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.139241:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:0.0:1789708603.139244:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708603.139246:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1e00, rc 0) 00000100:00100000:0.0:1789708603.139298:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+29:11901:x1876645357105024:12345-192.168.201.52@tcp:101:bash.0 Request processed in 174us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.139304:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:2.0:1789708603.140040:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708603.140088:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357105280 00000100:00100000:3.0:1789708603.140092:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357105280 00000100:00100000:3.0:1789708603.140115:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:3.0:1789708603.140121:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+29:11901:x1876645357105280:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:3.0:1789708603.140280:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.140301:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.140310:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708603.140349:0:13656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967459 00000004:00010000:3.0:1789708603.140370:0:13656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c9267a0 reply state 00000000b249ed04 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.140382:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.140388:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:3.0:1789708603.140391:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708603.140394:0:13656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789708603.140487:0:13656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967460 00000100:00100000:3.0:1789708603.140536:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+33:11901:x1876645357105280:12345-192.168.201.52@tcp:36:bash.0 Request processed in 415us (498us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789708603.140540:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 200 00000020:00080000:3.0:1789708603.140542:0:13656:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789708603.141150:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.141187:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357105408 00000100:00100000:1.0:1789708603.141192:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357105408 00000100:00100000:1.0:1789708603.141224:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:1.0:1789708603.141232:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+33:11901:x1876645357105408:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708603.141242:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708603.141252:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47da59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e229 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.141316:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47da59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e229 expref: 34 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.141335:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47da59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e229 expref: 34 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.141352:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:1.0:1789708603.141353:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708603.141355:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948e00, rc 0) 00000100:00100000:1.0:1789708603.141378:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+34:11901:x1876645357105408:12345-192.168.201.52@tcp:101:bash.0 Request processed in 148us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.141382:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:0.0:1789708603.142189:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.142239:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357105536 00000100:00100000:2.0:1789708603.142245:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357105536 00000100:00100000:2.0:1789708603.142329:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:2.0:1789708603.142339:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:11901:x1876645357105536:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708603.142358:0:9145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.142373:0:9145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47da60 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e230 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708603.142392:0:9145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aacc93a, atime: 0x6aacc93a, ctime: 0x6aacc93a, blocks: 0x8 00010000:00010000:2.0:1789708603.142406:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=173s v=(0 0) 00010000:00010000:2.0:1789708603.142411:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708603.142418:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47da60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e230 expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.142439:0:9145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47da60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e230 expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.142449:0:9145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd800, rc 0) 00000100:00100000:2.0:1789708603.142480:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+8:11901:x1876645357105536:12345-192.168.201.52@tcp:101:bash.0 Request processed in 143us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.142488:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:2.0:1789708603.143169:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.143204:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357105664 00000100:00100000:0.0:1789708603.143210:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357105664 00002000:00010000:0.0:1789708603.143232:0:8402:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789708603.143237:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee363cf800 with x1876645357105664 ext(0->18446744073709551615) 00002000:00010000:0.0:1789708603.143245:0:8402:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee363cf800. 00000100:00100000:2.0:1789708603.143292:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789708603.143304:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357105664:12345-192.168.201.52@tcp:10:bash.0 00002000:00010000:2.0:1789708603.143481:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789708603.143484:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789708602 -> 1789708602 00002000:00010000:2.0:1789708603.143487:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789708602 -> 1789708602 00002000:00010000:2.0:1789708603.143489:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789708602 -> 1789708602 00002000:00010000:2.0:1789708603.143491:0:8403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789708603.143522:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68824747-448a-469b-b2cf-e27bc037ded7+9:2396:x1876645357105664:12345-192.168.201.52@tcp:10:bash.0 Request processed in 221us (353us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789708603.143530:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00002000:00010000:2.0:1789708603.143534:0:8403:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789708603.143537:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee363cf800 with x1876645357105664 ext(0->18446744073709551615) 00002000:00010000:2.0:1789708603.143542:0:8403:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee363cf800. 00000100:00100000:3.0:1789708603.167917:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.167995:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357105792 00000100:00100000:2.0:1789708603.168006:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357105792 00000100:00100000:2.0:1789708603.168070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 202 00000100:00100000:2.0:1789708603.168095:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+34:12382:x1876645357105792:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:2.0:1789708603.168153:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da67 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168166:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168173:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168184:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168188:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168192:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168254:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168286:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168294:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708603.168338:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168350:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168359:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da67 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168363:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168367:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.168370:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168375:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da67 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168383:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:2.0:1789708603.168385:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.168389:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168392:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168400:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168404:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168407:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168410:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.168415:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168419:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168423:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee2c76c300) 00010000:00010000:2.0:1789708603.168424:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.168425:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168429:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168437:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168440:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168443:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168446:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebcc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.168447:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168451:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168455:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:2.0:1789708603.168456:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.168461:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.168465:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.168518:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+34:12382:x1876645357105792:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 427us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.168523:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 202 00000100:00100000:0.0:1789708603.181240:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.181305:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357106048 00000100:00100000:2.0:1789708603.181315:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357106048 00000100:00100000:2.0:1789708603.181370:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 203 00000100:00100000:2.0:1789708603.181380:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+34:12385:x1876645357106048:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708603.181400:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.181421:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e237 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181490:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181505:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181515:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181528:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181536:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181559:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181671:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47da91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181681:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47da91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181688:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47da91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708603.181697:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789708603.181769:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181785:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da83 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181791:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181796:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.181800:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181808:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181818:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:2.0:1789708603.181821:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.181832:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181837:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47da83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181850:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181856:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181862:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181867:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.181870:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181875:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181883:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee2c76c300) 00010000:00010000:2.0:1789708603.181886:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.181888:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181894:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47da8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181931:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47da7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e237 expref: 37 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181955:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47da91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e237 expref: 36 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.181962:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:2.0:1789708603.181965:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789708603.181967:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebdc00, rc 0) 00000100:00100000:2.0:1789708603.182021:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+36:12385:x1876645357106048:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 642us (786us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789708603.182028:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 203 00000100:00100000:1.0:1789708603.183367:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.183411:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357106176 00000100:00100000:0.0:1789708603.183417:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357106176 00000100:00100000:0.0:1789708603.183448:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:0.0:1789708603.183456:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+36:12385:x1876645357106176:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789708603.183488:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.183499:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e21b expref: 36 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.183508:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.183535:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e21b expref: 36 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.183547:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e21b expref: 36 pid: 6485 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.183560:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365513088:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708603.183636:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20900 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.184388:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.184408:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365513088:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708603.184423:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357106432 00000100:00100000:2.0:1789708603.184429:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357106432 00010000:00010000:0.0:1789708603.184445:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.184466:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:2.0:1789708603.184474:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+37:6153:x1876645357106432:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789708603.184635:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+38:6153:x1876645357106432:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 160us (247us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1789708603.184644:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1789708603.185299:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.185350:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357106560 00000100:00100000:1.0:1789708603.185354:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357106560 00010000:00010000:1.0:1789708603.185371:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e21b expref: 38 pid: 6485 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.185397:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:1.0:1789708603.185405:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+38:2395:x1876645357106560:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708603.185416:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708603.185423:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e21b expref: 38 pid: 6485 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.185435:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e21b expref: 38 pid: 6485 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.185450:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47da36 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e21b expref: 38 pid: 6485 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.185473:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:1.0:1789708603.185477:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.185485:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.185492:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.185511:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708603.185536:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+37:2395:x1876645357106560:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 132us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.185542:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 96 00010000:00010000:0.0:1789708603.185551:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.185561:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.185581:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.185588:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.185595:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.185615:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708603.185619:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.185625:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.185635:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:0.0:1789708603.185637:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708603.185641:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.185647:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47da9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.185695:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+36:12385:x1876645357106176:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 2240us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.185703:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:3.0:1789708603.186329:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.186367:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357106816 00000100:00100000:1.0:1789708603.186371:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357106816 00000100:00100000:1.0:1789708603.186395:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:1.0:1789708603.186400:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+36:12385:x1876645357106816:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789708603.186475:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+37:12385:x1876645357106816:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 75us (148us total) trans 4294967464 rc 0/0 00000100:00100000:1.0:1789708603.186480:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:3.0:1789708603.214084:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.214149:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357107072 00000100:00100000:0.0:1789708603.214160:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357107072 00000100:00100000:0.0:1789708603.214220:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 205 00000100:00100000:0.0:1789708603.214232:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+37:12396:x1876645357107072:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1789708603.214294:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.214316:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47daa6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e23e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214384:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47daad lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214398:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47daad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214410:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47daad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214425:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dab4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214432:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214439:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214555:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dabb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214565:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dabb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214573:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dabb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708603.214582:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789708603.214678:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47daad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214685:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47daad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214692:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47daad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214698:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708603.214702:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47daad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214709:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47daad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214721:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:0.0:1789708603.214724:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708603.214729:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47daad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214744:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47daad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214758:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214764:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dab4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214770:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214775:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708603.214778:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214785:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dab4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214792:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee4205da00) 00010000:00010000:0.0:1789708603.214795:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708603.214798:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dab4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214804:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dab4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214839:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47daa6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e23e expref: 40 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214853:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dabb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e23e expref: 39 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.214866:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:0.0:1789708603.214868:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708603.214871:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708603.214927:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+39:12396:x1876645357107072:12345-192.168.201.52@tcp:101:cat.0 Request processed in 697us (849us total) trans 4294967465 rc 0/0 00000100:00100000:0.0:1789708603.214936:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 205 00000100:00100000:3.0:1789708603.216815:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.216863:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357107328 00000100:00100000:2.0:1789708603.216869:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357107328 00000100:00100000:2.0:1789708603.216900:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:2.0:1789708603.216906:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+39:12396:x1876645357107328:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:2.0:1789708603.217079:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+40:12396:x1876645357107328:12345-192.168.201.52@tcp:35:cat.0 Request processed in 173us (268us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789708603.217085:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:3.0:1789708603.224952:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.225034:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357107584 00000100:00100000:0.0:1789708603.225043:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357107584 00000100:00100000:0.0:1789708603.225092:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 206 00000100:00100000:0.0:1789708603.225101:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+40:12397:x1876645357107584:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:0.0:1789708603.225159:0:13656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789708603.225185:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47da59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e229 expref: 40 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225209:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dabb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e23e expref: 39 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225221:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47da91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e237 expref: 38 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225233:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47da4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e222 expref: 37 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225242:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:0.0:1789708603.225247:0:13656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708603.225326:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dac9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225342:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dac9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225352:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dac9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225367:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225374:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225381:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225454:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47dad7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225463:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47dad7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225470:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47dad7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708603.225694:0:13656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:0.0:1789708603.225743:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225752:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225772:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225779:0:13656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225786:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225792:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225811:0:13656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708603.225829:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47dad7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.225835:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708603.225836:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47dad7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.225843:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225846:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47dad7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.225852:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708603.225857:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225859:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708603.225864:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47dad7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.225871:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225876:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47dad7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.225881:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:1.0:1789708603.225886:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789708603.225889:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.225895:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dade lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225895:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00010000:00010000:0.0:1789708603.225903:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789708603.225908:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708603.225909:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708603.225911:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708603.225917:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47dad7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225935:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47dad7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225952:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dac9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225958:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dac9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225964:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dac9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225970:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708603.225973:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dac9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225979:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dac9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225987:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:0.0:1789708603.225990:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708603.225993:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dac9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.225998:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dac9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708603.226007:0:13656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e09077eb reply state 000000001e0e3d4a transno 4294967467 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.226029:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.226035:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee4205da00) 00010000:00010000:0.0:1789708603.226038:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708603.226040:0:13656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708603.226107:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+38:12397:x1876645357107584:12345-192.168.201.52@tcp:36:rm.0 Request processed in 1005us (1163us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1789708603.226115:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 206 00000100:00100000:3.0:1789708603.240831:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.240882:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357107840 00000100:00100000:1.0:1789708603.240893:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357107840 00000100:00100000:1.0:1789708603.240951:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 207 00000100:00100000:1.0:1789708603.240962:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+38:12403:x1876645357107840:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708603.240986:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708603.241006:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47dae5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e245 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241100:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47daec lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241114:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47daec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241125:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47daec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241149:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241157:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241164:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708603.241491:0:8421:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789708603.241627:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241637:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241645:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241691:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47daec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241699:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47daec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241706:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47daec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241713:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708603.241717:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47daec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241734:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47daec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241746:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:1.0:1789708603.241749:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708603.241753:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47daec lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241760:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47daec lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708603.241772:0:8421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011b59199 reply state 0000000015e0c202 transno 4294967468 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241782:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241788:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee4205da00) 00010000:00010000:1.0:1789708603.241791:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708603.241794:0:8421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789708603.241818:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47dae5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e245 expref: 41 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241832:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e245 expref: 40 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.241839:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bed08847b00) 00010000:00010000:1.0:1789708603.241841:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708603.241844:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949200, rc 0) 00000100:00100000:1.0:1789708603.241890:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+41:12403:x1876645357107840:12345-192.168.201.52@tcp:101:bash.0 Request processed in 933us (1070us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789708603.241900:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 207 00000100:00100000:3.0:1789708603.243183:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.243217:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357107968 00000100:00100000:2.0:1789708603.243226:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357107968 00000100:00100000:2.0:1789708603.243254:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:2.0:1789708603.243278:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+7:2397:x1876645357107968:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708603.243286:0:8397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.243297:0:8397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db08 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e24c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708603.243313:0:8397:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708603.243326:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=174s v=(0 0) 00010000:00010000:2.0:1789708603.243329:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708603.243335:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e24c expref: 8 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.243350:0:8397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e24c expref: 8 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.243361:0:8397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebcc00, rc 0) 00000100:00100000:2.0:1789708603.243393:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2397:x1876645357107968:12345-192.168.201.52@tcp:101:bash.0 Request processed in 132us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.243398:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:3.0:1789708603.244213:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.244250:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357108096 00000100:00100000:0.0:1789708603.244255:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357108096 00000100:00100000:0.0:1789708603.244303:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:0.0:1789708603.244315:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+8:12403:x1876645357108096:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708603.244324:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.244334:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e253 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.244362:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e24c expref: 9 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.244369:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708603.244372:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708603.244377:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 9 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.244416:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e24c expref: 9 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.244445:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e24c expref: 9 pid: 8397 timeout: 274 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.244459:0:8399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8399:1876645365513216:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708603.244538:0:8399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708603.245218:0:8399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8399:1876645365513216:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708603.245235:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 9 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.245247:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1000, rc 0) 00000100:00100000:0.0:1789708603.245302:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+9:12403:x1876645357108096:12345-192.168.201.52@tcp:101:bash.0 Request processed in 991us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.245310:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:3.0:1789708603.245430:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.245478:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357108224 00000100:00100000:2.0:1789708603.245484:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357108224 00010000:00010000:2.0:1789708603.245504:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e24c expref: 9 pid: 8397 timeout: 274 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.245532:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:2.0:1789708603.245540:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+9:2396:x1876645357108224:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708603.245556:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708603.245570:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e24c expref: 9 pid: 8397 timeout: 274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.245583:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e24c expref: 9 pid: 8397 timeout: 274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.245610:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db08 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e24c expref: 9 pid: 8397 timeout: 274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.245621:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708603.245624:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708603.245629:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 8 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.245637:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 8 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.245661:0:6469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 8 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.245671:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6469:1876645365513344:192.168.201.52@tcp:105: 00000100:00100000:2.0:1789708603.245719:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708603.246415:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6469:1876645365513344:192.168.201.52@tcp:105: 00010000:00010000:2.0:1789708603.246424:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708603.246450:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357108224:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 912us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.246455:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:3.0:1789708603.246767:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.246817:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357108480 00000100:00100000:1.0:1789708603.246821:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357108480 00000100:00100000:1.0:1789708603.246852:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:1.0:1789708603.246857:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+41:12403:x1876645357108480:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:1.0:1789708603.247020:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+42:12403:x1876645357108480:12345-192.168.201.52@tcp:35:bash.0 Request processed in 162us (254us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789708603.247025:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:3.0:1789708603.296537:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.296616:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357108608 00000100:00100000:2.0:1789708603.296627:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357108608 00000100:00100000:2.0:1789708603.296681:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 208 00000100:00100000:2.0:1789708603.296692:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+42:12419:x1876645357108608:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708603.296728:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.296748:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e25a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.296810:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47db1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.296824:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47db1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.296833:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47db1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708603.296867:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789708603.296869:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708603.296883:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47db1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.296901:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e25a expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.296913:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47db1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e25a expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.296933:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:2.0:1789708603.296935:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708603.296938:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd400, rc 0) 00000100:00100000:2.0:1789708603.296979:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+43:12419:x1876645357108608:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 291us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.296985:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 208 00000100:00100000:3.0:1789708603.298399:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.298427:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357108864 00000100:00100000:2.0:1789708603.298431:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357108864 00000100:00100000:2.0:1789708603.298454:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 209 00000100:00100000:2.0:1789708603.298459:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+43:12419:x1876645357108864:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708603.298466:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.298474:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e261 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.298541:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.298552:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e245 expref: 44 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.298561:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db2b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.298591:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e245 expref: 44 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.298614:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e245 expref: 44 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.298634:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365513472:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708603.298696:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708603.299339:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365513472:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708603.299354:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.299537:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.299563:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357108992 00000100:00100000:2.0:1789708603.299567:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357108992 00010000:00010000:2.0:1789708603.299581:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e245 expref: 45 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.299615:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:2.0:1789708603.299622:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+45:2395:x1876645357108992:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708603.299632:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708603.299638:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e245 expref: 45 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.299651:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e245 expref: 45 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.299666:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949200/0xf45f43947e47dafa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e245 expref: 45 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.299676:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bed08847b00) 00010000:00010000:2.0:1789708603.299680:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.299694:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.299701:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db2b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.299727:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708603.299751:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.299759:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+44:2395:x1876645357108992:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 135us (220us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708603.299760:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.299776:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 98 00000004:00200000:0.0:1789708603.299785:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789708603.299858:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e261 expref: 45 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.299866:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e261 expref: 44 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.299879:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bed08847b00) 00010000:00010000:0.0:1789708603.299881:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789708603.299883:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebda00, rc 0) 00000100:00100000:0.0:1789708603.299907:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+44:12419:x1876645357108864:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1447us (1510us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789708603.299912:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 209 00000100:00100000:3.0:1789708603.301226:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.301288:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357109248 00000100:00100000:0.0:1789708603.301295:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357109248 00000100:00100000:0.0:1789708603.301332:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 210 00000100:00100000:0.0:1789708603.301338:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+44:12419:x1876645357109248:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708603.301348:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.301349:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789708603.301358:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e261 expref: 44 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.301366:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bed08847b00) 00010000:00010000:0.0:1789708603.301371:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708603.301379:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47db39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e268 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.301420:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47db40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.301426:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47db40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.301430:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47db40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708603.301442:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789708603.301479:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47db39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e268 expref: 46 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.301488:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47db40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e268 expref: 45 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.301492:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205dd00) 00010000:00010000:0.0:1789708603.301494:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789708603.301495:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1e00, rc 0) 00000100:00100000:0.0:1789708603.301520:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+45:12419:x1876645357109248:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 183us (300us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789708603.301524:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 210 00000100:00100000:3.0:1789708603.303314:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.303342:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357109376 00000100:00100000:0.0:1789708603.303346:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357109376 00000100:00100000:0.0:1789708603.303371:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 211 00000100:00100000:0.0:1789708603.303377:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+45:12419:x1876645357109376:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708603.303385:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.303392:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47db4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e26f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.303417:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47db4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e26f expref: 46 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.303427:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47db4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e26f expref: 46 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.303456:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205dd00) 00010000:00010000:0.0:1789708603.303459:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708603.303462:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708603.303493:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+46:12419:x1876645357109376:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 116us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.303500:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 211 00000100:00100000:3.0:1789708603.305011:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.305048:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357109504 00000100:00100000:2.0:1789708603.305053:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357109504 00000100:00100000:2.0:1789708603.305084:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:2.0:1789708603.305089:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+8:2397:x1876645357109504:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:2.0:1789708603.305111:0:9145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.305123:0:9145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 8 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.305129:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708603.305132:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708603.305135:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.305154:0:9145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 8 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.305172:0:9145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 8 pid: 8399 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.305182:0:9145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9145:1876645365513600:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708603.305229:0:9145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708603.305901:0:9145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9145:1876645365513600:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708603.305918:0:9145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.306130:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.306169:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357109632 00000100:00100000:2.0:1789708603.306174:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357109632 00002000:00100000:2.0:1789708603.306200:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9bed09ab1500 x1876645357109632/t0(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:744/0 lens 504/0 e 0 to 0 dl 1789708614 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789708603.306208:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bed09ab1500 with x1876645357109632 ext(0->8) 00010000:00010000:2.0:1789708603.306214:0:8404:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 9 pid: 8399 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.306226:0:8404:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 9 pid: 8399 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708603.306232:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bed09ab1500 00000100:00100000:2.0:1789708603.306287:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:2.0:1789708603.306296:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+9:2395:x1876645357109632:12345-192.168.201.52@tcp:4:lfs.0 00000100:00100000:2.0:1789708603.306811:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+11:2395:x1876645357109632:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 515us (680us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789708603.306820:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00002000:00100000:2.0:1789708603.306828:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9bed09ab1500 x1876645357109632/t4294967309(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:744/0 lens 504/448 e 0 to 0 dl 1789708614 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789708603.306836:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bed09ab1500 with x1876645357109632 ext(0->8) 00010000:00010000:2.0:1789708603.306843:0:8404:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 11 pid: 8399 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.306857:0:8404:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 11 pid: 8399 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708603.306865:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bed09ab1500 00000100:00100000:3.0:1789708603.307522:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.307557:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357109760 00000100:00100000:2.0:1789708603.307563:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357109760 00010000:00010000:2.0:1789708603.307584:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 11 pid: 8399 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.307626:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:2.0:1789708603.307635:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+11:2397:x1876645357109760:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708603.307647:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789708603.307657:0:6470:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789708603.307660:0:6470:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789708603 00002000:00010000:2.0:1789708603.307662:0:6470:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789708603 00002000:00010000:2.0:1789708603.307664:0:6470:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789708603 00002000:00010000:2.0:1789708603.307673:0:6470:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789708603.307679:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 11 pid: 8399 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.307689:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 11 pid: 8399 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.307708:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47db0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e253 expref: 11 pid: 8399 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.307726:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708603.307730:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708603.307735:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.307744:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.307770:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708603.307804:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+10:2397:x1876645357109760:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 171us (281us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708603.307810:0:9145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.307814:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 99 00010000:00010000:0.0:1789708603.307826:0:9145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.307846:0:9145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.307852:0:9145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.307857:0:9145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.307863:0:9145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebcc00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708603.307866:0:9145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.307882:0:9145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.307890:0:9145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.307895:0:9145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c20c0700/0xf45f43947e47db55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.307930:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+9:2397:x1876645357109504:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 2840us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.307935:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1789708603.308526:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.308554:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357110016 00000100:00100000:2.0:1789708603.308559:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357110016 00000100:00100000:2.0:1789708603.308590:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:2.0:1789708603.308610:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10256c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+46:12419:x1876645357110016:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:2.0:1789708603.308644:0:14125:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47db40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e268 expref: 46 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708603.308746:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967472 00000001:00080000:2.0:1789708603.308766:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000001:00080000:2.0:1789708603.308992:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00010000:00010000:2.0:1789708603.309023:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.309037:0:14125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47db4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e26f expref: 50 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.309045:0:14125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.309069:0:14125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47db4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e26f expref: 50 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.309080:0:14125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47db4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e26f expref: 50 pid: 6483 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.309092:0:14125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14125:1876645365513728:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708603.309142:0:14125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708603.309765:0:14125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14125:1876645365513728:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708603.309778:0:14125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.309921:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.309948:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357110144 00000100:00100000:0.0:1789708603.309952:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357110144 00010000:00010000:0.0:1789708603.309966:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47db4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e26f expref: 51 pid: 6483 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.309986:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:0.0:1789708603.309991:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee40ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+51:2396:x1876645357110144:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708603.309999:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708603.310003:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47db4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e26f expref: 51 pid: 6483 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.310009:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47db4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e26f expref: 51 pid: 6483 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.310027:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47db4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e26f expref: 51 pid: 6483 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.310034:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205dd00) 00010000:00010000:0.0:1789708603.310037:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.310042:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.310046:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.310059:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708603.310077:0:14125:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.310081:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee40ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+50:2396:x1876645357110144:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.310095:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 100 00010000:00010000:2.0:1789708603.310096:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708603.310151:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000001:00080000:2.0:1789708603.310234:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1789708603.310323:0:14125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365513856:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789708603.310368:0:14125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708603.310391:0:14125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708603.310404:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365513856 00000100:00100000:1.0:1789708603.310408:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365513856 00000100:00100000:1.0:1789708603.310440:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789708603.310446:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0855df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14125:x1876645365513856:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00080000:3.0:1789708603.310450:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708603.310499:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0855df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14125:x1876645365513856:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 54us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.310504:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789708603.310534:0:14125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365513856:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1789708603.310646:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:2.0:1789708603.310680:0:14125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365513984:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789708603.310712:0:14125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708603.310733:0:14125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708603.310746:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365513984 00000100:00100000:1.0:1789708603.310750:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365513984 00000100:00100000:1.0:1789708603.310768:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789708603.310772:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14125:x1876645365513984:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789708603.310837:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:14125:x1876645365513984:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 64us (125us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789708603.310841:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789708603.310873:0:14125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14125:1876645365513984:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1789708603.310902:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967478 00010000:00010000:2.0:1789708603.310923:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.310931:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.310937:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.310943:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebde00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.310947:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.310953:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.310973:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205dd00) 00010000:00010000:2.0:1789708603.310976:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789708603.310980:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.310986:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db5c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789708603.311052:0:14125:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789708603.311100:0:14125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789708603.311109:0:14125:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 174120847881ns, next at 175120845644ns, rc = 0 00000001:00080000:2.0:1789708603.311114:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967479 00010000:00010000:2.0:1789708603.311132:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205dd00) 00010000:00010000:2.0:1789708603.311135:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789708603.311139:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47db40 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e268 expref: 54 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.311194:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10256c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+53:12419:x1876645357110016:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 2587us (2667us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789708603.311202:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000020:00080000:2.0:1789708603.311207:0:14125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789708603.311823:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.311852:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357110272 00000100:00100000:0.0:1789708603.311857:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357110272 00000100:00100000:0.0:1789708603.311883:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 212 00000100:00100000:0.0:1789708603.311887:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+53:12419:x1876645357110272:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708603.311896:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.311907:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47db63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e276 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.311932:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47db63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e276 expref: 54 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.311949:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47db63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e276 expref: 54 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.311960:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708603.311962:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708603.311963:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0e00, rc 0) 00000100:00100000:0.0:1789708603.311986:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+54:12419:x1876645357110272:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 98us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.311991:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 212 00000100:00100000:3.0:1789708603.312852:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.312906:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357110528 00000100:00100000:1.0:1789708603.312911:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357110528 00000100:00100000:1.0:1789708603.312936:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:1.0:1789708603.312941:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+54:12419:x1876645357110528:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789708603.313052:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+55:12419:x1876645357110528:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 109us (199us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789708603.313060:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:3.0:1789708603.338110:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.338160:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357110656 00000100:00100000:2.0:1789708603.338171:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357110656 00000100:00100000:2.0:1789708603.338232:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 213 00000100:00100000:2.0:1789708603.338243:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+55:12429:x1876645357110656:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:2.0:1789708603.338360:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db6a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338393:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338404:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338416:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338423:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338439:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338507:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338515:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338522:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708603.338566:0:8421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338579:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338585:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db6a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338631:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338637:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebde00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.338641:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338649:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338661:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:2.0:1789708603.338664:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.338669:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338675:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338693:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338699:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338705:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338710:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebcc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.338713:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338729:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338738:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee4205da00) 00010000:00010000:2.0:1789708603.338740:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.338743:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338749:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338760:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338765:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338771:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338776:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebda00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.338779:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338785:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338791:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708603.338793:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.338796:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.338810:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.338881:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+55:12429:x1876645357110656:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 639us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.338889:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 213 00000100:00100000:3.0:1789708603.352252:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.352325:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357110912 00000100:00100000:2.0:1789708603.352335:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357110912 00000100:00100000:2.0:1789708603.352392:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 214 00000100:00100000:2.0:1789708603.352401:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+55:12432:x1876645357110912:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708603.352421:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.352439:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e27d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352529:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db86 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352543:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352554:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352566:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352574:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352592:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352720:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352729:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352736:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708603.352746:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789708603.352825:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352834:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db86 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352841:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352847:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebcc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.352851:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352858:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352869:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:2.0:1789708603.352872:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.352884:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352891:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47db86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352904:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352910:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352916:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352921:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebde00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.352924:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352930:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352937:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee4205da00) 00010000:00010000:2.0:1789708603.352940:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.352943:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352949:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47db8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.352981:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47db7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e27d expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.353007:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e27d expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.353014:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708603.353017:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708603.353019:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc000, rc 0) 00000100:00100000:2.0:1789708603.353074:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+57:12432:x1876645357110912:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 673us (828us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789708603.353081:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 214 00000100:00100000:3.0:1789708603.354059:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.354097:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357111040 00000100:00100000:2.0:1789708603.354103:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357111040 00000100:00100000:2.0:1789708603.354138:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 215 00000100:00100000:2.0:1789708603.354147:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+57:12432:x1876645357111040:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:2.0:1789708603.354179:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dba2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.354188:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.354194:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.354208:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.354212:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dba2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.354223:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.354226:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebdc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.354228:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.354232:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dba2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.354238:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708603.354240:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708603.354242:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dba2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.354246:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dba2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.354316:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+57:12432:x1876645357111040:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 170us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.354324:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 215 00000100:00100000:3.0:1789708603.354970:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.355016:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357111296 00000100:00100000:2.0:1789708603.355021:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357111296 00000100:00100000:2.0:1789708603.355059:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:2.0:1789708603.355065:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+57:12432:x1876645357111296:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789708603.355189:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+58:12432:x1876645357111296:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 123us (220us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789708603.355195:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:3.0:1789708603.380275:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.380342:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357111552 00000100:00100000:0.0:1789708603.380353:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357111552 00000100:00100000:0.0:1789708603.380406:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 216 00000100:00100000:0.0:1789708603.380416:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+58:12442:x1876645357111552:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708603.380438:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.380441:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789708603.380478:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47db1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e25a expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.380495:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:0.0:1789708603.380500:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708603.380513:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dba9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e284 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.380626:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.380655:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e27d expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.380663:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.380697:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e27d expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.380710:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e27d expref: 58 pid: 6512 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.380724:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365514112:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708603.380809:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708603.381671:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365514112:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708603.381698:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.381824:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.381871:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357111680 00000100:00100000:1.0:1789708603.381876:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357111680 00010000:00010000:1.0:1789708603.381896:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e27d expref: 59 pid: 6512 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.381918:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:1.0:1789708603.381924:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+59:2395:x1876645357111680:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708603.381931:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708603.381935:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e27d expref: 59 pid: 6512 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.381943:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e27d expref: 59 pid: 6512 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.381953:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47db94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e27d expref: 59 pid: 6512 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.381960:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:1.0:1789708603.381963:0:7427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.381968:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.381973:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.381993:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708603.382019:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+58:2395:x1876645357111680:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 95us (196us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708603.382021:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.382028:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 101 00010000:00010000:0.0:1789708603.382034:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708603.382045:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789708603.382128:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dba9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e284 expref: 59 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.382146:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e284 expref: 58 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.382151:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708603.382153:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789708603.382155:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0200, rc 0) 00000100:00100000:0.0:1789708603.382180:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+58:12442:x1876645357111552:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1767us (1928us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789708603.382186:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 216 00000100:00100000:3.0:1789708603.382995:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.383032:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357111808 00000100:00100000:0.0:1789708603.383039:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357111808 00000100:00100000:0.0:1789708603.383071:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 217 00000100:00100000:0.0:1789708603.383079:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+58:12442:x1876645357111808:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708603.383091:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.383102:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dbbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e28b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.383119:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.383126:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.383131:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.383186:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dbbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e28b expref: 60 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.383199:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e28b expref: 59 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.383204:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708603.383206:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708603.383207:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1600, rc 0) 00000100:00100000:0.0:1789708603.383234:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+59:12442:x1876645357111808:12345-192.168.201.52@tcp:101:bash.0 Request processed in 158us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.383238:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 217 00000100:00100000:3.0:1789708603.384009:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.384059:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357112064 00000100:00100000:0.0:1789708603.384063:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357112064 00000100:00100000:0.0:1789708603.384088:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 218 00000100:00100000:0.0:1789708603.384093:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+59:12442:x1876645357112064:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:0.0:1789708603.384193:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.384200:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.384205:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789708603.384232:0:13656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000004:00010000:0.0:1789708603.384245:0:13656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057345ca7 reply state 00000000b01c0a23 transno 4294967486 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.384252:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.384278:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708603.384280:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708603.384282:0:13656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708603.384324:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+62:12442:x1876645357112064:12345-192.168.201.52@tcp:36:bash.0 Request processed in 231us (318us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789708603.384330:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 218 00000020:00080000:0.0:1789708603.384333:0:13656:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789708603.385022:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.385067:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357112192 00000100:00100000:2.0:1789708603.385073:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357112192 00000100:00100000:2.0:1789708603.385105:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 219 00000100:00100000:2.0:1789708603.385113:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+62:12442:x1876645357112192:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708603.385124:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.385132:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dbd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e292 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.385177:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.385189:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e284 expref: 63 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.385198:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.385224:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e284 expref: 63 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.385236:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e284 expref: 63 pid: 6485 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.385247:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8421:1876645365514240:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708603.385327:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789708603.385952:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8421:1876645365514240:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708603.385967:0:8421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.386095:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.386137:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357112320 00000100:00100000:1.0:1789708603.386141:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357112320 00010000:00010000:1.0:1789708603.386156:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e284 expref: 64 pid: 6485 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.386175:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:1.0:1789708603.386180:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+64:2396:x1876645357112320:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708603.386188:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708603.386192:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e284 expref: 64 pid: 6485 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.386199:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e284 expref: 64 pid: 6485 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.386209:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dbb0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e284 expref: 64 pid: 6485 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.386216:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:1.0:1789708603.386219:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.386223:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.386234:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.386247:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708603.386279:0:8421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.386288:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.386289:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+63:2396:x1876645357112320:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 108us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.386302:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 102 00000004:00200000:2.0:1789708603.386322:0:8421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789708603.386327:0:8421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708603.386341:0:8421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.386364:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dbd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e292 expref: 63 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.386377:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e292 expref: 62 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.386384:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708603.386388:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708603.386390:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebda00, rc 0) 00000100:00100000:2.0:1789708603.386420:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+62:12442:x1876645357112192:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1308us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.386428:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 219 00000100:00100000:3.0:1789708603.387185:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708603.387225:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357112576 00000100:00100000:1.0:1789708603.387229:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357112576 00000100:00100000:1.0:1789708603.387257:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:1.0:1789708603.387279:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+62:12442:x1876645357112576:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:1.0:1789708603.387360:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+63:12442:x1876645357112576:12345-192.168.201.52@tcp:35:bash.0 Request processed in 82us (175us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789708603.387365:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1789708603.408758:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.408871:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357112704 00000100:00100000:2.0:1789708603.408881:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357112704 00000100:00100000:2.0:1789708603.408937:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 220 00000100:00100000:2.0:1789708603.408948:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+63:12448:x1876645357112704:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708603.408980:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.409013:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dbe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e299 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.409073:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47dbe8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.409086:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47dbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.409096:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47dbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708603.409141:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789708603.409144:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708603.409162:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47dbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.409185:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47dbe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e299 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.409201:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47dbe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e299 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.409208:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:2.0:1789708603.409212:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708603.409215:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebde00, rc 0) 00000100:00100000:2.0:1789708603.409305:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+64:12448:x1876645357112704:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 358us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.409314:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 220 00000100:00100000:3.0:1789708603.412027:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.412060:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357112832 00000100:00100000:2.0:1789708603.412071:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357112832 00000100:00100000:2.0:1789708603.412101:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 221 00000100:00100000:2.0:1789708603.412106:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+64:12448:x1876645357112832:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708603.412115:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.412124:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47dbef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2a0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412163:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47dbf6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412173:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47dbf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412179:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47dbf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412186:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47dbfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412190:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47dbfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412194:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47dbfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412254:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412276:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412281:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708603.412308:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789708603.412310:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708603.412319:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412327:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412332:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47dbf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412343:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47dbf6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412348:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47dbf6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412351:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.412354:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47dbf6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412359:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47dbf6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412365:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:2.0:1789708603.412367:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.412370:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47dbf6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412374:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47dbf6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412388:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47dbfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412392:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47dbfd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412395:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47dbfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412398:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708603.412400:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47dbfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412403:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47dbfd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412407:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee4205da00) 00010000:00010000:2.0:1789708603.412408:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708603.412410:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47dbfd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412413:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47dbfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412427:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47dbef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a0 expref: 66 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412434:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a0 expref: 65 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.412445:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708603.412446:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708603.412448:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4600, rc 0) 00000100:00100000:2.0:1789708603.412483:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+65:12448:x1876645357112832:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 375us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.412490:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 221 00000100:00100000:3.0:1789708603.413370:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.413402:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357112960 00000100:00100000:2.0:1789708603.413407:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357112960 00000100:00100000:2.0:1789708603.413440:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1789708603.413445:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+65:2398:x1876645357112960:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708603.413452:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708603.413466:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a0 expref: 65 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.413475:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708603.413478:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708603.413502:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+64:2398:x1876645357112960:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 58us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.413507:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789708603.413702:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.413743:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357113216 00000100:00100000:0.0:1789708603.413749:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357113216 00000100:00100000:0.0:1789708603.413790:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 222 00000100:00100000:0.0:1789708603.413798:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+64:12448:x1876645357113216:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708603.413807:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.413817:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dc0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2a7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.413886:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.413898:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e292 expref: 65 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.413905:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.413928:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e292 expref: 65 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.413937:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e292 expref: 65 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.413952:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365514368:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708603.414000:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708603.414726:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365514368:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708603.414744:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.414910:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.414950:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357113344 00000100:00100000:2.0:1789708603.414955:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357113344 00010000:00010000:2.0:1789708603.414980:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e292 expref: 66 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.415005:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:2.0:1789708603.415012:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+66:2396:x1876645357113344:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708603.415028:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708603.415034:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e292 expref: 66 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.415045:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e292 expref: 66 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.415058:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47dbda lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e292 expref: 66 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.415068:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708603.415071:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.415079:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.415086:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.415105:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708603.415129:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.415131:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+65:2396:x1876645357113344:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 119us (221us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708603.415145:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.415147:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 103 00000004:00200000:0.0:1789708603.415159:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789708603.415229:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dc0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a7 expref: 66 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.415239:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a7 expref: 65 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.415244:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708603.415246:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789708603.415247:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708603.415294:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+65:12448:x1876645357113216:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1497us (1592us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1789708603.415299:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 222 00000100:00100000:3.0:1789708603.416373:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708603.416416:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357113600 00000100:00100000:2.0:1789708603.416422:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357113600 00000100:00100000:2.0:1789708603.416461:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:2.0:1789708603.416468:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+65:12448:x1876645357113600:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:2.0:1789708603.416488:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708603.416502:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47db63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e276 expref: 65 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.416515:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708603.416519:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708603.416547:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+64:12448:x1876645357113600:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 79us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.416554:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1789708603.417197:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.417234:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357113728 00000100:00100000:0.0:1789708603.417243:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357113728 00000100:00100000:0.0:1789708603.417297:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 223 00000100:00100000:0.0:1789708603.417307:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+64:12448:x1876645357113728:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:0.0:1789708603.417377:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.417385:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.417390:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708603.417456:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789708603.417505:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+64:12448:x1876645357113728:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 201us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.417510:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 223 00000100:00100000:3.0:1789708603.418163:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708603.418193:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357113856 00000100:00100000:0.0:1789708603.418198:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357113856 00000100:00100000:0.0:1789708603.418224:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 224 00000100:00100000:0.0:1789708603.418229:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+64:12448:x1876645357113856:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708603.418236:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708603.418244:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dc27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2ae expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.418286:0:13656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.418296:0:13656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dc27 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ae expref: 65 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.418321:0:13656:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.418333:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dc27 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ae expref: 65 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.418352:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708603.418354:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708603.418358:0:13656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dc27 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ae expref: 65 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.418366:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0200, rc 0) 00000100:00100000:0.0:1789708603.418393:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+65:12448:x1876645357113856:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 164us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.418398:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 224 00000040:00080000:2.0:1789708603.814842:0:13756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789708604.006419:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708604.006526:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708604.006531:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708604.006574:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 6 00000040:00080000:2.0:1789708604.006604:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789708604.006748:0:13754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365514496:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708604.006844:0:13754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789708604.007943:0:13754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365514496:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789708604.008242:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.008295:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357113984 00000100:00100000:2.0:1789708604.008302:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357113984 00000100:00100000:2.0:1789708604.008362:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 225 00000100:00080000:3.0:1789708604.008363:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708604.008374:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+65:12449:x1876645357113984:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789708604.008406:0:8421:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789708604.008489:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+65:12449:x1876645357113984:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 118us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708604.008498:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 225 00000100:00100000:3.0:1789708604.009369:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.009415:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357114112 00000100:00100000:2.0:1789708604.009420:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357114112 00000100:00100000:2.0:1789708604.009451:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 226 00000100:00100000:2.0:1789708604.009458:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+65:12449:x1876645357114112:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789708604.009508:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc2e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009524:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009535:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009552:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dc35 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009559:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dc35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009565:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dc35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009597:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009607:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009614:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708604.009641:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789708604.009651:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708604.009665:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009676:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009682:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc2e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009689:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc2e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009694:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708604.009699:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc2e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009706:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc2e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009717:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:2.0:1789708604.009720:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708604.009725:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009731:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dc2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009742:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dc35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009748:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dc35 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009764:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dc35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009769:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708604.009772:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dc35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009778:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dc35 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009786:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9bee2c76ce00) 00010000:00010000:2.0:1789708604.009788:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708604.009791:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dc35 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009796:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dc35 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009810:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009817:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009822:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009827:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708604.009829:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009844:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009852:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708604.009854:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708604.009857:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.009863:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.009908:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+65:12449:x1876645357114112:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 450us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708604.009915:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 226 00000100:00100000:3.0:1789708604.011025:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.011077:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357114368 00000100:00100000:2.0:1789708604.011083:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357114368 00000100:00100000:2.0:1789708604.011123:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 227 00000100:00100000:2.0:1789708604.011130:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+65:12449:x1876645357114368:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708604.011143:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708604.011154:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47dc43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2b5 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011217:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47dc4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011228:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47dc4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011236:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47dc4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708604.011252:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789708604.011353:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47dc4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011361:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47dc4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011366:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47dc4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011372:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708604.011375:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47dc4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011382:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47dc4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011391:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708604.011394:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789708604.011397:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47dc4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011402:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47dc4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011433:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47dc43 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2b5 expref: 67 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011443:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:2.0:1789708604.011445:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708604.011456:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47dc43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2b5 expref: 67 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.011465:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4c00, rc 0) 00000100:00100000:2.0:1789708604.011503:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+66:12449:x1876645357114368:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 372us (479us total) trans 4294967489 rc 301/301 00000100:00100000:2.0:1789708604.011509:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 227 00000100:00100000:3.0:1789708604.012404:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.012456:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357114496 00000100:00100000:0.0:1789708604.012462:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357114496 00000100:00100000:0.0:1789708604.012497:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 228 00000100:00100000:0.0:1789708604.012505:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+66:12449:x1876645357114496:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789708604.012525:0:6485:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708604.012601:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+66:12449:x1876645357114496:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 97us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.012606:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 228 00000100:00100000:3.0:1789708604.013595:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.013631:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357114752 00000100:00100000:0.0:1789708604.013636:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357114752 00000100:00100000:0.0:1789708604.013662:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 229 00000100:00100000:0.0:1789708604.013689:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+66:12449:x1876645357114752:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708604.013698:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708604.013700:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789708604.013714:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47dbe8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e299 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.013724:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:0.0:1789708604.013727:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708604.013734:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dc58 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2bc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789708604.014037:0:6483:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1789708604.014151:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47dc5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.014161:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47dc5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.014168:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47dc5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.014203:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dc58 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2bc expref: 68 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.014216:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47dc5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2bc expref: 67 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.014223:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bee4205d100) 00010000:00010000:0.0:1789708604.014225:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708604.014233:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1e00, rc 0) 00000100:00100000:0.0:1789708604.014330:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+67:12449:x1876645357114752:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 641us (774us total) trans 4294967490 rc 0/0 00000100:00100000:0.0:1789708604.014338:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 229 00000100:00100000:3.0:1789708604.015490:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.015521:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357115008 00000100:00100000:0.0:1789708604.015526:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357115008 00000100:00100000:0.0:1789708604.015555:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 230 00000100:00100000:0.0:1789708604.015563:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+67:12449:x1876645357115008:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789708604.015599:0:13656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708604.015609:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47dc5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2bc expref: 67 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015618:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bee4205d100) 00010000:00010000:0.0:1789708604.015624:0:13656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708604.015633:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dc6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015639:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dc6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015644:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dc6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015689:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dc74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xecf6a698 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015696:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dc74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xecf6a698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015703:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dc74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xecf6a698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015736:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dc6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015742:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dc6d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015749:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dc6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015754:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708604.015758:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dc6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015765:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dc6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015784:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:0.0:1789708604.015786:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708604.015789:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dc6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015793:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dc6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015799:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dc74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xecf6a698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015802:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dc74 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xecf6a698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015806:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dc74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xecf6a698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015814:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708604.015816:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dc74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xecf6a698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015820:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dc74 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xecf6a698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015825:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xecf6a698 (ffff9bee4205dc00) 00010000:00010000:0.0:1789708604.015826:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708604.015828:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dc74 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xecf6a698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.015835:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dc74 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xecf6a698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.015871:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+66:12449:x1876645357115008:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 309us (383us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708604.015875:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 230 00000100:00100000:2.0:1789708604.016505:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708604.016554:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357115136 00000100:00100000:1.0:1789708604.016560:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357115136 00000100:00100000:1.0:1789708604.016603:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 231 00000100:00100000:1.0:1789708604.016612:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+66:12449:x1876645357115136:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708604.016622:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708604.016633:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47dc7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2c3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.016654:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.016663:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.016680:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.016745:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948800/0xf45f43947e47dc7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2c3 expref: 68 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.016758:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2c3 expref: 67 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.016766:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:1.0:1789708604.016769:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789708604.016771:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948000, rc 0) 00000100:00100000:1.0:1789708604.016804:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+67:12449:x1876645357115136:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 193us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708604.016815:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 231 00000100:00100000:3.0:1789708604.017631:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.017680:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357115392 00000100:00100000:2.0:1789708604.017685:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357115392 00000100:00100000:2.0:1789708604.017722:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 232 00000100:00100000:2.0:1789708604.017731:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+67:12449:x1876645357115392:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789708604.017772:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.017782:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.017790:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708604.017903:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789708604.017912:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 174827650906ns, next at 175827648665ns, rc = 0 00000004:00010000:2.0:1789708604.017947:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d394b56c reply state 0000000075b3cdff transno 4294967491 ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.017958:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.017965:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708604.017975:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789708604.017979:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708604.018033:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+69:12449:x1876645357115392:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 302us (402us total) trans 4294967491 rc 0/0 00000100:00100000:2.0:1789708604.018040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 232 00000100:00100000:3.0:1789708604.018670:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.018709:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357115520 00000100:00100000:2.0:1789708604.018714:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357115520 00000100:00100000:2.0:1789708604.018749:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 233 00000100:00100000:2.0:1789708604.018757:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+69:12449:x1876645357115520:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708604.018768:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708604.018778:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2ca expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.018807:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ca expref: 70 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.018817:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ca expref: 70 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.018831:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708604.018834:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708604.018837:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5a00, rc 0) 00000100:00100000:2.0:1789708604.018879:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+70:12449:x1876645357115520:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 122us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708604.018886:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 233 00000100:00100000:1.0:1789708604.019945:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.019990:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357115648 00000100:00100000:2.0:1789708604.019995:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357115648 00000100:00100000:2.0:1789708604.020040:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00080000:3.0:1789708604.020044:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708604.020069:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+9:2395:x1876645357115648:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789708604.020192:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+10:2395:x1876645357115648:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 125us (249us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789708604.020200:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:3.0:1789708604.020987:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.021021:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357115904 00000100:00100000:2.0:1789708604.021026:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357115904 00000100:00100000:2.0:1789708604.021061:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:2.0:1789708604.021069:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+70:12449:x1876645357115904:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789708604.021186:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+71:12449:x1876645357115904:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 117us (199us total) trans 4294967492 rc 0/0 00000100:00100000:2.0:1789708604.021194:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:3.0:1789708604.021838:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.021877:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357116160 00000100:00100000:0.0:1789708604.021882:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357116160 00000100:00100000:0.0:1789708604.021915:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 234 00000100:00100000:0.0:1789708604.021921:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+71:12449:x1876645357116160:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789708604.021965:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+71:12449:x1876645357116160:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 44us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.021969:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 234 00000100:00100000:1.0:1789708604.022669:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.022714:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357116288 00000100:00100000:0.0:1789708604.022719:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357116288 00000100:00100000:0.0:1789708604.022762:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 235 00000100:00100000:0.0:1789708604.022770:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+71:12449:x1876645357116288:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708604.022779:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708604.022794:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dc97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2d1 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.022840:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47dc9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.022851:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47dc9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.022860:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47dc9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708604.022886:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708604.022899:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47dc9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.022919:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dc97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d1 expref: 73 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.022933:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47dc9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d1 expref: 72 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.022941:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:0.0:1789708604.022943:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789708604.022946:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0c00, rc 0) 00000100:00100000:0.0:1789708604.022975:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+72:12449:x1876645357116288:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 206us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.022990:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 235 00000100:00100000:3.0:1789708604.023872:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.023911:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357116416 00000100:00100000:0.0:1789708604.023916:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357116416 00000100:00100000:0.0:1789708604.023949:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:0.0:1789708604.023958:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+10:2396:x1876645357116416:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708604.023967:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708604.023980:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ec84eb/0xf45f43947e47dca5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2d8 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708604.023998:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacc93b, blocks: 0x0 00010000:00010000:0.0:1789708604.024010:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=174s v=(0 0) 00010000:00010000:0.0:1789708604.024014:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708604.024022:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ec84eb/0xf45f43947e47dca5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d8 expref: 11 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.024032:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ec84eb/0xf45f43947e47dca5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d8 expref: 11 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.024041:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0800, rc 0) 00000100:00100000:0.0:1789708604.024072:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+11:2396:x1876645357116416:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 116us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.024078:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:3.0:1789708604.024814:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.024847:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357116672 00000100:00100000:0.0:1789708604.024852:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357116672 00000100:00100000:0.0:1789708604.024879:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 236 00000100:00100000:0.0:1789708604.024886:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+72:12449:x1876645357116672:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789708604.024937:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+72:12449:x1876645357116672:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 52us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.024942:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 236 00000100:00100000:1.0:1789708604.025710:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.025757:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357116800 00000100:00100000:0.0:1789708604.025763:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357116800 00000100:00100000:0.0:1789708604.025795:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:0.0:1789708604.025802:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+11:12449:x1876645357116800:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708604.025809:0:9145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708604.025819:0:9145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2df expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.025840:0:9145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ec84eb/0xf45f43947e47dca5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d8 expref: 12 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.025849:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708604.025852:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708604.025857:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 12 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.025883:0:9145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2ec84eb/0xf45f43947e47dca5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d8 expref: 12 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.025896:0:9145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2ec84eb/0xf45f43947e47dca5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d8 expref: 12 pid: 8399 timeout: 274 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.025909:0:9145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9145:1876645365514624:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708604.025974:0:9145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708604.026637:0:9145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9145:1876645365514624:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708604.026655:0:9145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 12 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.026676:0:9145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1800, rc 0) 00000100:00100000:0.0:1789708604.026707:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+12:12449:x1876645357116800:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 905us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.026713:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:1.0:1789708604.026814:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.026851:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357116928 00000100:00100000:0.0:1789708604.026857:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357116928 00010000:00010000:0.0:1789708604.026875:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ec84eb/0xf45f43947e47dca5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d8 expref: 12 pid: 8399 timeout: 274 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.026901:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:0.0:1789708604.026909:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+12:2395:x1876645357116928:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708604.026919:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708604.026933:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2ec84eb/0xf45f43947e47dca5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d8 expref: 12 pid: 8399 timeout: 274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.026945:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2ec84eb/0xf45f43947e47dca5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d8 expref: 12 pid: 8399 timeout: 274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.026960:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ec84eb/0xf45f43947e47dca5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d8 expref: 12 pid: 8399 timeout: 274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.026983:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708604.026987:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708604.026994:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 11 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.027003:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 11 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.027024:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 11 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.027034:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:8413:1876645365514752:192.168.201.52@tcp:105: 00000100:00100000:0.0:1789708604.027073:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708604.027649:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:8413:1876645365514752:192.168.201.52@tcp:105: 00010000:00010000:0.0:1789708604.027659:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708604.027685:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+11:2395:x1876645357116928:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 777us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.027692:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:3.0:1789708604.028250:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.028309:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357117056 00000100:00100000:2.0:1789708604.028314:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357117056 00002000:00100000:2.0:1789708604.028342:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9bed0a225880 x1876645357117056/t0(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:745/0 lens 504/0 e 0 to 0 dl 1789708615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789708604.028350:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bed0a225880 with x1876645357117056 ext(0->12) 00002000:00010000:2.0:1789708604.028353:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bed0a225880 00000100:00100000:2.0:1789708604.028367:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1789708604.028372:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68824747-448a-469b-b2cf-e27bc037ded7+11:2396:x1876645357117056:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789708604.028893:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68824747-448a-469b-b2cf-e27bc037ded7+13:2396:x1876645357117056:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 520us (644us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789708604.028898:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00002000:00100000:2.0:1789708604.028903:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9bed0a225880 x1876645357117056/t4294967321(0) o4->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:745/0 lens 504/448 e 0 to 0 dl 1789708615 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789708604.028917:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bed0a225880 with x1876645357117056 ext(0->12) 00002000:00010000:2.0:1789708604.028920:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bed0a225880 00000100:00100000:1.0:1789708604.029519:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.029555:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357117184 00000100:00100000:2.0:1789708604.029560:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357117184 00000100:00100000:2.0:1789708604.029602:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 237 00000100:00100000:2.0:1789708604.029611:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+72:12449:x1876645357117184:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789708604.030679:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967492 is committed 00000004:00080000:3.0:1789708604.030690:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:0.0:1789708604.030708:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.030718:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708604.030723:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:0.0:1789708604.030726:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.030741:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708604.030746:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.030754:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708604.030756:0:6463:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bed07e3e9c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789708604.030768:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bed084ab900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bed07e3e780 00000020:00080000:3.0:1789708604.030775:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bed084abf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bed098b1c00 00010000:00010000:0.0:1789708604.030775:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bee08f48d00) 00010000:00010000:0.0:1789708604.030782:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708604.030787:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.030794:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509200/0xf45f43947e47d9bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.030822:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.030829:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.030837:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.030841:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708604.030841:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365515008:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1789708604.030843:0:6463:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bed07e20f00 refcount 2 committed 0 result 0 batchid 6 00010000:00010000:0.0:1789708604.030849:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc1a211b0) 00000020:00080000:3.0:1789708604.030852:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee2f7b6e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bed07e20240 00010000:00010000:0.0:1789708604.030855:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708604.030857:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee2f7b6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bed0a202400 00000100:00100000:2.0:1789708604.030858:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365514880:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789708604.030871:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708604.030877:0:6463:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1789708604.030893:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bee2c76c600) 00000100:00100000:1.0:1789708604.030898:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708604.030899:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1789708604.030900:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00010000:00010000:0.0:1789708604.030905:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.030913:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508000/0xf45f43947e47da52 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.030934:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708604.030934:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708604.030942:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789708604.030944:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708604.030949:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1789708604.030951:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708604.030952:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365515136:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789708604.030963:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0600 already unused, calling callback (ffffffffc1a211b0) 00000100:00100000:3.0:1789708604.030968:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365515008 00010000:00010000:0.0:1789708604.030968:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708604.030974:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365515008 00010000:00010000:0.0:1789708604.030976:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.030987:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee4205da00) 00000100:00100000:1.0:1789708604.030988:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708604.030994:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708604.030998:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031005:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dad0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708604.031019:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365514880 00000100:00100000:3.0:1789708604.031025:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365514880 00000100:00100000:1.0:1789708604.031029:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365515136 00010000:00010000:0.0:1789708604.031031:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031042:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.031043:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+24:12449:x1876645357117184:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 1428us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708604.031044:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365515136 00010000:00010000:0.0:1789708604.031059:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.031060:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 237 00000100:00100000:3.0:1789708604.031068:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1789708604.031071:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708604.031076:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708604.031083:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee048f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3617:x1876645365515008:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789708604.031085:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708604.031091:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1789708604.031102:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee4205da00) 00000100:00100000:1.0:1789708604.031105:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365514880:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789708604.031106:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:3.0:1789708604.031108:0:10054:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1789708604.031112:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031120:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949a00/0xf45f43947e47daf3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8421 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789708604.031128:0:8397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1789708604.031136:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708604.031139:0:10054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aacc93b, atime: 0x6aacc93b, ctime: 0x6aacc93b, blocks: 0x8 00010000:00010000:1.0:1789708604.031144:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.031148:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1789708604.031154:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.031155:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47dcb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.031160:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3608a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1876645365515136:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789708604.031169:0:8397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47da60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e230 expref: 12 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031176:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.031186:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789708604.031194:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708604.031194:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708604.031200:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.031202:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031217:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031229:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:3.0:1789708604.031230:0:10054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=174s v=(0 0) 00010000:00010000:0.0:1789708604.031233:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:2.0:1789708604.031236:0:8398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00010000:00010000:3.0:1789708604.031237:0:10054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708604.031238:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708604.031243:0:8398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789708603 00010000:00010000:3.0:1789708604.031252:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47dcb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708604.031252:0:8398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1789708604.031252:0:8397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47da60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e230 expref: 12 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031254:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dbcc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708604.031285:0:8398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789708603 -> 1789708603 00002000:00010000:2.0:1789708604.031293:0:8398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789708604.031303:0:8397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47da60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e230 expref: 12 pid: 9145 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.031309:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47dcb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031311:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708604.031319:0:8397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8397:1876645365515264:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708604.031332:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.031337:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3608a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3617:x1876645365515136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (347us total) trans 4294967322 rc 0/0 00010000:00010000:0.0:1789708604.031355:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.031356:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1789708604.031359:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47dcb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031373:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4800 already unused, calling callback (ffffffffc1a211b0) 00000100:00100000:1.0:1789708604.031377:0:8397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9240 going to sleep for 11 seconds 00010000:00010000:3.0:1789708604.031378:0:10054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47dcb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031378:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789708604.031390:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789708604.031399:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.031412:0:10054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789708604.031414:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bed0a2edc00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789708604.031422:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365515136:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789708604.031425:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:0.0:1789708604.031430:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789708604.031434:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.031441:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47dc89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.031452:0:10362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708604.031465:0:10362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47dcb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.031473:0:10362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708604.031477:0:10362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47dcb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.031485:0:10362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47dcb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.031500:0:10362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47dcb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.031507:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47dcb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.031527:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708604.031529:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708604.031532:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789708604.031556:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bee048f2d80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1789708604.031562:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365515008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789708604.031575:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee048f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3617:x1876645365515008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 497us (677us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789708604.031597:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789708604.032201:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.032240:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357117312 00000100:00100000:2.0:1789708604.032246:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357117312 00000100:00100000:2.0:1789708604.032311:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:2.0:1789708604.032319:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+13:2397:x1876645357117312:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789708604.032395:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.032398:0:8397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8397:1876645365515264:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708604.032418:0:8397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.032434:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357117440 00000100:00100000:0.0:1789708604.032440:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357117440 00010000:00010000:0.0:1789708604.032463:0:7427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47da60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e230 expref: 14 pid: 9145 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.032494:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:0.0:1789708604.032504:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee40ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+14:2395:x1876645357117440:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708604.032514:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708604.032520:0:7427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47da60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e230 expref: 14 pid: 9145 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.032532:0:7427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47da60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e230 expref: 14 pid: 9145 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.032548:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c68189d/0xf45f43947e47da60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e230 expref: 14 pid: 9145 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.032569:0:7427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708604.032572:0:7427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708604.032576:0:7427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.032597:0:7427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.032621:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708604.032633:0:8397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.032640:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.032647:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.032652:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.032657:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee40ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+13:2395:x1876645357117440:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 153us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.032666:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 105 00010000:00010000:2.0:1789708604.032670:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708604.032709:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708604.032717:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.032728:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708604.032732:0:7426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.032769:0:7426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.032772:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3615:x1876645365514880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1669us (1838us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789708604.032790:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1789708604.032795:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.032806:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6549a28/0xf45f43947e47dcba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.032828:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708604.032831:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789708604.032832:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bed09946680/2, rc 0, transno 4294967323 00010000:00010000:1.0:1789708604.032834:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708604.032842:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365514880:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789708604.033746:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1789708604.033752:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1789708604.033830:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+7:2397:x1876645357117312:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 1511us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708604.033837:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:3.0:1789708604.034838:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.034878:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357117696 00000100:00100000:2.0:1789708604.034895:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357117696 00000100:00100000:2.0:1789708604.034938:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 238 00000100:00100000:2.0:1789708604.034946:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+21:12449:x1876645357117696:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789708604.035001:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708604.035019:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47dc9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2d1 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.035032:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708604.035036:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708604.035056:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.035065:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.035071:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708604.035144:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df8b3d25 reply state 0000000044ac95c8 transno 4294967493 ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.035152:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.035156:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708604.035158:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789708604.035160:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708604.035223:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+22:12449:x1876645357117696:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 278us (388us total) trans 4294967493 rc 0/0 00000100:00100000:2.0:1789708604.035228:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 238 00000100:00100000:1.0:1789708604.036044:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.036079:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357117824 00000100:00100000:2.0:1789708604.036083:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357117824 00000100:00100000:2.0:1789708604.036107:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:2.0:1789708604.036111:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+7:2396:x1876645357117824:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789708604.036180:0:8399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789708604.036184:0:8399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789708603 -> 1789708603 00002000:00010000:2.0:1789708604.036187:0:8399:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789708603 00002000:00010000:2.0:1789708604.036189:0:8399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789708603 -> 1789708603 00002000:00010000:2.0:1789708604.036191:0:8399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789708604.036222:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357117824:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 110us (179us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789708604.036227:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:3.0:1789708604.037046:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.037077:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357118080 00000100:00100000:2.0:1789708604.037082:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357118080 00000100:00100000:2.0:1789708604.037108:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:2.0:1789708604.037113:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+22:12449:x1876645357118080:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789708604.037142:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.037151:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2c3 expref: 22 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.037164:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.037189:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2c3 expref: 22 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.037209:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2c3 expref: 22 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.037218:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365515392:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708604.037280:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789708604.038105:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1876645365515392:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708604.038123:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708604.038304:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708604.038340:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357118208 00000100:00100000:1.0:1789708604.038346:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357118208 00010000:00010000:1.0:1789708604.038373:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2c3 expref: 23 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708604.038407:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:1.0:1789708604.038417:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+23:2395:x1876645357118208:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708604.038429:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708604.038436:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2c3 expref: 23 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.038448:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2c3 expref: 23 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.038477:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948000/0xf45f43947e47dc82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2c3 expref: 23 pid: 8421 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.038487:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:1.0:1789708604.038491:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.038499:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.038506:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.038535:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708604.038595:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68824747-448a-469b-b2cf-e27bc037ded7+22:2395:x1876645357118208:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 168us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708604.038604:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 106 00010000:00010000:2.0:1789708604.038715:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.038724:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.038756:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.038764:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.038770:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.038776:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708604.038780:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.038798:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.038808:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708604.038811:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789708604.038815:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.038821:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4600/0xf45f43947e47dcc8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.038863:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+21:12449:x1876645357118080:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 1748us (1818us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789708604.038872:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:3.0:1789708604.040041:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.040104:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357118336 00000100:00100000:0.0:1789708604.040113:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357118336 00000100:00100000:0.0:1789708604.040157:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:0.0:1789708604.040167:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357118336:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789708604.040204:0:9145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.040223:0:9145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.040231:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708604.040244:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708604.040249:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.040306:0:9145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 8 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.040323:0:9145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 8 pid: 9145 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.040344:0:9145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9145:1876645365515520:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708604.040410:0:9145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18a68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708604.041472:0:9145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9145:1876645365515520:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708604.041495:0:9145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708604.041579:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.041628:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357118464 00000100:00100000:2.0:1789708604.041634:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357118464 00010000:00010000:2.0:1789708604.041663:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 9 pid: 9145 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.041698:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:2.0:1789708604.041708:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a227b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+9:2396:x1876645357118464:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708604.041721:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708604.041746:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 9 pid: 9145 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.041766:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 9 pid: 9145 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.041801:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038233ea1/0xf45f43947e47dcac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2df expref: 9 pid: 9145 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.041816:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708604.041820:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708604.041825:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.041834:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.041858:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708604.041882:0:9145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.041893:0:9145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.041903:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a227b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357118464:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 195us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708604.041913:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 107 00010000:00010000:0.0:1789708604.041919:0:9145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.041929:0:9145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.041946:0:9145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.041954:0:9145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708604.041958:0:9145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.041967:0:9145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.041980:0:9145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.041988:0:9145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47dccf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.042042:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:2396:x1876645357118336:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 1876us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.042051:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:3.0:1789708604.042695:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.042731:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357118720 00000100:00100000:0.0:1789708604.042736:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357118720 00000100:00100000:0.0:1789708604.042784:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 240 00000100:00100000:0.0:1789708604.042792:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+21:12449:x1876645357118720:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789708604.042851:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.042873:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e28b expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.042882:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.042907:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e28b expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.042919:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e28b expref: 21 pid: 6483 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.042938:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365515648:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708604.042992:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18a68f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708604.043686:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365515648:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708604.043698:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708604.043834:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.043868:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357118848 00000100:00100000:2.0:1789708604.043873:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357118848 00010000:00010000:2.0:1789708604.043896:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e28b expref: 22 pid: 6483 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.043930:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:2.0:1789708604.043938:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+22:2396:x1876645357118848:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708604.043948:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708604.043954:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e28b expref: 22 pid: 6483 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.043977:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e28b expref: 22 pid: 6483 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.043989:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47dbc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e28b expref: 22 pid: 6483 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.043999:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:2.0:1789708604.044003:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dc27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ae expref: 21 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.044009:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.044013:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.044018:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.044032:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708604.044046:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.044053:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.044061:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68824747-448a-469b-b2cf-e27bc037ded7+21:2396:x1876645357118848:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 122us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708604.044068:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 108 00010000:00010000:0.0:1789708604.044214:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.044226:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc90 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ca expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.044239:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.044288:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ca expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.044300:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ca expref: 21 pid: 6484 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.044308:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365515776:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708604.044355:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708604.044927:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365515776:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708604.044940:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708604.045143:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.045175:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357118976 00000100:00100000:2.0:1789708604.045180:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357118976 00010000:00010000:2.0:1789708604.045198:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ca expref: 22 pid: 6484 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.045234:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:2.0:1789708604.045241:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a225f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+22:2395:x1876645357118976:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708604.045253:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708604.045285:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ca expref: 22 pid: 6484 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.045296:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ca expref: 22 pid: 6484 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.045311:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47dc90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ca expref: 22 pid: 6484 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.045322:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708604.045326:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.045334:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.045341:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.045357:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708604.045373:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.045379:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.045383:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a225f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68824747-448a-469b-b2cf-e27bc037ded7+21:2395:x1876645357118976:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 141us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708604.045393:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 109 00000001:00080000:0.0:1789708604.045437:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000001:00080000:0.0:1789708604.045533:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00000001:00080000:0.0:1789708604.045560:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00000100:00100000:0.0:1789708604.045626:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1876645365515904:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789708604.045678:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708604.045695:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f1dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708604.045733:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365515904 00000100:00100000:1.0:1789708604.045739:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365515904 00000100:00100000:1.0:1789708604.045778:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789708604.045788:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6485:x1876645365515904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789708604.045868:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6485:x1876645365515904:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708604.045877:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789708604.045882:0:6485:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1789708604.045888:0:6485:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1789708604.045916:0:6485:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bed0a2edc00, transno 4294967322 00000100:00100000:0.0:1789708604.045929:0:6485:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9bed09946680 x1876645365514880/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789708620 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708604.045937:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1876645365515904:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789708604.046015:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00000100:00100000:0.0:1789708604.046041:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1876645365516032:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789708604.046064:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708604.046078:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708604.046102:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365516032 00000100:00100000:1.0:1789708604.046107:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365516032 00000100:00100000:1.0:1789708604.046133:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789708604.046141:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6485:x1876645365516032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789708604.046233:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6485:x1876645365516032:12345-0@lo:1000:mdt00_002.0 Request processed in 93us (167us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789708604.046241:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789708604.046271:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1876645365516032:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789708604.046291:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046297:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046302:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046306:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708604.046309:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046313:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046319:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:0.0:1789708604.046321:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708604.046329:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046335:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dcdd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046354:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046360:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046366:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046372:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708604.046375:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046382:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046390:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708604.046393:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708604.046397:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dc27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ae expref: 24 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046407:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dc27 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ae expref: 24 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046415:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dc27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ae expref: 24 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.046441:0:6485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dc27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ae expref: 24 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.046448:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365516160:192.168.201.52@tcp:105: 00000100:00100000:0.0:1789708604.046479:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708604.047249:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1876645365516160:192.168.201.52@tcp:105: 00010000:00010000:0.0:1789708604.047300:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047308:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dc20 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047329:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dce4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047339:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dce4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047347:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dce4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047355:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dce4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047362:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dce4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047368:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dce4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708604.047376:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:0.0:1789708604.047389:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708604.047393:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dce4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047400:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dce4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047411:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00000100:00100000:1.0:1789708604.047412:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357119104 00010000:00010000:0.0:1789708604.047417:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708604.047418:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357119104 00010000:00010000:0.0:1789708604.047422:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dce4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047431:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47dce4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047445:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708604.047447:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1789708604.047458:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+25:12448:x1876645357119104:12345-192.168.201.52@tcp:49:lfs.0 00010000:00010000:0.0:1789708604.047458:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047470:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047476:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708604.047479:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047486:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.047508:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708604.047511:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708604.047514:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708604.047520:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+25:12448:x1876645357119104:12345-192.168.201.52@tcp:49:lfs.0 Request processed in 64us (146us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708604.047526:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dcd6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708604.047530:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:0.0:1789708604.047645:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+24:12449:x1876645357118720:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 4852us (4947us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789708604.047655:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 240 00000020:00080000:0.0:1789708604.047659:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789708604.047690:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708604.047696:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708604.048041:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:2.0:1789708604.048053:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789708604.048205:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.048242:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357119360 00000100:00100000:0.0:1789708604.048248:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357119360 00000100:00100000:0.0:1789708604.048306:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:0.0:1789708604.048317:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+24:12448:x1876645357119360:12345-192.168.201.52@tcp:58:lfs.0 00000100:00100000:3.0:1789708604.048382:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000040:00080000:0.0:1789708604.048400:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789708604.048408:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357119616 00000100:00100000:2.0:1789708604.048413:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357119616 00000100:00100000:2.0:1789708604.048438:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:2.0:1789708604.048448:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10255c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+25:12449:x1876645357119616:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789708604.048453:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+25:12448:x1876645357119360:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 136us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.048464:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 241 00000004:00080000:2.0:1789708604.048565:0:14125:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789708604.048600:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00010000:00010000:2.0:1789708604.048617:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.048624:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.048629:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.048634:0:14125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.048638:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.048641:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708604.048654:0:14125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708604.048673:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708604.048679:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.048685:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708604.048688:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.048695:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10255c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+26:12449:x1876645357119616:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 249us (312us total) trans 4294967500 rc 0/0 00010000:00010000:1.0:1789708604.048695:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708604.048702:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00010000:00010000:1.0:1789708604.048705:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:1.0:1789708604.048708:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000020:00080000:2.0:1789708604.048711:0:14125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789708604.048711:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.048717:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5200/0xf45f43947e47dceb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708604.048737:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708604.048740:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708604.048741:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708604.058972:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.059020:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357119744 00000100:00100000:0.0:1789708604.059029:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357119744 00000100:00100000:0.0:1789708604.059071:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 242 00000100:00100000:0.0:1789708604.059078:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+26:12451:x1876645357119744:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708604.059096:0:13656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708604.059110:0:13656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dcf2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2e6 expref: -99 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059166:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dcf9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059176:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059184:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059194:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dd00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059198:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dd00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059202:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dd00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059307:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059315:0:13656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a7 expref: 27 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059321:0:13656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059343:0:13656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a7 expref: 27 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.059361:0:13656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a7 expref: 27 pid: 6485 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.059375:0:13656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13656:1876645365516288:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708604.059459:0:13656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708604.060270:0:13656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13656:1876645365516288:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708604.060283:0:13656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708604.060390:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708604.060456:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357120000 00000100:00100000:1.0:1789708604.060461:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357120000 00000100:00100000:1.0:1789708604.060494:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:1.0:1789708604.060502:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+28:6153:x1876645357120000:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789708604.060644:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+29:6153:x1876645357120000:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 144us (255us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789708604.060650:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:3.0:1789708604.061238:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.061291:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357120128 00000100:00100000:0.0:1789708604.061295:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357120128 00010000:00010000:0.0:1789708604.061310:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a7 expref: 29 pid: 6485 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.061329:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:0.0:1789708604.061333:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a343100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+29:2396:x1876645357120128:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708604.061340:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708604.061344:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a7 expref: 29 pid: 6485 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.061352:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a7 expref: 29 pid: 6485 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.061365:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dc12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2a7 expref: 29 pid: 6485 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.061382:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708604.061385:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.061389:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.061393:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708604.061407:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708604.061428:0:13656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061437:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708604.061438:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a343100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:68824747-448a-469b-b2cf-e27bc037ded7+28:2396:x1876645357120128:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 100us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.061451:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 110 00000004:00200000:3.0:1789708604.061467:0:13656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789708604.061471:0:13656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708604.061483:0:13656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061491:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061497:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061501:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dcf9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061506:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061511:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708604.061513:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061518:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dcf9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061524:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:3.0:1789708604.061531:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708604.061534:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dcf9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061567:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47dcf9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061575:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dd00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061579:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dd00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061598:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dd00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061601:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708604.061603:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dd00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061607:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dd00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061612:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bee4205d300) 00010000:00010000:3.0:1789708604.061614:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708604.061616:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dd00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061619:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47dd00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061638:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dcf2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2e6 expref: 28 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061654:0:13656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2e6 expref: 27 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708604.061659:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:3.0:1789708604.061661:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708604.061662:0:13656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0600, rc 0) 00000100:00100000:3.0:1789708604.061685:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+27:12451:x1876645357119744:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 2608us (2723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708604.061689:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 242 00000100:00100000:3.0:1789708604.128485:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708604.128523:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.128538:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357120256 00000100:00100000:3.0:1789708604.128548:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708604.128551:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357120256 00000100:00100000:3.0:1789708604.128577:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708604.128593:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357120384 00000100:00100000:1.0:1789708604.128599:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357120384 00000100:00100000:2.0:1789708604.128620:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357120640 00000100:00100000:0.0:1789708604.128620:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 345 00000100:00100000:3.0:1789708604.128625:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.128627:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357120640 00000100:00100000:0.0:1789708604.128633:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:2398:x1876645357120256:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708604.128647:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357120512 00000100:00100000:1.0:1789708604.128652:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357120512 00000100:00100000:3.0:1789708604.128657:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.128660:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357120768 00000100:00100000:2.0:1789708604.128664:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357120768 00000100:00100000:1.0:1789708604.128688:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357120896 00000100:00100000:1.0:1789708604.128691:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357120896 00000100:00100000:2.0:1789708604.128701:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:3.0:1789708604.128709:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708604.128711:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+7:2397:x1876645357120640:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708604.128721:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357121024 00000100:00100000:1.0:1789708604.128727:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357121024 00000100:00100000:2.0:1789708604.128748:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+7:2397:x1876645357120640:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 38us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708604.128754:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:0.0:1789708604.128758:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:098f9bc4-0284-4f29-9497-0447ce008685+13:2398:x1876645357120256:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 124us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708604.128764:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:1.0:1789708604.128771:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+27:2397:x1876645357120384:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708604.128776:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 345 00000100:00100000:2.0:1789708604.128790:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1789708604.128800:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+9:2398:x1876645357120768:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708604.128822:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+27:2397:x1876645357120384:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 56us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.128828:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:2.0:1789708604.128834:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68824747-448a-469b-b2cf-e27bc037ded7+9:2398:x1876645357120768:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708604.128838:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:0.0:1789708604.128844:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357120512:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708604.128851:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:1.0:1789708604.128865:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:1.0:1789708604.128875:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357120896:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708604.128883:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+5:2398:x1876645357120512:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 44us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.128891:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:1.0:1789708604.128913:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2397:x1876645357120896:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 39us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708604.128929:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:0.0:1789708604.128943:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:0.0:1789708604.128954:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357121024:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:1.0:1789708604.128962:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789708604.128969:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708604.128972:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708604.129015:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2398:x1876645357121024:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 64us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.129020:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 139 00000040:00080000:3.0:1789708604.360161:0:14711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708604.360168:0:14711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708604.360219:0:14711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:3.0:1789708604.360232:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789708605.030398:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708605.094507:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708605.094516:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708605.094556:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:2.0:1789708605.094599:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789708605.094727:0:13754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2edc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365516416:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708605.094833:0:13754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789708605.095956:0:13754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2edc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13754:1876645365516416:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789708605.096141:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708605.096290:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357121152 00000100:00100000:1.0:1789708605.096298:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357121152 00000100:00100000:1.0:1789708605.096352:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 243 00000100:00100000:1.0:1789708605.096362:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+27:12463:x1876645357121152:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789708605.096389:0:8421:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789708605.096472:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+27:12463:x1876645357121152:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 107us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.096481:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 243 00000100:00100000:3.0:1789708605.097461:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708605.097509:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357121408 00000100:00100000:1.0:1789708605.097515:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357121408 00000100:00100000:1.0:1789708605.097552:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 244 00000100:00100000:1.0:1789708605.097559:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+27:12463:x1876645357121408:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708605.097584:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708605.097604:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47dd0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2ed expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.097679:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47dd15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.097694:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47dd15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.097704:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47dd15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708605.097726:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789708605.097826:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e948e00/0xf45f43947e47dd0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ed expref: 30 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.097843:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47dd15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ed expref: 29 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.097851:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:1.0:1789708605.097854:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708605.097857:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949600, rc 0) 00000100:00100000:1.0:1789708605.097889:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+29:12463:x1876645357121408:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 330us (429us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789708605.097896:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 244 00000100:00100000:0.0:1789708605.098959:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708605.099000:0:7427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357121536 00000100:00100000:1.0:1789708605.099006:0:7427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357121536 00000100:00100000:1.0:1789708605.099041:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:1.0:1789708605.099048:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+29:2397:x1876645357121536:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708605.099058:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708605.099074:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949600/0xf45f43947e47dd15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ed expref: 29 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.099085:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:1.0:1789708605.099088:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708605.099115:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68824747-448a-469b-b2cf-e27bc037ded7+28:2397:x1876645357121536:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 67us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.099123:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:3.0:1789708605.099346:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708605.099379:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357121792 00000100:00100000:1.0:1789708605.099384:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357121792 00000100:00100000:1.0:1789708605.099415:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 245 00000100:00100000:1.0:1789708605.099425:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+28:12463:x1876645357121792:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789708605.099465:0:13656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47dd23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.099476:0:13656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47dd23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.099485:0:13656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47dd23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.099592:0:13656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47dd23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.099601:0:13656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47dd23 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.099608:0:13656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47dd23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.099614:0:13656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708605.099619:0:13656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47dd23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.099626:0:13656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47dd23 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.099636:0:13656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:1.0:1789708605.099638:0:13656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789708605.099649:0:13656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47dd23 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.099656:0:13656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949e00/0xf45f43947e47dd23 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708605.099737:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+29:12463:x1876645357121792:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 314us (390us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789708605.099753:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 245 00000040:00080000:2.0:1789708605.099797:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708605.099801:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708605.100135:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 7 00000040:00080000:2.0:1789708605.100151:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789708605.100335:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708605.100370:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357122048 00000100:00100000:2.0:1789708605.100374:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357122048 00000100:00100000:2.0:1789708605.100404:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:2.0:1789708605.100414:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+29:12463:x1876645357122048:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789708605.100506:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+30:12463:x1876645357122048:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 95us (171us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789708605.100512:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:3.0:1789708605.286485:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365516544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789708605.286590:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708605.286664:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365516544 00000100:00100000:1.0:1789708605.286673:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365516544 00000100:00100000:1.0:1789708605.286729:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789708605.286750:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365516544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708605.286783:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789708605.286830:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365516544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.286842:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789708605.286882:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365516544:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789708605.635875:0:14762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708605.635883:0:14762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708605.635931:0:14762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:1.0:1789708605.635943:0:14762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789708605.682833:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708605.682865:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357122304 00000100:00100000:0.0:1789708605.682872:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357122304 00000100:00100000:0.0:1789708605.682921:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 246 00000100:00100000:0.0:1789708605.682930:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+30:12483:x1876645357122304:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708605.682951:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708605.682968:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dd2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2f4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.683059:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47dd31 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.683069:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47dd31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.683080:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47dd31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708605.683088:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789708605.683187:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47dd2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2f4 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.683200:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47dd31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2f4 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.683213:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708605.683216:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789708605.683219:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1e00, rc 0) 00000100:00100000:0.0:1789708605.683288:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68824747-448a-469b-b2cf-e27bc037ded7+32:12483:x1876645357122304:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 359us (460us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789708605.683295:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 246 00000100:00100000:0.0:1789708605.684356:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708605.684375:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357122432 00000100:00100000:0.0:1789708605.684379:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357122432 00000100:00100000:0.0:1789708605.684404:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 247 00000100:00100000:0.0:1789708605.684412:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+32:12483:x1876645357122432:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789708605.684436:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dd3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.684444:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dd3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.684450:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dd3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.684463:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dd3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.684468:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dd3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.684473:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dd3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.684486:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708605.684490:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dd3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.684495:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dd3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.684503:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:0.0:1789708605.684505:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708605.684508:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dd3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.684512:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0400/0xf45f43947e47dd3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708605.684547:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68824747-448a-469b-b2cf-e27bc037ded7+32:12483:x1876645357122432:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 138us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708605.684564:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 247 00000100:00100000:3.0:1789708605.715970:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708605.716030:0:9145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357122560 00000100:00100000:0.0:1789708605.716041:0:9145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357122560 00000100:00100000:0.0:1789708605.716096:0:9145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:0.0:1789708605.716106:0:9145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+7:2395:x1876645357122560:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1789708605.716122:0:9145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708605.716141:0:9145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47dd46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e2fb expref: -99 pid: 9145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708605.716163:0:9145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aacc93b, atime: 0x6aacc93b, ctime: 0x6aacc93b, blocks: 0x8 00010000:00010000:0.0:1789708605.716182:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=176s v=(0 0) 00010000:00010000:0.0:1789708605.716197:0:9145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708605.716206:0:9145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47dd46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2fb expref: 8 pid: 9145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.716224:0:9145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47dd46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2fb expref: 8 pid: 9145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.716238:0:9145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0400, rc 0) 00000100:00100000:0.0:1789708605.716319:0:9145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68824747-448a-469b-b2cf-e27bc037ded7+8:2395:x1876645357122560:12345-192.168.201.52@tcp:101:cat.0 Request processed in 213us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708605.716328:0:9145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:1.0:1789708605.717591:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708605.717629:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357122688 00000100:00100000:2.0:1789708605.717633:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357122688 00002000:00100000:2.0:1789708605.717658:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9bed0a2f3800 x1876645357122688/t0(0) o3->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:746/0 lens 488/0 e 0 to 0 dl 1789708616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789708605.717666:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bed0a2f3800 with x1876645357122688 ext(0->4095) 00002000:00010000:2.0:1789708605.717669:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bed0a2f3800 00000100:00100000:2.0:1789708605.717691:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789708605.717698:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357122688:12345-192.168.201.52@tcp:3:cat.0 00000100:00100000:2.0:1789708605.717817:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68824747-448a-469b-b2cf-e27bc037ded7+8:2396:x1876645357122688:12345-192.168.201.52@tcp:3:cat.0 Request processed in 120us (228us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789708605.717823:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00002000:00100000:2.0:1789708605.717828:0:8404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9bed0a2f3800 x1876645357122688/t0(0) o3->68824747-448a-469b-b2cf-e27bc037ded7@192.168.201.52@tcp:746/0 lens 488/4536 e 0 to 0 dl 1789708616 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789708605.717834:0:8404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bed0a2f3800 with x1876645357122688 ext(0->4095) 00002000:00010000:2.0:1789708605.717836:0:8404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bed0a2f3800 00010000:00010000:0.0:1789708606.054364:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708606.310549:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365516800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708606.310623:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708606.310646:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365516672:0@lo:400:kworker.0 00000100:00100000:3.0:1789708606.310668:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365517056:0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.310692:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365517312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708606.310696:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708606.310711:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708606.310742:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365517184:0@lo:400:kworker.0 00000100:00100000:3.0:1789708606.310743:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365517568:0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.310746:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708606.310763:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365516928:0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.310778:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365517824:0@lo:400:kworker.0 00000100:00100000:3.0:1789708606.310787:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708606.310810:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708606.310814:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708606.310818:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365518080:0@lo:400:kworker.0 00000100:00100000:0.0:1789708606.310829:0:13774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365516800 00000100:00100000:0.0:1789708606.310837:0:13774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365516800 00000100:00100000:3.0:1789708606.310842:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708606.310852:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365518336:0@lo:400:kworker.0 00000100:00100000:2.0:1789708606.310862:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365517440:0@lo:400:kworker.0 00000100:00100000:3.0:1789708606.310872:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365518592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708606.310878:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708606.310901:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708606.310904:0:13774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365517312 00000100:00100000:3.0:1789708606.310910:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708606.310910:0:13774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365517312 00000100:00100000:2.0:1789708606.310928:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365517952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708606.310929:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365518592 00000100:00100000:3.0:1789708606.310935:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708606.310935:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365518592 00000100:00100000:0.0:1789708606.310944:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789708606.310945:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365518208:0@lo:400:kworker.0 00000100:00100000:2.0:1789708606.310953:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708606.310960:0:13774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365516800:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708606.310965:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365517952 00000100:00100000:2.0:1789708606.310970:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365518464:0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.310970:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365517952 00000100:00100000:3.0:1789708606.310978:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789708606.310993:0:13774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789708606.310999:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789708606.311000:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708606.311012:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1876645365517312:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708606.311015:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365517056 00000100:00100000:3.0:1789708606.311019:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365517056 00002000:00000024:1.0:1789708606.311034:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789708606.311040:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365517824 00000100:00100000:2.0:1789708606.311045:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365517824 00000100:00100000:3.0:1789708606.311056:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365517440 00000100:00100000:0.0:1789708606.311058:0:13774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365516800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708606.311061:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365517440 00000100:00100000:0.0:1789708606.311071:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789708606.311076:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365518080 00000100:00100000:1.0:1789708606.311077:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1876645365517312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708606.311080:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365518080 00000100:00100000:3.0:1789708606.311087:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789708606.311089:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789708606.311100:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789708606.311101:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365517056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.311117:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789708606.311121:0:13774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3615:x1876645365518592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708606.311126:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365518464 00000100:00100000:2.0:1789708606.311130:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365518464 00000100:00100000:1.0:1789708606.311131:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876645365517952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789708606.311136:0:13774:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789708606.311147:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789708606.311148:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365517056:12345-0@lo:400:kworker.0 Request processed in 53us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708606.311152:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789708606.311161:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789708606.311165:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1876645365517824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708606.311182:0:13774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3615:x1876645365518592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708606.311187:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789708606.311197:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789708606.311198:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365517440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.311198:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876645365517952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708606.311208:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1876645365517824:12345-0@lo:400:kworker.0 Request processed in 45us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708606.311209:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789708606.311220:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789708606.311227:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365517568 00000100:00100000:0.0:1789708606.311232:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365517568 00000100:00100000:2.0:1789708606.311238:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789708606.311240:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365516672 00000100:00100000:1.0:1789708606.311246:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365516672 00000100:00100000:2.0:1789708606.311247:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365518080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708606.311256:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365517440:12345-0@lo:400:kworker.0 Request processed in 59us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708606.311283:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789708606.311299:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789708606.311306:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789708606.311307:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee1811a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3616:x1876645365516672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708606.311314:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365518080:12345-0@lo:400:kworker.0 Request processed in 66us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708606.311315:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3618:x1876645365518464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708606.311317:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365516928 00000100:00100000:0.0:1789708606.311323:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365516928 00000100:00100000:2.0:1789708606.311332:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789708606.311350:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee1811a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3616:x1876645365516672:12345-0@lo:400:kworker.0 Request processed in 43us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708606.311356:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3618:x1876645365518464:12345-0@lo:400:kworker.0 Request processed in 43us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708606.311360:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789708606.311362:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365518336 00000100:00100000:3.0:1789708606.311365:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789708606.311368:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365518336 00000100:00100000:3.0:1789708606.311391:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365518208 00000100:00100000:2.0:1789708606.311393:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365517440:0@lo:400:kworker.0 00000100:00100000:3.0:1789708606.311397:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365518208 00000100:00100000:0.0:1789708606.311398:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789708606.311412:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789708606.311415:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365517568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708606.311427:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365517952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708606.311427:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365516928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708606.311434:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789708606.311444:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365518464:0@lo:400:kworker.0 00000100:00100000:3.0:1789708606.311445:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365518336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708606.311468:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365517568:12345-0@lo:400:kworker.0 Request processed in 58us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708606.311477:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789708606.311481:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365516928:12345-0@lo:400:kworker.0 Request processed in 57us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708606.311484:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365518336:12345-0@lo:400:kworker.0 Request processed in 42us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708606.311489:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789708606.311491:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365516928:0@lo:400:kworker.0 00000100:00100000:3.0:1789708606.311494:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789708606.311501:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789708606.311511:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365518208:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789708606.311516:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789708606.311522:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789708606.311526:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708606.311529:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708606.311534:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708606.311569:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365518080:0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.311569:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365517824:0@lo:400:kworker.0 00000100:00100000:0.0:1789708606.311580:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365518208:12345-0@lo:400:kworker.0 Request processed in 70us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708606.311588:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365518592:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789708606.311588:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2ec380 x1876645365518336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708606.311590:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365517696:0@lo:400:kworker.0 00000100:00100000:0.0:1789708606.311592:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789708606.311602:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365517056:0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.311605:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365518336:0@lo:400:kworker.0 00000100:00100000:0.0:1789708606.311616:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365517184 00000100:00100000:3.0:1789708606.311617:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365517568:0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.311621:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365516800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708606.311623:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365517184 00000100:00100000:2.0:1789708606.311630:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708606.311638:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365517312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708606.311659:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365517696 00000100:00100000:3.0:1789708606.311661:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365518208:0@lo:400:kworker.0 00000100:00100000:0.0:1789708606.311665:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365517696 00000100:00100000:2.0:1789708606.311671:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365516672:0@lo:400:kworker.0 00000100:00100000:3.0:1789708606.311693:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789708606.311705:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365517184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.311721:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789708606.311730:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365517696:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789708606.311741:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708606.311749:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365517184:12345-0@lo:400:kworker.0 Request processed in 48us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708606.311755:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365517184:0@lo:400:kworker.0 00000100:00100000:1.0:1789708606.311765:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365517696:12345-0@lo:400:kworker.0 Request processed in 37us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708606.311768:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00080000:2.0:1789708606.311773:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2eea00 x1876645365517696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708606.311773:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789708606.311784:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365517696:0@lo:400:kworker.0 00010000:00010000:1.0:1789708607.078380:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708607.246215:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708607.246302:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357122816 00000100:00100000:0.0:1789708607.246312:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357122816 00000100:00100000:0.0:1789708607.246391:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 248 00000100:00080000:1.0:1789708607.246403:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708607.246403:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+32:12137:x1876645357122816:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789708607.246510:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68824747-448a-469b-b2cf-e27bc037ded7+32:12137:x1876645357122816:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 Request processed in 110us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708607.246519:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 248 00000100:00100000:3.0:1789708607.247193:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708607.247227:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357122944 00000100:00100000:2.0:1789708607.247232:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357122944 00000100:00100000:2.0:1789708607.247276:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 249 00000100:00080000:1.0:1789708607.247280:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708607.247291:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:12137:x1876645357122944:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789708607.247335:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68824747-448a-469b-b2cf-e27bc037ded7+5:12137:x1876645357122944:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 Request processed in 52us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708607.247342:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 249 00000100:00100000:1.0:1789708607.248294:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708607.248364:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357123200 00000100:00100000:3.0:1789708607.248369:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357123200 00000100:00100000:3.0:1789708607.248411:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:3.0:1789708607.248420:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+32:12137:x1876645357123200:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789708607.248595:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+33:12137:x1876645357123200:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 175us (302us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789708607.248603:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:2.0:1789708607.334461:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365518720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789708607.334551:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708607.334599:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365518720 00000100:00100000:1.0:1789708607.334608:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365518720 00000100:00100000:1.0:1789708607.334658:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789708607.334668:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365518720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789708607.334720:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789708607.334769:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365518720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708607.334776:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789708607.334822:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365518720:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1789708607.882952:0:14958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:16:47 (1789708607) 00010000:00010000:1.0:1789708608.102351:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789708608.359048:0:9480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1789708608.359059:0:9480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1789708608.578843:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708608.578880:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357123328 00000100:00100000:0.0:1789708608.578889:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357123328 00000100:00080000:1.0:1789708608.578930:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708608.578943:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 250 00000100:00100000:0.0:1789708608.578951:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:13154:x1876645357123328:12345-192.168.201.52@tcp:101:lsof.0 00010000:00010000:0.0:1789708608.578967:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708608.578982:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dd4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e302 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.579030:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dd54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.579040:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dd54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.579049:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dd54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708608.579081:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789708608.579083:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708608.579111:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dd54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.579127:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1400/0xf45f43947e47dd4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e302 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.579148:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dd54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e302 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.579154:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c76cf00) 00010000:00010000:0.0:1789708608.579156:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708608.579159:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708608.579201:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:13154:x1876645357123328:12345-192.168.201.52@tcp:101:lsof.0 Request processed in 252us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708608.579206:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 250 00000100:00100000:0.0:1789708608.781802:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708608.781880:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357123584 00000100:00100000:2.0:1789708608.781891:0:14125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357123584 00000100:00100000:2.0:1789708608.781962:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:2.0:1789708608.781973:0:14125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+33:13155:x1876645357123584:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:2.0:1789708608.782231:0:14125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:68824747-448a-469b-b2cf-e27bc037ded7+34:13155:x1876645357123584:12345-192.168.201.52@tcp:35:umount.0 Request processed in 259us (437us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789708608.782255:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:1.0:1789708608.784794:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708608.784861:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357123840 00000100:00100000:3.0:1789708608.784868:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357123840 00000100:00100000:3.0:1789708608.784911:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:3.0:1789708608.784922:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+34:13155:x1876645357123840:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:3.0:1789708608.785142:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+35:13155:x1876645357123840:12345-192.168.201.52@tcp:35:umount.0 Request processed in 223us (354us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789708608.785149:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:3.0:1789708608.785985:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708608.786035:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357124096 00000100:00100000:1.0:1789708608.786041:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357124096 00000100:00100000:1.0:1789708608.786080:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:1.0:1789708608.786089:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10257850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+35:13155:x1876645357124096:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:1.0:1789708608.786195:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10257850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68824747-448a-469b-b2cf-e27bc037ded7+36:13155:x1876645357124096:12345-192.168.201.52@tcp:35:umount.0 Request processed in 107us (209us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789708608.786203:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:0.0:1789708608.786920:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708608.786971:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357124352 00000100:00100000:3.0:1789708608.786976:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357124352 00000100:00100000:3.0:1789708608.787005:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:3.0:1789708608.787011:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+36:13155:x1876645357124352:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:3.0:1789708608.787148:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68824747-448a-469b-b2cf-e27bc037ded7+37:13155:x1876645357124352:12345-192.168.201.52@tcp:35:umount.0 Request processed in 135us (228us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1789708608.787154:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:0.0:1789708608.788250:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708608.788301:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708608.788405:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357124480 00000100:00100000:1.0:1789708608.788406:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357124608 00000100:00100000:2.0:1789708608.788412:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357124480 00000100:00100000:1.0:1789708608.788413:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357124608 00000100:00100000:2.0:1789708608.788464:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1789708608.788472:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee40ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:098f9bc4-0284-4f29-9497-0447ce008685+14:2395:x1876645357124480:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708608.788483:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708608.788516:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee00030e00/0xf45f43947e47cd9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de78 expref: 14 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708608.788533:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708608.788554:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708608.788570:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee40ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:098f9bc4-0284-4f29-9497-0447ce008685+13:2395:x1876645357124480:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 97us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708608.788571:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357124736 00000100:00100000:1.0:1789708608.788578:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357124736 00000100:00100000:3.0:1789708608.788581:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789708608.788589:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1789708608.788595:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:098f9bc4-0284-4f29-9497-0447ce008685+14:2398:x1876645357124608:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708608.788607:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789708608.788616:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00010000:00010000:3.0:1789708608.788620:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebec00/0xf45f43947e47cc28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de39 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708608.788631:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:098f9bc4-0284-4f29-9497-0447ce008685+12:2396:x1876645357124736:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708608.788632:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708608.788643:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708608.788656:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e948200/0xf45f43947e47cfaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df51 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.788667:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708608.788778:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:098f9bc4-0284-4f29-9497-0447ce008685+11:2398:x1876645357124608:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 187us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708608.788780:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:098f9bc4-0284-4f29-9497-0447ce008685+11:2396:x1876645357124736:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 151us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708608.788793:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1789708608.788801:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:0.0:1789708608.788808:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708608.788832:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357124864 00000100:00100000:3.0:1789708608.788836:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357124864 00000100:00100000:3.0:1789708608.788883:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:3.0:1789708608.788891:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0991b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+5:2394:x1876645357124864:12345-192.168.201.52@tcp:9:umount.0 00000100:00080000:1.0:1789708608.788902:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1789708608.788946:0:8399:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47d0b9 00000100:00080000:3.0:1789708608.788953:0:8399:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa45000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789708608.788987:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789708608.788988:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789708608.789136:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0991b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68824747-448a-469b-b2cf-e27bc037ded7+2:2394:x1876645357124864:12345-192.168.201.52@tcp:9:umount.0 Request processed in 246us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708608.789141:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:2.0:1789708608.790821:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708608.790849:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357125248 00000100:00100000:3.0:1789708608.790854:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357125248 00000100:00100000:3.0:1789708608.790887:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00080000:1.0:1789708608.790898:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708608.790899:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+8:2394:x1876645357125248:12345-192.168.201.52@tcp:9:umount.0 00000020:00000080:3.0:1789708608.790915:0:8397:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47d305 00000020:00010000:3.0:1789708608.790920:0:8397:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bed0a0ab000: total 0 00000100:00080000:3.0:1789708608.790922:0:8397:0:(import.c:65:import_set_state_nolock()) ffff9bed0a0a8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708608.790950:0:8397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:0.0:1789708608.790965:0:10362:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bed0a0ab000: total 0 00010000:00010000:0.0:1789708608.791013:0:10362:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bed0a0ab000, canceled 0 locks, left on hash table 2. 00000100:00100000:3.0:1789708608.791037:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68824747-448a-469b-b2cf-e27bc037ded7+6:2394:x1876645357125248:12345-192.168.201.52@tcp:9:umount.0 Request processed in 138us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708608.791043:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00010000:00010000:0.0:1789708608.791059:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47d6b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e12d expref: 5 pid: 10054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.791089:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47dd46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2fb expref: 4 pid: 9145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.791106:0:10362:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bed0a0ab000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789708608.791118:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708608.791124:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708608.791125:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708608.794233:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708608.794293:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357126272 00000100:00100000:3.0:1789708608.794300:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357126272 00000100:00100000:3.0:1789708608.794343:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 251 00000100:00100000:3.0:1789708608.794353:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+37:2394:x1876645357126272:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:3.0:1789708608.794377:0:8421:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cc36 00000020:00010000:3.0:1789708608.794400:0:8421:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bed09601000: total 0 00000100:00080000:3.0:1789708608.794405:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9bed09602800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708608.794436:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967510 00010000:00010000:0.0:1789708608.794446:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.794455:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.794460:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.794465:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4400 already unused, calling callback (ffffffffc1a211b0) 00000020:00010000:1.0:1789708608.794466:0:7426:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bed09601000: total 0 00010000:00010000:0.0:1789708608.794469:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.794475:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708608.794487:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:0.0:1789708608.794489:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708608.794534:0:7426:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bed09601000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789708608.794572:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794574:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708608.794582:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708608.794586:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4400/0xf45f43947e47dcc1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794590:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508c00/0xf45f43947e47d677 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e118 expref: 36 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708608.794594:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68824747-448a-469b-b2cf-e27bc037ded7+36:2394:x1876645357126272:12345-192.168.201.52@tcp:39:umount.0 Request processed in 239us (363us total) trans 4294967511 rc 0/0 00000100:00100000:3.0:1789708608.794612:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 251 00010000:00010000:1.0:1789708608.794624:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:1.0:1789708608.794628:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789708608.794633:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47d08f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df7b expref: 33 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794649:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708608.794652:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789708608.794657:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509c00/0xf45f43947e47d6a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e126 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794672:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:1.0:1789708608.794675:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708608.794679:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47dd07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2e6 expref: 31 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794692:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:1.0:1789708608.794695:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789708608.794710:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47d72d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e149 expref: 30 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794726:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:1.0:1789708608.794728:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789708608.794732:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1e00/0xf45f43947e47dd31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2f4 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794746:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c76cf00) 00010000:00010000:1.0:1789708608.794748:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708608.794752:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47d711 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e142 expref: 28 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794763:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee08f48900) 00010000:00010000:1.0:1789708608.794766:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708608.794769:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1c00/0xf45f43947e47d034 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df66 expref: 27 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794782:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bee08f48600) 00010000:00010000:1.0:1789708608.794785:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708608.794788:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47d137 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715dfc1 expref: 26 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794800:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bee4205db00) 00010000:00010000:1.0:1789708608.794803:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708608.794806:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0200/0xf45f43947e47dc27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e2ae expref: 25 pid: 13656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794819:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bee2c76cb00) 00010000:00010000:1.0:1789708608.794827:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708608.794831:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee3e949c00/0xf45f43947e47d7ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e18f expref: 24 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794848:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bee08f48500) 00010000:00010000:1.0:1789708608.794850:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708608.794854:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47d597 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e0e0 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794868:0:7426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bee2c76c700) 00010000:00010000:1.0:1789708608.794871:0:7426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708608.794876:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47d018 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df5f expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708608.794886:0:7426:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bed09601000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789708608.794901:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708608.794903:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708608.794905:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708608.798455:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708608.798517:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357126400 00000100:00100000:0.0:1789708608.798526:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357126400 00000100:00100000:0.0:1789708608.798570:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 252 00000100:00100000:0.0:1789708608.798579:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+5:2394:x1876645357126400:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:0.0:1789708608.798602:0:13656:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cc3d 00000100:00080000:0.0:1789708608.798619:0:13656:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa73000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789708608.798648:0:13656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1789708608.798659:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708608.798772:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:68824747-448a-469b-b2cf-e27bc037ded7+3:2394:x1876645357126400:12345-192.168.201.52@tcp:39:umount.0 Request processed in 194us (323us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789708608.798780:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 252 00000100:00100000:2.0:1789708609.043757:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708609.043798:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708609.043833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357126528 00000100:00100000:2.0:1789708609.043843:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708609.043844:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357126528 00000100:00100000:1.0:1789708609.043863:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357126656 00000100:00100000:1.0:1789708609.043868:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357126656 00000100:00100000:0.0:1789708609.043914:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357126784 00000100:00100000:0.0:1789708609.043918:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357126784 00000100:00100000:1.0:1789708609.043921:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789708609.043933:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:1.0:1789708609.043934:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:098f9bc4-0284-4f29-9497-0447ce008685+12:2397:x1876645357126528:12345-192.168.201.52@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789708609.043948:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:3.0:1789708609.043951:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:098f9bc4-0284-4f29-9497-0447ce008685+12:2395:x1876645357126656:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708609.043962:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708609.043964:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789708609.043965:0:7427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:098f9bc4-0284-4f29-9497-0447ce008685+12:2397:x1876645357126784:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708609.043978:0:7427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708609.043986:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee029c9c00/0xf45f43947e47cdf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715debe expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708609.043986:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47cdef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de8d expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.043993:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e948a00/0xf45f43947e47cfa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715df4a expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708609.044019:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708609.044019:0:7427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708609.044020:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708609.044079:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:098f9bc4-0284-4f29-9497-0447ce008685+9:2397:x1876645357126528:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 148us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708609.044080:0:7427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:098f9bc4-0284-4f29-9497-0447ce008685+9:2397:x1876645357126784:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 119us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708609.044082:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:098f9bc4-0284-4f29-9497-0447ce008685+9:2395:x1876645357126656:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 137us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708609.044097:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:2.0:1789708609.044112:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:3.0:1789708609.044123:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:2.0:1789708609.046994:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708609.047030:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357127040 00000100:00100000:1.0:1789708609.047037:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357127040 00000100:00100000:1.0:1789708609.047074:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 253 00000100:00100000:1.0:1789708609.047081:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+6:2394:x1876645357127040:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:1.0:1789708609.047109:0:6485:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ce04 00000020:00010000:1.0:1789708609.047115:0:6485:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bed08566000: total 0 00000100:00080000:1.0:1789708609.047118:0:6485:0:(import.c:65:import_set_state_nolock()) ffff9bed08561800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789708609.047140:0:6485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967511 00000020:00010000:2.0:1789708609.047155:0:6472:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bed08566000: total 0 00010000:00010000:2.0:1789708609.047203:0:6472:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bed08566000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789708609.047227:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c76cf00) 00010000:00010000:2.0:1789708609.047231:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708609.047238:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47dd54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e302 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.047284:0:6472:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bed08566000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789708609.047298:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708609.047302:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708609.047304:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708609.047310:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bd23bbf-17fc-4232-922d-5f674c08c0de+3:2394:x1876645357127040:12345-192.168.201.52@tcp:39:umount.0 Request processed in 228us (319us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1789708609.047319:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 253 00000001:00100000:3.0:1789708609.048069:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0bd23bbf-17fc-4232-922d-5f674c08c0de 00000001:00080000:3.0:1789708609.048079:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00000080:3.0:1789708609.048083:0:6463:0:(genops.c:885:class_export_put()) final put ffff9bed08566000/0bd23bbf-17fc-4232-922d-5f674c08c0de 00000001:00100000:3.0:1789708609.048104:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000001:00080000:3.0:1789708609.048111:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000020:00000080:2.0:1789708609.048130:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08566000/0bd23bbf-17fc-4232-922d-5f674c08c0de for lustre-MDT0000 00000020:00080000:3.0:1789708609.048146:0:6463:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bee02f1dc00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789708609.048151:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee2f7b6200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bee02f1d780 00000020:00080000:3.0:1789708609.048155:0:6463:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee2f7b6800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bed0a203a00 00000020:00000080:3.0:1789708609.048178:0:6463:0:(genops.c:885:class_export_put()) final put ffff9bed09601000/68824747-448a-469b-b2cf-e27bc037ded7 00000020:00080000:3.0:1789708609.048186:0:6463:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789708609.048191:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00000080:2.0:1789708609.048204:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed08561800 for lustre-MDT0000 00000020:00000080:2.0:1789708609.048212:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed09601000/68824747-448a-469b-b2cf-e27bc037ded7 for lustre-MDT0000 00000020:00080000:1.0:1789708609.048223:0:6517:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00000080:2.0:1789708609.048256:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed09602800 for lustre-MDT0000 00000100:00100000:0.0:1789708609.051445:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708609.051484:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357127168 00000100:00100000:2.0:1789708609.051505:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357127168 00000100:00080000:1.0:1789708609.051542:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708609.051558:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 254 00000100:00100000:2.0:1789708609.051568:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+5:2394:x1876645357127168:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:2.0:1789708609.051606:0:6483:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ce0b 00000100:00080000:2.0:1789708609.051613:0:6483:0:(import.c:65:import_set_state_nolock()) ffff9bee3f9f0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789708609.051631:0:6483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1789708609.051647:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708609.051745:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bd23bbf-17fc-4232-922d-5f674c08c0de+3:2394:x1876645357127168:12345-192.168.201.52@tcp:39:umount.0 Request processed in 178us (303us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789708609.051765:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 254 00000100:00100000:0.0:1789708609.062907:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708609.062979:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357127424 00000100:00100000:1.0:1789708609.062989:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357127424 00000100:00100000:1.0:1789708609.063042:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 347 00000100:00100000:1.0:1789708609.063052:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+7:2394:x1876645357127424:12345-192.168.201.52@tcp:251:umount.0 00000020:00000080:1.0:1789708609.063097:0:6478:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cc13 00000020:00010000:1.0:1789708609.063104:0:6478:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bee3fa77800: total 0 00000100:00080000:1.0:1789708609.063108:0:6478:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa75000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1789708609.063152:0:7426:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bee3fa77800: total 0 00010000:00010000:3.0:1789708609.063158:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708609.063171:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:098f9bc4-0284-4f29-9497-0447ce008685+3:2394:x1876645357127424:12345-192.168.201.52@tcp:251:umount.0 Request processed in 120us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708609.063179:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 347 00010000:00010000:3.0:1789708609.063226:0:7426:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bee3fa77800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789708609.063304:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01508200/0xf45f43947e47cda2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715de7f expref: 2 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708609.063322:0:7426:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bee3fa77800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789708609.063388:0:7426:0:(genops.c:885:class_export_put()) final put ffff9bee3fa77800/098f9bc4-0284-4f29-9497-0447ce008685 00010000:00010000:3.0:1789708609.063404:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708609.063407:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708609.063410:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789708609.063426:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa77800/098f9bc4-0284-4f29-9497-0447ce008685 for MGS 00000020:00000080:1.0:1789708609.063472:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3fa75000 for MGS 00010000:00010000:2.0:1789708609.127350:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789708609.672175:0:15154:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789708609.683413:0:15154:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789708609.683464:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.683491:0:15154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.683501:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.683509:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.683526:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789708609.683531:0:15154:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789708609.683558:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708609.683566:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789708609.683566:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708609.683572:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1789708609.683577:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508a00 already unused, calling callback (ffffffffc13d2d20) 00000100:00080000:0.0:1789708609.683578:0:15154:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:2.0:1789708609.683582:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.683590:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708609.683596:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708609.683600:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:0.0:1789708609.683601:0:15154:0:(import.c:65:import_set_state_nolock()) ffff9bee2d93f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:2.0:1789708609.683603:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789708609.683606:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789708609.683634:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.683639:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708609.683661:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708609.683667:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0991aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365518848:0@lo:39:umount.0 00010000:00010000:2.0:1789708609.683667:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47cd71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708609.683676:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365518976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708609.683684:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708609.683692:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708609.683694:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708609.683740:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708609.683742:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708609.683784:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365518976 00000100:00100000:2.0:1789708609.683786:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365518848 00000100:00100000:2.0:1789708609.683791:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365518848 00000100:00100000:0.0:1789708609.683791:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365518976 00000100:00100000:0.0:1789708609.683845:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708609.683849:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789708609.683860:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876645365518848:12345-0@lo:39:umount.0 00000100:00100000:0.0:1789708609.683864:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3617:x1876645365518976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708609.683875:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:2.0:1789708609.683888:0:6484:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c8ee 00010000:00010000:0.0:1789708609.683889:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee00031c00/0xf45f43947e47cd78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cd71 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789708609.683898:0:6484:0:(import.c:65:import_set_state_nolock()) ffff9bee2d999800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789708609.683903:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708609.683940:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708609.683940:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:3617:x1876645365518976:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708609.683948:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708609.683968:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3614:x1876645365518848:12345-0@lo:39:umount.0 Request processed in 112us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708609.683971:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3617:1876645365518976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708609.683975:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000020:00000080:2.0:1789708609.683981:0:6484:0:(genops.c:885:class_export_put()) final put ffff9bee36077000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1789708609.684010:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee2d93f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:1.0:1789708609.684019:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee36077000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1789708609.684024:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0991aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365518848:0@lo:39:umount.0 00000100:00080000:0.0:1789708609.684038:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708609.684041:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789708609.684044:0:15154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789708609.684071:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee2d999800 for lustre-MDT0000 00010000:00010000:0.0:1789708609.684784:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684791:0:15154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684794:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684798:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684809:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708609.684813:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684822:0:15154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684826:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708609.684831:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708609.684831:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708609.684840:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684843:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708609.684850:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708609.684852:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebe200 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:0.0:1789708609.684856:0:15154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708609.684858:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.684863:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708609.684863:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.684870:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708609.684875:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684881:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.684887:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509600 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708609.684892:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708609.684898:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.684902:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684904:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708609.684912:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708609.684919:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1789708609.684919:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684921:0:15154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708609.684926:0:7426:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789708609.684935:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1789708609.684944:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789708609.684947:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1789708609.684947:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708609.684949:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684949:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708609.684952:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789708609.684968:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebfc00 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:3.0:1789708609.684970:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708609.684971:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684971:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708609.684972:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708609.684989:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.684994:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708609.684995:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708609.684995:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789708609.685003:0:15154:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789708609.685007:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe200/0xf45f43947e47cd7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708609.685008:0:15154:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1789708609.685013:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708609.685016:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708609.685023:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708609.685028:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01509600/0xf45f43947e47ccd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47ccd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708609.685032:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789708609.685035:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708609.685040:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000020:01000004:0.0:1789708609.685040:0:15154:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 10000000:01000000:1.0:1789708609.685047:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000000:0.0:1789708609.685047:0:15154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:3.0:1789708609.685048:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee188ac200 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:2.0:1789708609.685049:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708609.685053:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789708609.685053:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:3.0:1789708609.685055:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.685057:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789708609.685058:0:15154:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000100:00100000:2.0:1789708609.685064:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:0.0:1789708609.685066:0:15154:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bed09602000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789708609.685069:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789708609.685071:0:15154:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bed084f2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1789708609.685073:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708609.685081:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365519232:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789708609.685084:0:15154:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bee2f447800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:3.0:1789708609.685093:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708609.685097:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1789708609.685100:0:15154:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bee362d2800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:1.0:1789708609.685108:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708609.685111:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:0.0:1789708609.685112:0:15154:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9bee18163380) has exports, disconnecting them 10000000:01000000:3.0:1789708609.685119:0:7426:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1789708609.685120:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfc00/0xf45f43947e47cfe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cfe7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789708609.685121:0:15154:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bed09602000), last request at 1789708606 00000100:00100000:2.0:1789708609.685122:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789708609.685124:0:7426:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:0.0:1789708609.685130:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cbf0 00010000:00010000:1.0:1789708609.685139:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708609.685144:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708609.685145:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708609.685148:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708609.685148:0:15154:0:(import.c:65:import_set_state_nolock()) ffff9bed09605000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789708609.685152:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789708609.685159:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789708609.685164:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708609.685172:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee188ac200/0xf45f43947e47c84d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47c854 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708609.685173:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365519360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708609.685174:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365519232 00000100:00100000:2.0:1789708609.685180:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365519232 00000020:00080000:0.0:1789708609.685187:0:15154:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed09602000): rc 0 00000020:00000080:0.0:1789708609.685190:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bed09602000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1789708609.685194:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708609.685198:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789708609.685198:0:15154:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bed084f2000), last request at 1789708606 00010000:00010000:3.0:1789708609.685203:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789708609.685203:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47caae 00000100:00100000:1.0:1789708609.685212:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789708609.685212:0:15154:0:(import.c:65:import_set_state_nolock()) ffff9bed084f5800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789708609.685219:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365519104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708609.685226:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000020:00080000:0.0:1789708609.685232:0:15154:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed084f2000): rc 0 00000020:00000080:0.0:1789708609.685234:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bed084f2000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:2.0:1789708609.685239:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee40ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:3616:x1876645365519232:12345-0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789708609.685241:0:15154:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bee2f447800), last request at 1789708518 00000100:00100000:1.0:1789708609.685244:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365519360 00000020:00000080:0.0:1789708609.685248:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c9c7 00000100:00100000:1.0:1789708609.685249:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365519360 00010000:00010000:2.0:1789708609.685252:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1789708609.685253:0:15154:0:(import.c:65:import_set_state_nolock()) ffff9bee2f444000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789708609.685284:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789708609.685286:0:15154:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bee2f447800): rc 0 00000020:00000080:0.0:1789708609.685288:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2f447800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789708609.685293:0:15154:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bee362d2800), last request at 1789708518 00010000:00010000:2.0:1789708609.685296:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebc600/0xf45f43947e47ccd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47ccd0 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789708609.685297:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c988 00000100:00080000:0.0:1789708609.685303:0:15154:0:(import.c:65:import_set_state_nolock()) ffff9bee36273800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789708609.685306:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365519104 00010000:00010000:2.0:1789708609.685309:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708609.685310:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365519104 00000001:00000004:0.0:1789708609.685310:0:15154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967512 00000100:00100000:3.0:1789708609.685332:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708609.685343:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365519488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708609.685344:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee40ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3616:x1876645365519232:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708609.685349:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708609.685359:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708609.685364:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+24:3615:x1876645365519360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708609.685376:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789708609.685382:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789708609.685385:0:15154:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bee362d2800): rc 0 00010000:00010000:1.0:1789708609.685388:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e948400/0xf45f43947e47cfe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cfe0 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1789708609.685393:0:15154:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbde290537ad8 00010000:00010000:1.0:1789708609.685397:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708609.685411:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708609.685412:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789708609.685413:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365519488 00000100:00100000:0.0:1789708609.685417:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1789708609.685419:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365519488 00010000:00010000:3.0:1789708609.685428:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708609.685432:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+23:3615:x1876645365519360:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708609.685439:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708609.685448:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708609.685453:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365519232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708609.685466:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:3618:x1876645365519104:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708609.685472:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789708609.685489:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789708609.685494:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a955500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+22:3618:x1876645365519488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708609.685498:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708609.685502:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:3.0:1789708609.685504:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed09602000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1789708609.685505:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee00031400/0xf45f43947e47cd86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cd7f expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708609.685514:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee0165ae00/0xf45f43947e47c854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47c84d expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708609.685519:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708609.685525:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:3.0:1789708609.685538:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed084f2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1789708609.685556:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:3618:x1876645365519104:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708609.685562:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00000080:3.0:1789708609.685564:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f447800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1789708609.685567:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a955500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+20:3618:x1876645365519488:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708609.685574:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00000080:3.0:1789708609.685591:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed09605000 for lustre-MDT0000 00000020:00000080:3.0:1789708609.685596:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed084f5800 for lustre-MDT0000 00000020:00000080:3.0:1789708609.685600:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee2f444000 for lustre-MDT0000 00000100:00100000:3.0:1789708609.685623:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365519488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708609.685633:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365519360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789708609.685634:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3618:1876645365519104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708609.685664:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708609.686096:0:15154:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789708609.686105:0:15154:0:(import.c:65:import_set_state_nolock()) ffff9bee2f6ae800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789708609.686138:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0991aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365519616:0@lo:39:umount.0 00000100:00100000:3.0:1789708609.686169:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789708609.686206:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789708609.686209:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 3 00000100:00100000:2.0:1789708609.686210:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365519616 00000100:00100000:2.0:1789708609.686216:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365519616 00000100:00100000:0.0:1789708609.686217:0:15154:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bed09946680 x1876645365514880/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789708620 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789708609.686225:0:15154:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bed09946680, transno 4294967323 00000100:00100000:0.0:1789708609.686237:0:15154:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bee3622e680 x1876645365516032/t4294967325(4294967325) o1000->lustre-OST0000-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1789708620 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789708609.686242:0:15154:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967322 00000100:00100000:2.0:1789708609.686254:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789708609.686285:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876645365519616:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789708609.686299:0:6488:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ca22 00000100:00080000:2.0:1789708609.686305:0:6488:0:(import.c:65:import_set_state_nolock()) ffff9bee3dd56800 : changing import state from FULL to CLOSED 00000004:00080000:0.0:1789708609.686312:0:15154:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000001:00000004:2.0:1789708609.686320:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1789708609.686336:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708609.686363:0:15154:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789708609.686375:0:15154:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa13800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789708609.686395:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789708609.686398:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 3 00000100:00100000:0.0:1789708609.686404:0:15154:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bed09945880 x1876645365510784/t4294967307(4294967307) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1789708618 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708609.686408:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3614:x1876645365519616:12345-0@lo:39:umount.0 Request processed in 124us (239us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789708609.686415:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365519744:0@lo:9:umount.0 00000100:00100000:2.0:1789708609.686423:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000004:00080000:0.0:1789708609.686430:0:15154:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967305 00000100:00100000:3.0:1789708609.686456:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708609.686456:0:15154:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bed09b81880 x1876645365511936/t4294967308(4294967308) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789708618 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789708609.686466:0:15154:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bed09b81880, transno 4294967308 00000100:00100000:0.0:1789708609.686492:0:15154:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bed0855fb80 x1876645365513984/t4294967310(4294967310) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1789708619 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_002.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789708609.686497:0:15154:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967305 00000100:00100000:1.0:1789708609.686502:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365519744 00000100:00080000:3.0:1789708609.686508:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee2f6ae800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789708609.686508:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365519744 00000100:00100000:3.0:1789708609.686516:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0991aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365519616:0@lo:39:umount.0 00000100:00100000:0.0:1789708609.686517:0:15154:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bee048f2d80 x1876645365515008/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789708620 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789708609.686527:0:15154:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bee048f2d80, transno 4294967311 00000004:00080000:0.0:1789708609.686540:0:15154:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789708609.686547:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789708609.686554:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3614:x1876645365519744:12345-0@lo:9:umount.0 00000100:00080000:3.0:1789708609.686563:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789708609.686568:0:10054:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cb64 00000100:00080000:1.0:1789708609.686583:0:10054:0:(import.c:65:import_set_state_nolock()) ffff9bee2f6ab800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789708609.686603:0:15154:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00010000:00010000:3.0:1789708609.686605:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708609.686614:0:15154:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa16800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000001:00000004:1.0:1789708609.686620:0:10054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789708609.686637:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365519872:0@lo:9:umount.0 00000020:00080000:0.0:1789708609.686644:0:15154:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9bee18163380) has no exports 00000100:00100000:3.0:1789708609.686676:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708609.686706:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365519872 00000100:00100000:0.0:1789708609.686711:0:8399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365519872 00000100:00100000:1.0:1789708609.686736:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+4:3614:x1876645365519744:12345-0@lo:9:umount.0 Request processed in 183us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708609.686742:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789708609.686754:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa13800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789708609.686757:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789708609.686765:0:8399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876645365519872:12345-0@lo:9:umount.0 00000004:00080000:3.0:1789708609.686766:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789708609.686770:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789708609.686774:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708609.686775:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365519744:0@lo:9:umount.0 00000020:00000080:0.0:1789708609.686778:0:8399:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cd01 00000100:00080000:0.0:1789708609.686788:0:8399:0:(import.c:65:import_set_state_nolock()) ffff9bee3f9f3000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789708609.686806:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789708609.686814:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789708609.686888:0:8399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3614:x1876645365519872:12345-0@lo:9:umount.0 Request processed in 125us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708609.686900:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789708609.686909:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000100:00080000:3.0:1789708609.686917:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa16800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789708609.686929:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789708609.686932:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789708609.686936:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365519872:0@lo:9:umount.0 00000001:00100000:1.0:1789708609.687616:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789708609.687623:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000001:00080000:1.0:1789708609.687632:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1789708609.687638:0:8392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000020:00000080:1.0:1789708609.687641:0:8392:0:(genops.c:885:class_export_put()) final put ffff9bed0a0ab000/68824747-448a-469b-b2cf-e27bc037ded7 00000020:00000080:1.0:1789708609.687655:0:8392:0:(genops.c:885:class_export_put()) final put ffff9bee2f6ab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789708609.687988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0a0ab000/68824747-448a-469b-b2cf-e27bc037ded7 for lustre-OST0000 00000020:00000080:3.0:1789708609.688013:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f6ab000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789708609.688037:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed0a0a8800 for lustre-OST0000 00000020:00000080:3.0:1789708609.688041:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee2f6ab800 for lustre-OST0000 00010000:00010000:1.0:1789708610.150437:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708610.406495:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365520000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789708610.406567:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708610.406636:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365520000 00000100:00100000:1.0:1789708610.406643:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365520000 00000100:00100000:1.0:1789708610.406681:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789708610.406690:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1876645365520000:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1789708610.406698:0:6489:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789708610.406744:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1876645365520000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (176us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789708610.406766:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:02020000:3.0:1789708610.406778:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1789708610.409412:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789708610.409418:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9bee36e4e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789708610.409423:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789708610.413731:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9bee36e4e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708610.413741:0:3618:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 89 00000100:00080000:3.0:1789708610.413754:0:3618:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bee36e4e800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708610.413786:0:3618:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a955c00 x1876645365520128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789708610.413911:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365520128:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789708610.413963:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708610.414024:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365520128 00000100:00100000:2.0:1789708610.414031:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365520128 00000100:00100000:2.0:1789708610.414060:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789708610.414066:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365520128:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789708610.414079:0:6488:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789708610.415683:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365520128:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 1614us (1717us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789708610.415690:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1789708610.415726:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee36e4e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789708610.415733:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789708610.415737:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365520128:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1789708611.174432:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708611.430424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708611.430432:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1789708611.430432:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365520384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708611.430433:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365520512:0@lo:400:kworker.0 00000100:00080000:3.0:1789708611.430438:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bee36e4e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708611.430458:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 181 00000100:00080000:3.0:1789708611.430464:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789708611.430475:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bee36e4e800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708611.430498:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a955880 x1876645365520640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708611.430518:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708611.430522:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708611.430554:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365520640:0@lo:38:kworker.0 00000100:00100000:0.0:1789708611.430572:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365520256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708611.430584:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365521152:0@lo:400:kworker.0 00000100:00100000:2.0:1789708611.430603:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708611.430607:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708611.430613:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365520896:0@lo:400:kworker.0 00000100:00100000:1.0:1789708611.430631:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708611.430641:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365521024:0@lo:400:kworker.0 00000100:00100000:3.0:1789708611.430659:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708611.430681:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365520512 00000100:00100000:2.0:1789708611.430685:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365520384 00000100:00100000:0.0:1789708611.430687:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365520896 00000100:00100000:1.0:1789708611.430689:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365520512 00000100:00100000:2.0:1789708611.430692:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365520384 00000100:00100000:0.0:1789708611.430692:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365520896 00000100:00100000:3.0:1789708611.430700:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365521408:0@lo:400:kworker.0 00000100:00100000:0.0:1789708611.430737:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789708611.430742:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789708611.430746:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1876645365520896:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789708611.430757:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789708611.430758:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365520256 00000100:00100000:1.0:1789708611.430758:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:3616:x1876645365520512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708611.430765:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708611.430766:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365520256 00000100:00100000:3.0:1789708611.430794:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365521408 00000100:00100000:2.0:1789708611.430799:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789708611.430800:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365521408 00000100:00100000:2.0:1789708611.430811:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365520384:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708611.430819:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1876645365520896:12345-0@lo:400:kworker.0 Request processed in 72us (160us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789708611.430828:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789708611.430833:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5+19:3616:x1876645365520512:12345-0@lo:400:kworker.0 Request processed in 79us (314us total) trans 0 rc 0/0 00002000:00000024:2.0:1789708611.430836:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789708611.430841:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789708611.430849:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789708611.430855:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365521408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708611.430862:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708611.430889:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365521152 00000100:00100000:2.0:1789708611.430894:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365520384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708611.430896:0:8397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365521152 00000100:00100000:2.0:1789708611.430905:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789708611.430911:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365520384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708611.430913:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365521408:12345-0@lo:400:kworker.0 Request processed in 60us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708611.430923:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789708611.430928:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708611.430938:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789708611.430944:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3615:x1876645365520256:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708611.430945:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365521024 00000100:00100000:0.0:1789708611.430950:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365521024 00000100:00100000:1.0:1789708611.430954:0:8397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1876645365521152:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789708611.430965:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00010000:00080000:3.0:1789708611.430979:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a955c00 x1876645365521408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708611.430984:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789708611.430995:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365521024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708611.430998:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365521408:0@lo:400:kworker.0 00000100:00100000:1.0:1789708611.431001:0:8397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1876645365521152:12345-0@lo:400:kworker.0 Request processed in 49us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708611.431014:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789708611.431015:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3615:x1876645365520256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708611.431024:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789708611.431028:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789708611.431039:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9bed08567800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1789708611.431043:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365521024:12345-0@lo:400:kworker.0 Request processed in 48us (182us total) trans 0 rc 0/0 00000100:02000400:3.0:1789708611.431046:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789708611.431051:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789708611.431060:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365520640 00000100:00080000:2.0:1789708611.431063:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708611.431068:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708611.431072:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365520640 00000100:00080000:2.0:1789708611.431073:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789708611.431081:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a957800 x1876645365521024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708611.431090:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365520768:0@lo:400:kworker.0 00000100:00100000:1.0:1789708611.431099:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789708611.431106:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365520640:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789708611.431118:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365521024:0@lo:400:kworker.0 00010000:02000000:1.0:1789708611.431124:0:6489:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789708611.431140:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708611.431142:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365520256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708611.431166:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876645365521280:0@lo:400:kworker.0 00000100:00100000:0.0:1789708611.431169:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365520768 00000100:00100000:0.0:1789708611.431174:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365520768 00000100:00100000:2.0:1789708611.431199:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708611.431200:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789708611.431207:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1876645365520768:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789708611.431214:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789708611.431230:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365521280 00000100:00100000:2.0:1789708611.431235:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365521280 00000100:00100000:0.0:1789708611.431248:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1876645365520768:12345-0@lo:400:kworker.0 Request processed in 40us (109us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789708611.431253:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789708611.431287:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789708611.431294:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1876645365521280:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789708611.431300:0:6484:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:0.0:1789708611.431313:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789708611.431317:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9bee2f445000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789708611.431322:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789708611.431326:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9bee2f445000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1789708611.431332:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1876645365521280:12345-0@lo:400:kworker.0 Request processed in 35us (135us total) trans 0 rc -107/-107 00000100:00080000:0.0:1789708611.431334:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 89 00000100:00100000:2.0:1789708611.431343:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:0.0:1789708611.431344:0:3617:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bee2f445000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708611.431359:0:3617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0855fb80 x1876645365521536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708611.431375:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365520768:0@lo:400:kworker.0 00000100:00080000:0.0:1789708611.431387:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789708611.431389:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9bed09600000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789708611.431391:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789708611.431397:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365521152:0@lo:400:kworker.0 00000100:00080000:0.0:1789708611.431400:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9bed09600000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708611.431407:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 102 00000100:00080000:0.0:1789708611.431412:0:3617:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bed09600000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708611.431415:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365520512:0@lo:400:kworker.0 00000100:00100000:0.0:1789708611.431425:0:3617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cf100 x1876645365521664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708611.431434:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876645365521280:0@lo:400:kworker.0 00000100:00100000:2.0:1789708611.431440:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365521536:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789708611.431481:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708611.431500:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365521664:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789708611.431512:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365521536 00000100:00100000:0.0:1789708611.431516:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365521536 00000100:00100000:2.0:1789708611.431522:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708611.431535:0:13656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365521664 00000100:00100000:0.0:1789708611.431538:0:13656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365521664 00000100:00100000:0.0:1789708611.431553:0:13656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789708611.431557:0:13656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1876645365521536:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789708611.431563:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00010000:02000000:0.0:1789708611.431565:0:13656:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789708611.431572:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3614:x1876645365521664:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1789708611.431582:0:8421:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789708611.431593:0:13656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1876645365521536:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 34us (111us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789708611.431598:0:13656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789708611.431616:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3614:x1876645365521664:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 43us (92us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789708611.431623:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:2.0:1789708611.431649:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee2f445000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708611.431653:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708611.431656:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365521536:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1789708611.431662:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed09600000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708611.431665:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708611.431667:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365521664:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789708611.438423:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365520640:12345-0@lo:38:kworker.0 Request processed in 7312us (7818us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789708611.438435:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1789708611.438473:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee36e4e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708611.438479:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708611.438483:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365520640:0@lo:38:kworker.0 00000100:00080000:3.0:1789708611.441737:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9bed08567800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708611.441746:0:3618:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 95 00000100:00080000:3.0:1789708611.441757:0:3618:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bed08567800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708611.441804:0:3618:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a3a7b80 x1876645365521792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789708611.441830:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365520896:0@lo:400:kworker.0 00000100:00100000:2.0:1789708611.441856:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365521792:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789708611.441898:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708611.441958:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365521792 00000100:00100000:0.0:1789708611.441966:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365521792 00000100:00100000:0.0:1789708611.442004:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789708611.442011:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365521792:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1789708611.442026:0:6483:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789708611.442063:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365521792:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 52us (164us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789708611.442069:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:2.0:1789708611.442097:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08567800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708611.442103:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708611.442106:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365521792:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1789708612.198389:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708613.030747:0:13756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789708613.222436:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789708613.991248:0:9480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789708613.991248:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789708613.991273:0:9480:0:(genops.c:885:class_export_put()) final put ffff9bee3f9f5000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789708613.991299:0:9480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000001:00080000:1.0:1789708613.991300:0:7415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789708613.991302:0:9480:0:(genops.c:885:class_export_put()) final put ffff9bee3fa41000/68824747-448a-469b-b2cf-e27bc037ded7 00000020:00000080:1.0:1789708613.991307:0:7415:0:(genops.c:885:class_export_put()) final put ffff9bee36275000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789708613.991318:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3f9f5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000001:00100000:1.0:1789708613.991319:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0bd23bbf-17fc-4232-922d-5f674c08c0de 00000001:00080000:1.0:1789708613.991327:0:7415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1789708613.991331:0:7415:0:(genops.c:885:class_export_put()) final put ffff9bee3f9f2000/0bd23bbf-17fc-4232-922d-5f674c08c0de 00000001:00100000:1.0:1789708613.991346:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 68824747-448a-469b-b2cf-e27bc037ded7 00000001:00080000:1.0:1789708613.991355:0:7415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1789708613.991357:0:7415:0:(genops.c:885:class_export_put()) final put ffff9bee3fa71000/68824747-448a-469b-b2cf-e27bc037ded7 00000020:00000080:2.0:1789708613.991371:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa41000/68824747-448a-469b-b2cf-e27bc037ded7 for lustre-OST0001 00000020:00000080:2.0:1789708613.991393:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee36275000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789708613.991441:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3f9f3000 for lustre-OST0001 00000020:00000080:2.0:1789708613.991445:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3f9f2000/0bd23bbf-17fc-4232-922d-5f674c08c0de for lustre-MDT0001 00000020:00000080:2.0:1789708613.991470:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa71000/68824747-448a-469b-b2cf-e27bc037ded7 for lustre-MDT0001 00000020:00000080:2.0:1789708613.991499:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3fa45000 for lustre-OST0001 00000020:00000080:2.0:1789708613.991504:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3dd56800 for lustre-MDT0001 00000020:00000080:2.0:1789708613.991507:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3f9f0000 for lustre-MDT0001 00000020:00000080:2.0:1789708613.991510:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3fa73000 for lustre-MDT0001 00010000:00010000:1.0:1789708614.246479:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708614.310502:0:13754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708614.310511:0:13754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708614.310646:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1789708614.310661:0:13754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:3.0:1789708614.311530:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789708614.311534:0:6463:0:(genops.c:885:class_export_put()) final put ffff9bee362d2800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1789708614.311551:0:6463:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00000080:2.0:1789708614.311597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee362d2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00080000:1.0:1789708614.311600:0:6517:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bee02f1dc00 refcount 1 committed 1 result 0 batchid 8 00000020:00080000:1.0:1789708614.311607:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee2f7b6200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bee02f1d780 00000020:00080000:1.0:1789708614.311611:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee2f7b6800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bed0a203a00 00000020:00000080:2.0:1789708614.311657:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee36273800 for lustre-MDT0000 00000020:00080000:0.0:1789708614.317432:0:15154:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9bee18163380) has no exports 00000020:00000080:0.0:1789708614.342989:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c8a8 00000020:00000080:0.0:1789708614.343005:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee1fd54800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789708614.343042:0:15154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789708614.343050:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708614.343059:0:15154:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789708614.343063:0:15154:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9bee2d988000) has no exports 00000020:00000080:0.0:1789708614.343463:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c8a1 00000020:00000080:0.0:1789708614.343469:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2d939000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789708614.343480:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee1fd54800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789708614.343498:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d939000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789708614.343533:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708614.343539:0:15154:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789708614.343542:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2d998000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789708614.343544:0:15154:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d998000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789708614.343551:0:15154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1789708614.343732:0:15154:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee0539bf80 - data ffff9bee30f22510/ffff9bee3f9ab000 00000020:01000000:0.0:1789708614.343858:0:15154:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee08086200 - data ffff9bee30cd9e58/ffff9bee36243800 00000001:00000004:0.0:1789708614.355311:0:15154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967512 00000100:00080000:1.0:1789708614.374409:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789708614.374418:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789708614.374432:0:15154:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bed0991aa00 x1876645365519616/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789708619 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708614.374463:0:15154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789708614.375540:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789708614.375544:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 4 00000004:00080000:1.0:1789708614.375552:0:15154:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789708614.375553:0:15154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789708614.375730:0:9141:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789708614.375735:0:9141:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 2 00000040:00080000:3.0:1789708614.375754:0:9141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789708614.375994:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789708614.375997:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1789708614.376005:0:15154:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789708614.376008:0:15154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789708614.376167:0:10257:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789708614.376176:0:10257:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 3 00000040:00080000:3.0:1789708614.376196:0:10257:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789708614.376830:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c870 00000020:00000080:1.0:1789708614.376839:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2d939800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789708614.376866:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d939800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789708614.381200:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c885 00000020:00000080:1.0:1789708614.381214:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2d99b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789708614.381236:0:15154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789708614.381243:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708614.381251:0:15154:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789708614.381255:0:15154:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9bee181619c0) has no exports 00000020:00000080:2.0:1789708614.381325:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d99b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789708614.381526:0:15154:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789708614.381535:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ccfa 00000020:00000080:1.0:1789708614.381541:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee3fa14000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789708614.381558:0:15154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789708614.381562:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708614.381572:0:15154:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789708614.381576:0:15154:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff9bed095f99c0) has no exports 00000020:00000080:1.0:1789708614.381583:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ccf3 00000020:00000080:1.0:1789708614.381588:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee3fa13000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789708614.381624:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa14000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789708614.381636:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa13000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789708614.382084:0:15154:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789708614.382090:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789708614.382095:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1789708614.382100:0:15154:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789708614.382103:0:15154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789708614.382152:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3fa16800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789708614.382157:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708614.382168:0:15154:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708614.382171:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee3f9f7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789708614.382174:0:15154:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3f9f7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789708614.382180:0:15154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708614.382281:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cb5d 00000020:00000080:1.0:1789708614.382312:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee3fa45800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789708614.382328:0:15154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789708614.382332:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708614.382339:0:15154:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789708614.382342:0:15154:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9bee3dd78000) has no exports 00000020:00000080:2.0:1789708614.382345:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa45800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789708614.382346:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cb56 00000020:00000080:1.0:1789708614.382354:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee3fa15800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789708614.382370:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa15800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789708614.382842:0:15154:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789708614.382845:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789708614.382846:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 5 00000004:00080000:1.0:1789708614.382849:0:15154:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789708614.382850:0:15154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789708614.382880:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708614.382884:0:15154:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789708614.382891:0:15154:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789708614.382894:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ca1b 00000020:00000080:1.0:1789708614.382899:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2f56a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789708614.382902:0:15154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789708614.382906:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708614.382909:0:15154:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789708614.382911:0:15154:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9bee10dab380) has no exports 00000020:00000080:1.0:1789708614.382915:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ca14 00000020:00000080:1.0:1789708614.382917:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2f6ac800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789708614.382937:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3fa13800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789708614.382946:0:8:0:(genops.c:885:class_export_put()) final put ffff9bed08501000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789708614.382949:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08501000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789708614.382956:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789708614.383024:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f56a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789708614.383035:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f6ac800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789708614.385898:0:15154:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789708614.385903:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789708614.385912:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789708614.385918:0:15154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789708614.385943:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee2f6ae800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789708614.385961:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708614.385969:0:15154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708614.385972:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee3dd50800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789708614.385974:0:15154:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3dd50800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789708614.385979:0:15154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708614.386059:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708614.386062:0:15154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708614.386065:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2d938800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789708614.386066:0:15154:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d938800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789708614.386069:0:15154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708614.386148:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c88c 00000020:00000080:1.0:1789708614.386153:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2d99d800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789708614.386161:0:15154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789708614.386164:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708614.386168:0:15154:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1789708614.386169:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d99d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00080000:1.0:1789708614.386170:0:15154:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9bee2d98b380) has no exports 00000020:00000080:1.0:1789708614.386191:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708614.386194:0:15154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789708614.386195:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2d93a000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789708614.386197:0:15154:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d93a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789708614.386200:0:15154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789708614.386225:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c893 00000020:00000080:1.0:1789708614.386228:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2d999000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789708614.386239:0:15154:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee02bf3800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789708614.386241:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d999000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1789708614.386242:0:15154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee02bf3800 3 00000020:01000004:1.0:1789708614.386247:0:15154:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bee02bf3800 from lustre-MDT0000 00000020:00000080:1.0:1789708614.386279:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708614.386282:0:15154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789708614.386284:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2d938000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789708614.386290:0:15154:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d938000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789708614.386298:0:15154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789708614.386328:0:15154:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789708614.386331:0:15154:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789708614.386333:0:15154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789708614.386335:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708614.386337:0:15154:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789708614.386342:0:15154:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9bee18012800 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708614.386346:0:15154:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9bee10da99c0) has exports, disconnecting them 00000020:00080000:1.0:1789708614.386350:0:15154:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bee18012800), last request at 1789708511 00000020:00000080:1.0:1789708614.386362:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c831 00000020:00010000:1.0:1789708614.386365:0:15154:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bee18012800: total 0 00000100:00080000:1.0:1789708614.386369:0:15154:0:(import.c:65:import_set_state_nolock()) ffff9bee18014800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789708614.386379:0:15154:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bee18012800): rc 0 00000020:00080000:1.0:1789708614.386382:0:15154:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9bee10da99c0) has no exports 00000020:00010000:3.0:1789708614.386407:0:7426:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bee18012800: total 0 00000100:00100000:2.0:1789708614.386457:0:6478:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bee09047e00:6478] 1 exiting: rc = 0 00010000:00010000:3.0:1789708614.386471:0:7426:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bee18012800, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1789708614.386471:0:6479:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bee203ff600:6479] 2 exiting: rc = 0 00010000:00010000:3.0:1789708614.386508:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee0165b400/0xf45f43947e47c92d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47c926 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708614.386554:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509400/0xf45f43947e47cd94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cd8d expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708614.386571:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee00031200/0xf45f43947e47cd24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cd1d expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708614.386588:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ad200/0xf45f43947e47cd32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cd2b expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708614.386589:0:6477:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bee203ffc00:6477] 0 exiting: rc = 1 00010000:00010000:3.0:1789708614.386610:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee00031600/0xf45f43947e47cd40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cd39 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708614.386630:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebca00/0xf45f43947e47cc91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cc8a expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708614.386653:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e949000/0xf45f43947e47cfbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cfb6 expref: 8 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708614.386669:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee188ac000/0xf45f43947e47cd4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cd47 expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708614.386679:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789708614.386692:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47cfcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cfc4 expref: 6 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708614.386696:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386714:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386726:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789708614.386727:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e948c00/0xf45f43947e47cfd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cfd2 expref: 5 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708614.386742:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386754:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789708614.386760:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee00031800/0xf45f43947e47cd6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cd63 expref: 4 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708614.386767:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386778:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386796:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386808:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789708614.386818:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebf200/0xf45f43947e47c91f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47c918 expref: 3 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708614.386819:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386831:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386841:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789708614.386851:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509800/0xf45f43947e47cd5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47cd55 expref: 2 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708614.386853:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386865:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789708614.386870:0:7426:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bee18012800, canceled 13 locks, left on hash table 0. 00000100:00100000:1.0:1789708614.386887:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789708614.386901:0:7426:0:(genops.c:885:class_export_put()) final put ffff9bee18012800/88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5 00000100:00100000:1.0:1789708614.386906:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386921:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789708614.386923:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708614.386928:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789708614.386930:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18012800/88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5 for MGS 00010000:00010000:3.0:1789708614.386932:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708614.386935:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386947:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386958:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789708614.386968:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee18014800 for MGS 00000100:00100000:1.0:1789708614.386972:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386983:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386991:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.386998:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387004:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387012:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387019:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387027:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387035:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387042:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387050:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387058:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387069:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387080:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387090:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387098:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387103:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387109:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387116:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387125:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387132:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387141:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387148:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387155:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387163:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387172:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387181:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387188:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387195:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387210:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387218:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387226:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387233:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387244:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387255:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387295:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387305:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387313:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387321:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387328:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387336:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387344:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708614.387351:0:15154:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789708614.388461:0:15154:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee2f470900 - data ffff9bee30ee0360/ffff9bed0971b000 00000020:01000000:1.0:1789708614.388647:0:15154:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee08086000 - data ffff9bee30c68798/ffff9bee1800cc00 00000020:00000080:1.0:1789708614.389318:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c815 00000020:00000080:1.0:1789708614.389325:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee083c1000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789708614.389337:0:15154:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee02bf3800 from MGS, refs=2 00000020:01000004:1.0:1789708614.389340:0:15154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee02bf3800 2 00000020:01000004:1.0:1789708614.389348:0:15154:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bee02bf3800 from MGS 00000020:00000080:2.0:1789708614.389352:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee083c1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789708614.389375:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708614.389381:0:15154:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789708614.389384:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee083c6000/MGS 00000020:00000080:1.0:1789708614.389386:0:15154:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee083c6000/MGS for MGS 00000020:01000000:1.0:1789708614.389405:0:15154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789708614.389457:0:15154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789708614.389461:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708614.389466:0:15154:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789708614.389471:0:15154:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bee2d93f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708614.389477:0:15154:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9bee2d98cd40) has exports, disconnecting them 00000020:00080000:1.0:1789708614.389481:0:15154:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bee2d93f000), last request at 1789708511 00000020:00000080:1.0:1789708614.389486:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c8e0 00000020:00080000:1.0:1789708614.389504:0:15154:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bee2d93f000): rc 0 00000020:00000080:1.0:1789708614.389508:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee2d93f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789708614.389532:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d93f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789708614.390296:0:15154:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789708614.390301:0:15154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789708614.390304:0:15154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789708614.390309:0:15154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789708614.390337:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee2d93f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789708614.390520:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708614.390527:0:15154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789708614.390532:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee36072800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789708614.390535:0:15154:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee36072800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789708614.390550:0:15154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789708614.390617:0:15154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee02bf3800 1 00000020:00000080:2.0:1789708614.390622:0:15154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c807 00000020:00000080:2.0:1789708614.390627:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee083c1800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789708614.390638:0:15154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789708614.390643:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708614.390651:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee083c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789708614.390652:0:15154:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789708614.390659:0:15154:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9bee10dacd40) has no exports 00000020:00000080:3.0:1789708614.415082:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708614.415092:0:15154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789708614.415097:0:15154:0:(genops.c:885:class_export_put()) final put ffff9bee02bf6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789708614.415100:0:15154:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee02bf6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789708614.415108:0:15154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789708614.415212:0:15154:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bee02bf2000 00000020:02000400:3.0:1789708614.415310:0:15154:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789708615.270397:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789708615.621409:0:15354:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789708615.627527:0:15354:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1789708615.627583:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.627599:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.627605:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.627610:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.627623:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789708615.627627:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789708615.627651:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1789708615.627653:0:10362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708615.627661:0:10362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708615.627664:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789708615.627672:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1789708615.627674:0:10362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebfa00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708615.627679:0:10362:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789708615.627680:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9bee2f445000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789708615.627689:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708615.627691:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789708615.627693:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789708615.627705:0:10362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708615.627713:0:10362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708615.627718:0:10362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789708615.627721:0:10362:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789708615.627724:0:10362:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789708615.627756:0:10362:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708615.627763:0:10362:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708615.627797:0:10362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708615.627805:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfa00/0xf45f43947e47cd55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708615.627816:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708615.627819:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708615.627822:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708615.627824:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365521920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708615.627880:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708615.627921:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365521920 00000100:00100000:3.0:1789708615.627930:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365521920 00000100:00100000:3.0:1789708615.627980:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708615.627991:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3615:x1876645365521920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789708615.627997:0:6470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789708615 with bad export cookie 17608867373094783025 00010000:00010000:0.0:1789708615.628568:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.628577:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.628583:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.628589:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.628605:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708615.628611:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.628618:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.628625:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708615.628627:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708615.628634:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.628636:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708615.628647:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebe400 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:1.0:1789708615.628650:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708615.628658:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708615.628669:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708615.628672:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789708615.628674:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789708615.628681:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708615.628686:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.628690:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708615.628691:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708615.628703:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708615.628703:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708615.628706:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708615.628710:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708615.628726:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe400/0xf45f43947e47cd63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cd6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708615.628728:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebf000 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:0.0:1789708615.628728:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708615.628734:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708615.628741:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708615.628749:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708615.628753:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708615.628756:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.628756:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708615.628763:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365522048:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789708615.628774:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708615.628783:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789708615.628786:0:7426:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789708615.628786:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789708615.628792:0:7426:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789708615.628796:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708615.628803:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708615.628810:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708615.628813:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708615.628824:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708615.628824:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.628834:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708615.628843:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708615.628847:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365522048 00010000:00010000:0.0:1789708615.628849:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1789708615.628852:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365522048 10000000:01000000:0.0:1789708615.628854:0:15354:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1789708615.628860:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf000/0xf45f43947e47cc8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cc91 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708615.628866:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000100:00100000:1.0:1789708615.628878:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789708615.628879:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708615.628883:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708615.628887:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3616:x1876645365522048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708615.628891:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebf800 already unused, calling callback (ffffffffc13d2d20) 00000020:01000004:0.0:1789708615.628893:0:15354:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 10000000:00010000:2.0:1789708615.628895:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1789708615.628898:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00010000:2.0:1789708615.628901:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:1.0:1789708615.628904:0:6471:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789708615 with bad export cookie 17608867373094783025 00000020:00000080:0.0:1789708615.628904:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:2.0:1789708615.628911:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789708615.628912:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 10000000:01000000:2.0:1789708615.628918:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789708615.628921:0:7426:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000020:00080000:0.0:1789708615.628922:0:15354:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9bed08bfb800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1789708615.628924:0:7426:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:0.0:1789708615.628932:0:15354:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9bed08566800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789708615.628938:0:15354:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9bee3dd7cd40) has exports, disconnecting them 00010000:00010000:2.0:1789708615.628940:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708615.628943:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3616:x1876645365522048:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (143us total) trans 0 rc -107/-107 00000020:00080000:0.0:1789708615.628946:0:15354:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9bed08bfb800), last request at 1789708611 00010000:00010000:2.0:1789708615.628957:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1789708615.628957:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cc05 00000100:00100000:1.0:1789708615.628958:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789708615.628972:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789708615.628976:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9bed08bff800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789708615.628982:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebf800/0xf45f43947e47cfd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47cfd9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789708615.628991:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789708615.628994:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9bee18284800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789708615.629002:0:3616:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1789708615.629007:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708615.629011:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708615.629015:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebce00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708615.629017:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708615.629022:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789708615.629025:0:15354:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed08bfb800): rc 0 10000000:00010000:2.0:1789708615.629029:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789708615.629030:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bed08bfb800/lustre-MDT0001-lwp-OST0001_UUID 10000000:01000000:2.0:1789708615.629036:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789708615.629038:0:7426:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789708615.629039:0:7426:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:0.0:1789708615.629046:0:15354:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9bed08566800), last request at 1789708611 00000020:00000080:0.0:1789708615.629051:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cac3 00000100:00080000:0.0:1789708615.629057:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9bed08560000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789708615.629062:0:15354:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed08566800): rc 0 00000020:00000080:0.0:1789708615.629064:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bed08566800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789708615.629070:0:15354:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbde28223bad8 00000100:00080000:0.0:1789708615.629085:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708615.629091:0:15354:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9bed0a2ec000 x1876645365520000/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789708626 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708615.629100:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1789708615.629855:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789708615.629858:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9bee36e4e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1789708615.629880:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789708615.629893:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08bfb800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789708615.629920:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08566800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789708615.629941:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed08bff800 for lustre-MDT0001 00000020:00000080:0.0:1789708615.629944:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed08560000 for lustre-MDT0001 00000100:00080000:0.0:1789708615.630030:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789708615.630033:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789708615.630043:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789708615.630109:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789708615.630121:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9bee3dd52800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789708615.630133:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789708615.630136:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789708615.630144:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789708615.630200:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789708615.630209:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa16000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789708615.630230:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9bee3dd7cd40) has no exports 00000100:00100000:0.0:1789708615.630285:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365522432:0@lo:9:umount.0 00000100:00100000:0.0:1789708615.630315:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708615.630331:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365522560:0@lo:9:umount.0 00000100:00100000:0.0:1789708615.630342:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789708615.636384:0:3616:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.152@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789708615.636389:0:3616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789708615.636399:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a6a00 x1876645365521920/t0(0) o103->MGC192.168.201.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789708631 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708615.636421:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a2f2680 x1876645365522048/t0(0) o103->MGC192.168.201.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789708631 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789708615.636434:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789708615.636437:0:3616:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789708615.636438:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789708615.636441:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9bee18284800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708615.636445:0:3616:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 82 00000100:00080000:1.0:1789708615.636459:0:3616:0:(import.c:666:import_select_connection()) MGC192.168.201.152@tcp: import ffff9bee18284800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708615.636493:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365522432 00000100:00100000:1.0:1789708615.636515:0:10054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365522432 00000100:00100000:2.0:1789708615.636539:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365522560 00000100:00100000:2.0:1789708615.636545:0:8398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365522560 00000100:00100000:2.0:1789708615.636593:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789708615.636603:0:8398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876645365522560:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789708615.636630:0:8398:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ccbb 00000100:00080000:2.0:1789708615.636641:0:8398:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa70000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789708615.636643:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee048f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:0:1876645365522304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708615.636674:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789708615.636680:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0855fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:0:1876645365522176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708615.636684:0:10054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3701ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1876645365522432:12345-0@lo:9:umount.0 00000001:00000004:2.0:1789708615.636687:0:8398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000020:00000080:1.0:1789708615.636701:0:10054:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cb10 00000100:00080000:1.0:1789708615.636707:0:10054:0:(import.c:65:import_set_state_nolock()) ffff9bed084f0000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789708615.636713:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365520000:0@lo:41:osp-pre-0-1.0 00000001:00000004:1.0:1789708615.636729:0:10054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789708615.636895:0:10054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3701ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3614:x1876645365522432:12345-0@lo:9:umount.0 Request processed in 212us (6576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708615.636901:0:8398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3614:x1876645365522560:12345-0@lo:9:umount.0 Request processed in 289us (6545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708615.636905:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789708615.636915:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:2.0:1789708615.636959:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708615.637001:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3dd52800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789708615.637016:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789708615.637020:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789708615.637024:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365522432:0@lo:9:umount.0 00000100:00080000:2.0:1789708615.637045:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa16000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789708615.637056:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789708615.637059:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789708615.637063:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365522560:0@lo:9:umount.0 00000100:00080000:0.0:1789708615.637106:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789708615.637111:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789708615.637129:0:7426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708615.637133:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3615:1876645365521920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708615.637145:0:3616:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f2300 x1876645365522816/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1789708615.637146:0:7426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708615.637171:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708615.637181:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708615.637182:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47c926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47c92d expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708615.637182:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3614:1876645365522816:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:0.0:1789708615.637193:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:0:1876645365522688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708615.637205:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708615.637209:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708615.637213:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1789708615.637213:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876645365522816 offset 0 length 520: 4 00010000:00010000:0.0:1789708615.637225:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708615.637256:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3616:1876645365522048:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1789708615.639771:0:6470:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876645365521920 offset 224 length 224: 4 00000100:00100000:3.0:1789708615.639785:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3615:x1876645365521920:12345-0@lo:103:ldlm_bl.0 Request processed in 11797us (11904us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789708615.639799:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00080000:2.0:1789708615.644383:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9bee3dd7cd40) has no exports 00000020:01000000:2.0:1789708615.666835:0:15354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee2f470800 - data ffff9bee30ee1bd0/ffff9bed09718c00 00000020:01000000:2.0:1789708615.666957:0:15354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee2009a680 - data ffff9bee1ab62438/ffff9bee2f597000 00000001:00000004:2.0:1789708615.676392:0:15354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789708615.692108:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708615.692115:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789708615.692125:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789708615.693124:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789708615.693128:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789708615.693145:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789708615.693148:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789708615.693351:0:9132:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789708615.693357:0:9132:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789708615.693388:0:9132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789708615.693908:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789708615.693912:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789708615.693925:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789708615.693929:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789708615.694098:0:10252:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789708615.694102:0:10252:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789708615.694115:0:10252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789708615.694812:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c949 00000020:00000080:0.0:1789708615.694821:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee3dd77800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789708615.694850:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3dd77800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789708615.696068:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c95e 00000020:00000080:0.0:1789708615.696073:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee3dd72000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789708615.696082:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1789708615.696086:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708615.696093:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1789708615.696095:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3dd72000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00080000:0.0:1789708615.696097:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9bee2d9899c0) has no exports 00000004:01000000:0.0:1789708615.696246:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789708615.696252:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ccb4 00000020:00000080:0.0:1789708615.696256:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee3f9f1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789708615.696279:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789708615.696282:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708615.696289:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1789708615.696290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3f9f1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00080000:0.0:1789708615.696291:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff9bed08674d40) has no exports 00000020:00000080:0.0:1789708615.696298:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ccad 00000020:00000080:0.0:1789708615.696302:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee3fa11800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789708615.696316:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa11800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789708615.696691:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789708615.696694:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789708615.696701:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1789708615.696704:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789708615.696706:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789708615.696738:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708615.696739:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3fa16000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789708615.696745:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789708615.696750:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bed08bf8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789708615.696752:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08bf8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789708615.696759:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789708615.696827:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cb09 00000020:00000080:0.0:1789708615.696833:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee3727f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789708615.696842:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789708615.696846:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708615.696851:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1789708615.696853:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3727f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00080000:0.0:1789708615.696853:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9bed08673380) has no exports 00000020:00000080:0.0:1789708615.696859:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cb02 00000020:00000080:0.0:1789708615.696863:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee2f6a8800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789708615.696873:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f6a8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789708615.697167:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789708615.697170:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789708615.697171:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1789708615.697174:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789708615.697175:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789708615.697197:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3dd52800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789708615.697208:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708615.697213:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789708615.697215:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bed08564800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789708615.697216:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08564800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789708615.697223:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1789708615.697253:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789708615.697257:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c981 00000020:00000080:0.0:1789708615.697274:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee36e4c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789708615.697280:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1789708615.697283:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708615.697291:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee36e4c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789708615.697292:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789708615.697295:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9bee3dd7b380) has no exports 00000020:00000080:0.0:1789708615.697299:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c97a 00000020:00000080:0.0:1789708615.697302:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee36e4c800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789708615.697313:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee36e4c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789708615.699298:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1789708615.699302:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789708615.699305:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789708615.699315:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789708615.699343:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee36e4e800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789708615.699389:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708615.699396:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789708615.699400:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee36e4b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789708615.699403:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee36e4b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789708615.699409:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789708615.699610:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708615.699615:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789708615.699619:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee3dd51800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789708615.699621:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3dd51800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789708615.699627:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789708615.699832:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c965 00000020:00000080:1.0:1789708615.699838:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee3dd76000/lustre-MDD0001_UUID 00000020:01000000:1.0:1789708615.699850:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1789708615.699855:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708615.699860:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00000080:3.0:1789708615.699861:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3dd76000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00080000:1.0:1789708615.699864:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9bee3dd799c0) has no exports 00000020:00000080:1.0:1789708615.699895:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708615.699900:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1789708615.699902:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee3dd72800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789708615.699905:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3dd72800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789708615.699910:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789708615.700156:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c96c 00000020:00000080:1.0:1789708615.700168:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee3dd71800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1789708615.700182:0:15354:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee36337800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1789708615.700186:0:15354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee36337800 2 00000020:01000004:1.0:1789708615.700189:0:15354:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bee36337800 from lustre-MDT0001 00000020:00000080:3.0:1789708615.700190:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3dd71800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789708615.700213:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708615.700219:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1789708615.700221:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee3dd73800/lustre-MDT0001_UUID 00000020:00000080:1.0:1789708615.700224:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3dd73800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1789708615.700230:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1789708615.700294:0:15354:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1789708615.700299:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1789708615.700303:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708615.700313:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789708615.700320:0:15354:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9bee2f445800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708615.700326:0:15354:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9bee2f488000) has exports, disconnecting them 00000020:00080000:1.0:1789708615.700331:0:15354:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9bee2f445800), last request at 1789708518 00000020:00000080:1.0:1789708615.700335:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c9c0 00000020:00080000:1.0:1789708615.700346:0:15354:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bee2f445800): rc 0 00000020:00000080:1.0:1789708615.700350:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee2f445800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789708615.700386:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f445800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789708615.702981:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789708615.702986:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789708615.702990:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789708615.702996:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789708615.703022:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee2f445000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789708615.703157:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708615.703163:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789708615.703167:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee36330800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789708615.703171:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee36330800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789708615.703176:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789708615.703231:0:15354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee36337800 1 00000020:00000080:1.0:1789708615.703236:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c8fc 00000020:00000080:1.0:1789708615.703250:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee2d93e800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789708615.703279:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789708615.703283:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708615.703288:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789708615.703291:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9bee3dc3b380) has no exports 00000020:00000080:3.0:1789708615.703299:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2d93e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789708615.720107:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708615.720118:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789708615.720122:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee36336800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789708615.720125:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee36336800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789708615.720133:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789708615.720226:0:15354:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bee36334800 00000020:01000000:0.0:1789708615.720248:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789708615.720250:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708615.720253:0:15354:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789708615.720256:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9bee18164d40) has no exports 00000100:00100000:0.0:1789708615.720392:0:6483:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9bee18135a00:6483] 0 exiting: rc = 1 00000100:00100000:3.0:1789708615.720402:0:8421:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9bed084fae00:8421] 4 exiting: rc = 0 00000100:00100000:2.0:1789708615.720406:0:6512:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9bee2d950c00:6512] 3 exiting: rc = 0 00000100:00100000:1.0:1789708615.720414:0:13656:0:(service.c:3188:ptlrpc_main()) mdt00_005: service thread [ffff9bed097efa00:13656] 5 exiting: rc = 0 00000100:00100000:2.0:1789708615.720533:0:6484:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9bee10396200:6484] 1 exiting: rc = 0 00000100:00100000:1.0:1789708615.720578:0:6485:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9bee18135400:6485] 2 exiting: rc = 0 00000100:00100000:0.0:1789708615.720621:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720629:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720633:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720636:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720640:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720643:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720646:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720649:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720653:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720656:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720660:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720663:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720672:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720678:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720683:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720688:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720694:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720699:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720705:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720719:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720724:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720729:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720734:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720739:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720744:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720749:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720754:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720760:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720766:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720772:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720778:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720784:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720790:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720796:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720801:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720806:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720811:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720817:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720823:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720828:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720833:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720838:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720844:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720850:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720855:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720862:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720868:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720874:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720879:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720885:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720890:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720894:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720900:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720905:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720918:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720924:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720929:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720935:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720941:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720946:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720952:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720957:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720963:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.720968:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.724818:0:14125:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9bed098abc00:14125] 2 exiting: rc = 0 00000100:00100000:1.0:1789708615.724825:0:6486:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bee10396400:6486] 0 exiting: rc = 1 00000100:00100000:3.0:1789708615.724829:0:6487:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bee202f8200:6487] 1 exiting: rc = 0 00000100:00100000:0.0:1789708615.724860:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724869:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724877:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724886:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724895:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724901:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724909:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724915:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724921:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724925:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724929:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724933:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724936:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724940:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724943:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724946:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724949:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724952:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724954:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724957:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724960:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724963:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724966:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724969:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724972:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724982:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724985:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724989:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724992:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724995:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.724998:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725001:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725004:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725007:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725010:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725012:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725015:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725018:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725021:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725023:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725026:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725029:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725032:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725035:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725038:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725040:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725043:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725046:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725049:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725052:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725055:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725057:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725060:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725063:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725065:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725068:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725071:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725073:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725076:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725079:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725085:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725089:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725091:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725094:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.725468:0:6488:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9bee064d6200:6488] 0 exiting: rc = 1 00000100:00100000:3.0:1789708615.725499:0:8422:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9bed0866b800:8422] 2 exiting: rc = 0 00000100:00100000:1.0:1789708615.725509:0:6489:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9bee064d7c00:6489] 1 exiting: rc = 0 00000100:00100000:0.0:1789708615.725539:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725560:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725567:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725573:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725580:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725586:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725589:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725593:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725596:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725600:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725603:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725607:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725611:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725623:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725627:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725631:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725634:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725637:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725640:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725644:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725647:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725650:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725654:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725657:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725661:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725672:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725676:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725680:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725683:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725687:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725691:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725698:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725702:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725706:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725710:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725714:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725717:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725729:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725734:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725738:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725743:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725746:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725750:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725754:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725758:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725761:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725764:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725768:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725772:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725783:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725787:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725791:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725794:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725798:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725802:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725805:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725809:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725812:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725816:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725819:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725823:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725827:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725830:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.725837:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708615.772438:0:6490:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bee064d6400:6490] 0 exiting: rc = 1 00000100:00100000:3.0:1789708615.772441:0:6491:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bee202f9800:6491] 1 exiting: rc = 0 00000100:00100000:2.0:1789708615.772447:0:9135:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0002: service thread [ffff9bed07dcb200:9135] 2 exiting: rc = 0 00000100:00100000:0.0:1789708615.772529:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772543:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772557:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772563:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772569:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772574:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772579:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772584:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772589:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772595:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772600:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772605:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772610:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772615:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772620:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772625:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772630:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772635:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772642:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772647:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772651:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772656:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772661:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772666:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772672:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772677:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772682:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772686:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772691:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772696:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772701:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772706:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772712:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772717:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772722:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772727:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772732:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772745:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772750:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772756:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772761:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772765:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772770:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772776:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772782:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772787:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772793:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772798:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772803:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772808:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772813:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772818:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772823:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772828:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772833:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772838:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772842:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772848:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772853:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772859:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772864:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772869:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772874:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.772879:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708615.773277:0:6493:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bee066d4c00:6493] 1 exiting: rc = 0 00000100:00100000:2.0:1789708615.773284:0:6492:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bee066d5400:6492] 0 exiting: rc = 1 00000100:00100000:3.0:1789708615.773312:0:7442:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0002: service thread [ffff9bee2f51c800:7442] 2 exiting: rc = 0 00000100:00100000:0.0:1789708615.773381:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773390:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773395:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773401:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773406:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773411:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773416:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773421:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773434:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773439:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773444:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773450:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773455:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773460:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773466:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773471:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773477:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773482:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773488:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773493:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773498:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773503:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773508:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773514:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773519:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773524:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773530:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773535:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773540:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773545:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773551:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773556:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773562:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773567:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773573:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773578:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773583:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773588:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773594:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773599:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773604:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773610:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773615:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773629:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773634:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773640:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773645:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773650:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773655:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773661:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773665:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773670:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773675:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773680:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773685:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773690:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773696:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773701:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773706:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773711:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773717:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773722:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773727:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.773732:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.774130:0:6495:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bee05173600:6495] 1 exiting: rc = 0 00000100:00100000:1.0:1789708615.774160:0:9146:0:(service.c:3188:ptlrpc_main()) mdt_fld_0002: service thread [ffff9bee18106c00:9146] 2 exiting: rc = 0 00000100:00100000:3.0:1789708615.774186:0:6494:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bee182be400:6494] 0 exiting: rc = 1 00000100:00100000:0.0:1789708615.774324:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774337:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774345:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774354:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774363:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774383:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774388:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774394:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774399:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774405:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774409:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774415:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774421:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774426:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774439:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774444:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774449:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774454:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774459:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774465:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774469:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774475:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774480:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774485:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774490:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774495:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774501:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774506:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774511:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774516:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774521:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774526:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774530:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774535:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774541:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774546:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774551:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774556:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774561:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774566:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774571:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774576:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774582:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774587:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774593:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774598:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774603:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774608:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774614:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774628:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774633:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774638:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774642:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774647:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774652:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774658:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774664:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774669:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774674:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774679:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774683:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774688:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774693:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708615.774698:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.775559:0:6496:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9bee05173400:6496] 0 exiting: rc = 1 00000100:00100000:3.0:1789708615.775895:0:6497:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9bee05172c00:6497] 1 exiting: rc = 0 00000100:00100000:1.0:1789708615.775911:0:6498:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9bee05173200:6498] 2 exiting: rc = 0 00000100:00100000:2.0:1789708615.775985:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.775995:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776001:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776005:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776010:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776015:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776020:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776035:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776042:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776047:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776054:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776059:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776065:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776071:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776077:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776082:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776099:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776112:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776118:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776125:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776131:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776136:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776142:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776148:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776154:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776159:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776164:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776170:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776176:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776182:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776188:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776210:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776216:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776221:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776227:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776233:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776238:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776244:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776250:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776256:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776300:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776310:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776317:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776326:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776336:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776345:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776355:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776402:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776413:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776424:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776435:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776441:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776448:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776468:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776477:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776482:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776487:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776492:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776498:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776503:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776508:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776514:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776519:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708615.776524:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789708615.782521:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708615.782536:0:15354:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789708615.782553:0:15354:0:(genops.c:885:class_export_put()) final put ffff9bee18013800/MDS_uuid 00000020:00000080:2.0:1789708615.782558:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18013800/MDS_uuid for MDS 00000020:01000000:2.0:1789708615.782564:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789708615.782714:0:15354:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789708616.294445:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708616.550417:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708616.550424:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708616.550428:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708616.550432:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789708616.550436:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bed08567800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708616.550443:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 182 00000100:00080000:3.0:1789708616.550450:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789708616.550462:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bed08567800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708616.550498:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a3a4e00 x1876645365522944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708616.550546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708616.550573:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1789708616.550575:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365522944:0@lo:38:kworker.0 00000100:00080000:3.0:1789708616.550577:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bed09600000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708616.550585:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 182 00000100:00080000:3.0:1789708616.550588:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789708616.550594:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bed09600000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708616.550598:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365523072:0@lo:400:kworker.0 00000100:00100000:3.0:1789708616.550617:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a3a7480 x1876645365523200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1789708616.550633:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365522944 offset 0 length 520: 4 00000400:00000100:1.0:1789708616.550640:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365523072 offset 0 length 224: 4 00000100:00100000:0.0:1789708616.550663:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365523328:0@lo:400:kworker.0 00000100:00100000:2.0:1789708616.550692:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365523200:0@lo:38:kworker.0 00000400:00000100:0.0:1789708616.550696:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365523328 offset 0 length 224: 4 00000400:00000100:2.0:1789708616.550722:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365523200 offset 0 length 520: 4 00000020:01000004:0.0:1789708617.037624:0:15555:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789708617.045688:0:15555:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789708617.045737:0:15555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708617.045750:0:15555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708617.045758:0:15555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708617.045766:0:15555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708617.045791:0:15555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789708617.045802:0:15555:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789708617.045811:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708617.045819:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708617.045826:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebe800 already unused, calling callback (ffffffffc13d2d20) 00000100:00080000:0.0:1789708617.045828:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:1.0:1789708617.045830:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708617.045838:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708617.045840:0:15555:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a4e00 x1876645365522944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789708631 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:1.0:1789708617.045851:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708617.045856:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789708617.045862:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:01000000:1.0:1789708617.045864:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789708617.045868:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:0.0:1789708617.045869:0:15555:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789708617.045876:0:15555:0:(import.c:65:import_set_state_nolock()) ffff9bed08567800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789708617.045880:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1789708617.045882:0:6473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee18284800 00000100:00100000:0.0:1789708617.045883:0:15555:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a4e00 x1876645365522944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789708631 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789708617.045886:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708617.045903:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe800/0xf45f43947e47cd39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cd40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708617.045904:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789708617.045910:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:1.0:1789708617.045920:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708617.045923:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708617.045926:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708617.045927:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365522944:0@lo:38:kworker.0 00000100:00080000:0.0:1789708617.046610:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789708617.046614:0:15555:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a5f80 x1876645365523072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708632 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708617.046625:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789708617.046627:0:15555:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789708617.046641:0:15555:0:(import.c:65:import_set_state_nolock()) ffff9bed08567000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789708617.046652:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365523072:0@lo:400:kworker.0 00000100:00100000:2.0:1789708617.046715:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876645365523456:0@lo:39:umount.0 00000400:00000100:2.0:1789708617.046753:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365523456 offset 0 length 224: 4 00010000:00010000:0.0:1789708617.318442:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708618.342445:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708619.366384:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708620.390450:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708620.582387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708620.582396:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708620.582399:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708620.582403:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789708620.582489:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708620.582512:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365523584:0@lo:400:kworker.0 00000400:00000100:1.0:1789708620.582561:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365523584 offset 0 length 224: 4 00000001:00100000:0.0:1789708621.159595:0:8392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789708621.159601:0:8392:0:(genops.c:885:class_export_put()) final put ffff9bed084f6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789708621.159643:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed084f6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789708621.159692:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed084f0000 for lustre-OST0000 00000001:00100000:3.0:1789708621.162653:0:9480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789708621.162661:0:9480:0:(genops.c:885:class_export_put()) final put ffff9bee3fa71800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789708621.162724:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa71800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789708621.162781:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3fa70000 for lustre-OST0001 00010000:00010000:0.0:1789708621.414459:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708621.606376:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708621.606384:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708621.606386:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708621.606389:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789708621.606493:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365523712:0@lo:400:kworker.0 00000400:00000100:0.0:1789708621.606541:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365523712 offset 0 length 224: 4 00010000:00010000:0.0:1789708622.438442:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708623.462404:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708624.486376:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708625.190394:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708615/real 1789708615] req@ffff9bed0a2f2300 x1876645365522816/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789708625 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708625.190427:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bed0a2f2300 x1876645365522816/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789708625 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789708625.190445:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee18284800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708625.190470:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789708625.190475:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3614:1876645365522816:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1789708625.190533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708625.190539:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789708625.190542:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee18284800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708625.190547:0:37:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 186 00000100:00080000:3.0:1789708625.190567:0:37:0:(import.c:630:import_select_connection()) MGC192.168.201.152@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789708625.190577:0:37:0:(import.c:666:import_select_connection()) MGC192.168.201.152@tcp: import ffff9bee18284800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708625.190600:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a3a5500 x1876645365523840/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708625.190617:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708625.190620:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789708625.190654:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3614:1876645365523840:0@lo:250:kworker.0 00000100:00100000:1.0:1789708625.190687:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365523968:0@lo:400:kworker.0 00000400:00000100:2.0:1789708625.190698:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876645365523840 offset 0 length 520: 4 00000400:00000100:1.0:1789708625.190723:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365523968 offset 0 length 224: 4 00010000:00010000:0.0:1789708625.510474:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708626.534421:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708627.238386:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708617/real 1789708617] req@ffff9bed0a2cf480 x1876645365523456/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708627 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708627.238417:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bed0a2cf480 x1876645365523456/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708627 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789708627.238447:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08567000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789708627.238467:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876645365523456:0@lo:39:umount.0 00000100:00080000:0.0:1789708627.238524:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789708627.238530:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789708627.238534:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789708627.239425:0:15555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708627.239437:0:15555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708627.239445:0:15555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708627.239451:0:15555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708627.239470:0:15555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708627.239477:0:15555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708627.239484:0:15555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708627.239490:0:15555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708627.239497:0:15555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708627.239504:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708627.239513:0:15555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708627.239516:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708627.239519:0:15555:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1789708627.239527:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebe000 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708627.239531:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708627.239542:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708627.239545:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708627.239552:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708627.239554:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789708627.239557:0:15555:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789708627.239563:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:1.0:1789708627.239568:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948600 already unused, calling callback (ffffffffc13d2d20) 00000020:00000080:0.0:1789708627.239572:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:1.0:1789708627.239573:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708627.239574:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00000080:0.0:1789708627.239578:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:01000000:2.0:1789708627.239582:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00000020:00080000:0.0:1789708627.239585:0:15555:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9bee2f4899c0) has no exports 10000000:01000000:2.0:1789708627.239588:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789708627.239589:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708627.239600:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708627.239603:0:6472:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee18284800 10000000:01000000:1.0:1789708627.239604:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789708627.239608:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789708627.239610:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708627.239610:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:0.0:1789708627.239615:0:15555:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9bee2f4899c0) has no exports 00010000:00010000:1.0:1789708627.239619:0:6473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee18284800 00010000:00010000:2.0:1789708627.239623:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe000/0xf45f43947e47cd47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cd4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708627.239624:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708627.239629:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee3e948600/0xf45f43947e47cfc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cfcb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708627.239639:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708627.239642:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708627.239644:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708627.239648:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708627.239651:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708627.239653:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789708627.241197:0:15555:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bed09812b80 - data ffff9bee30e9c288/ffff9bed0970a400 00000020:01000000:0.0:1789708627.241365:0:15555:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee2f470b00 - data ffff9bee30ee3438/ffff9bed07e45c00 00100000:10000000:0.0:1789708627.250795:0:15555:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789708627.255106:0:15555:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ca7d 00000020:00000080:1.0:1789708627.255118:0:15555:0:(genops.c:885:class_export_put()) final put ffff9bed07d3a000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789708627.255135:0:15555:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee2f569800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789708627.255139:0:15555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee2f569800 2 00000020:01000004:1.0:1789708627.255142:0:15555:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bee2f569800 from lustre-OST0000 00000020:00000080:2.0:1789708627.255149:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed07d3a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789708627.255181:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708627.255189:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789708627.255192:0:15555:0:(genops.c:885:class_export_put()) final put ffff9bed07d38000/lustre-OST0000_UUID 00000020:00000080:1.0:1789708627.255195:0:15555:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed07d38000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789708627.255201:0:15555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789708627.255284:0:15555:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789708627.255288:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789708627.255292:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708627.255297:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789708627.255308:0:15555:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bed08564000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708627.255314:0:15555:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9bee10da8000) has exports, disconnecting them 00000020:00080000:1.0:1789708627.255318:0:15555:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bed08564000), last request at 1789708524 00000020:00000080:1.0:1789708627.255322:0:15555:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47caa7 00000020:00080000:1.0:1789708627.255331:0:15555:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed08564000): rc 0 00000020:00000080:1.0:1789708627.255336:0:15555:0:(genops.c:885:class_export_put()) final put ffff9bed08564000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789708627.255354:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08564000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789708627.257208:0:15555:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789708627.257212:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789708627.257217:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789708627.257222:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789708627.257250:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed08567800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789708627.257458:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708627.257464:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789708627.257468:0:15555:0:(genops.c:885:class_export_put()) final put ffff9bee36333000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789708627.257471:0:15555:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee36333000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789708627.257476:0:15555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789708627.257514:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789708627.257517:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708627.257521:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789708627.257525:0:15555:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9bed08562800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708627.257529:0:15555:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff9bed086719c0) has exports, disconnecting them 00000020:00080000:1.0:1789708627.257533:0:15555:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9bed08562800), last request at 1789708524 00000020:00000080:1.0:1789708627.257536:0:15555:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cabc 00000020:00080000:1.0:1789708627.257544:0:15555:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed08562800): rc 0 00000020:00000080:1.0:1789708627.257547:0:15555:0:(genops.c:885:class_export_put()) final put ffff9bed08562800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789708627.257581:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08562800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789708627.259315:0:15555:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789708627.259320:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789708627.259323:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789708627.259328:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789708627.259358:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed08567000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789708627.259519:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708627.259525:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789708627.259530:0:15555:0:(genops.c:885:class_export_put()) final put ffff9bed08562000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789708627.259533:0:15555:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08562000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789708627.259543:0:15555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789708627.259597:0:15555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee2f569800 1 00000020:00000080:0.0:1789708627.259603:0:15555:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ca45 00000020:00000080:0.0:1789708627.259609:0:15555:0:(genops.c:885:class_export_put()) final put ffff9bee2f446000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789708627.259619:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789708627.259624:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708627.259628:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1789708627.259630:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f446000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:0.0:1789708627.259631:0:15555:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9bee3dc38000) has no exports 00000020:00000080:1.0:1789708627.274059:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708627.274069:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789708627.274075:0:15555:0:(genops.c:885:class_export_put()) final put ffff9bee2f56c800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789708627.274079:0:15555:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f56c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789708627.274092:0:15555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789708627.274321:0:15555:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bee2f56a800 00000020:02000400:1.0:1789708627.274403:0:15555:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789708627.560380:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789708628.511761:0:15756:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789708628.519579:0:15756:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789708628.519654:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708628.519666:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708628.519674:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708628.519680:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708628.519700:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789708628.519705:0:15756:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789708628.519721:0:10362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708628.519731:0:10362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789708628.519732:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789708628.519743:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a7480 x1876645365523200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789708631 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789708628.519743:0:10362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508e00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708628.519755:0:10362:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708628.519757:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789708628.519763:0:15756:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1789708628.519766:0:10362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789708628.519770:0:15756:0:(import.c:65:import_set_state_nolock()) ffff9bed09600000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:00010000:0.0:1789708628.519772:0:10362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789708628.519775:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:0.0:1789708628.519779:0:10362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789708628.519781:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a7480 x1876645365523200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789708631 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789708628.519782:0:10362:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789708628.519786:0:10362:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1789708628.519794:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789708628.519798:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:0.0:1789708628.519800:0:10362:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee18284800 00010000:00010000:0.0:1789708628.519804:0:10362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708628.519805:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365523200:0@lo:38:kworker.0 00010000:00010000:0.0:1789708628.519816:0:10362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01508e00/0xf45f43947e47cd1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cd24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708628.519827:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708628.519829:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708628.519832:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789708628.520528:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789708628.520535:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a4380 x1876645365523328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708632 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708628.520552:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a4700 x1876645365523584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708636 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708628.520560:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a6d80 x1876645365523712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708637 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708628.520572:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a4a80 x1876645365523968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708641 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708628.520582:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1789708628.520597:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365523584:0@lo:400:kworker.0 00000100:00100000:1.0:1789708628.520605:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365523968:0@lo:400:kworker.0 00000100:00100000:2.0:1789708628.520618:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365523328:0@lo:400:kworker.0 00000100:00080000:1.0:1789708628.520625:0:15756:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789708628.520644:0:15756:0:(import.c:65:import_set_state_nolock()) ffff9bed07d39800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789708628.520849:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365523712:0@lo:400:kworker.0 00000100:00100000:3.0:1789708628.520879:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876645365524096:0@lo:39:umount.0 00000400:00000100:3.0:1789708628.520919:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365524096 offset 0 length 224: 4 00010000:00010000:1.0:1789708628.582433:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708629.606388:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708630.374399:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789708630.374409:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789708630.630435:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708631.654419:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708632.678491:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708633.702386:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708634.726462:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708635.494433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789708635.494446:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789708635.750436:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708636.774463:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708637.798505:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708638.758512:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708628/real 1789708628] req@ffff9bed0a2f2680 x1876645365524096/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708638 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708638.758556:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bed0a2f2680 x1876645365524096/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708638 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789708638.758579:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed07d39800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789708638.758610:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876645365524096:0@lo:39:umount.0 00000100:00080000:1.0:1789708638.758728:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789708638.758735:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789708638.758741:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789708638.759780:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708638.759795:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708638.759803:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708638.759830:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708638.759853:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708638.759861:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708638.759867:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708638.759873:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708638.759879:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708638.759964:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789708638.759971:0:15756:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:0.0:1789708638.759971:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708638.759982:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789708638.760010:0:15756:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789708638.760016:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789708638.760022:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708638.760028:0:15756:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789708638.760033:0:15756:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9bed08670000) has no exports 00010000:00010000:0.0:1789708638.760036:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebe600 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708638.760042:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708638.760053:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708638.760061:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789708638.760065:0:15756:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9bed08670000) has no exports 10000000:01000000:0.0:1789708638.760072:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708638.760076:0:7426:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789708638.760078:0:7426:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789708638.760095:0:7426:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee18284800 00010000:00010000:0.0:1789708638.760099:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708638.760106:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebe600/0xf45f43947e47cd2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cd32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708638.760119:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708638.760122:0:7426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708638.760127:0:7426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd000 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708638.760147:0:7426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708638.760154:0:7426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708638.760160:0:7426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708638.760164:0:7426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789708638.760166:0:7426:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789708638.760167:0:7426:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789708638.760172:0:7426:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee18284800 00010000:00010000:0.0:1789708638.760175:0:7426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708638.760180:0:7426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd000/0xf45f43947e47cfb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cfbd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708638.760193:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708638.760194:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708638.760197:0:7426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789708638.761801:0:15756:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee2f470380 - data ffff9bee30f21288/ffff9bee3e822c00 00000020:01000000:1.0:1789708638.761929:0:15756:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee2f470200 - data ffff9bee30f0c798/ffff9bee37217400 00010000:00010000:3.0:1789708638.761989:0:10362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789708638.769983:0:15756:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789708638.776190:0:15756:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cbbf 00000020:00000080:2.0:1789708638.776207:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bed08bfe000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789708638.776225:0:15756:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bed08a9c000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789708638.776230:0:15756:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed08a9c000 2 00000020:01000004:2.0:1789708638.776234:0:15756:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bed08a9c000 from lustre-OST0001 00000020:00000080:0.0:1789708638.776241:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08bfe000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789708638.776302:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708638.776314:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789708638.776318:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bed08bfe800/lustre-OST0001_UUID 00000020:00000080:2.0:1789708638.776321:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08bfe800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789708638.776329:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789708638.776518:0:15756:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5->MGS 00010000:00010000:2.0:1789708638.776539:0:15756:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd200/0xf45f43947e47c918 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47c91f expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708638.776565:0:15756:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd200/0xf45f43947e47c918 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47c91f expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708638.776572:0:15756:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789708638.776576:0:15756:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789708638.776579:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789708638.776598:0:15756:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee18284800 00010000:00010000:2.0:1789708638.776601:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebd200/0xf45f43947e47c918 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47c91f expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708638.776617:0:15756:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47cd94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708638.776625:0:15756:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47cd94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708638.776630:0:15756:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789708638.776632:0:15756:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789708638.776634:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789708638.776644:0:15756:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee18284800 00010000:00010000:2.0:1789708638.776647:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebfe00/0xf45f43947e47cd8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47cd94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789708638.776666:0:15756:0:(import.c:65:import_set_state_nolock()) ffff9bee18284800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789708638.776671:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789708638.776675:0:15756:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789708638.776676:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789708638.776681:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789708638.776695:0:15756:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a3a5500 x1876645365523840/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789708640 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789708638.776725:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789708638.776728:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1789708638.776766:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5:3614:1876645365523840:0@lo:250:kworker.0 10000000:01000000:2.0:1789708638.776789:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789708638.776797:0:15756:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47c823 00000020:00000080:2.0:1789708638.776803:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bee18283000/88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5 00000020:01000000:2.0:1789708638.776817:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.152@tcp (flags='') 00000020:00000080:2.0:1789708638.776822:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708638.776827:0:15756:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789708638.776831:0:15756:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9bee18160000) has no exports 00000020:00000080:0.0:1789708638.776837:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18283000/88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5 for MGC192.168.201.152@tcp 10000000:01000000:1.0:1789708638.776890:0:6481:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789708638.776899:0:15756:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.152@tcp: client import never connected 00000100:00080000:2.0:1789708638.776902:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789708638.776905:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789708638.776908:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789708638.776910:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789708638.776955:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee18284800 for MGC192.168.201.152@tcp 00000020:00000080:2.0:1789708638.776972:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708638.776978:0:15756:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.152@tcp (uuid 88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5) 00000020:00000080:2.0:1789708638.776981:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bee0a8be800/88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5 00000020:00000080:2.0:1789708638.776983:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee0a8be800/88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5 for MGC192.168.201.152@tcp 00000020:01000000:2.0:1789708638.776989:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.152@tcp (88a3ed3f-8f9c-4cc7-a3c3-2690f02cd7c5) 00000020:01000000:2.0:1789708638.777285:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789708638.777289:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708638.777295:0:15756:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789708638.777301:0:15756:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bed09601800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789708638.777307:0:15756:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff9bed095fcd40) has exports, disconnecting them 00000020:00080000:2.0:1789708638.777313:0:15756:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bed09601800), last request at 1789708531 00000020:00000080:2.0:1789708638.777318:0:15756:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cbe9 00000020:00080000:2.0:1789708638.777330:0:15756:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed09601800): rc 0 00000020:00000080:2.0:1789708638.777334:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bed09601800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789708638.777364:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed09601800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789708638.778312:0:15756:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789708638.778316:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789708638.778320:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789708638.778324:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789708638.778359:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed09600000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789708638.778526:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708638.778534:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789708638.778539:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bed09603000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789708638.778543:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed09603000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789708638.778553:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789708638.778626:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789708638.778630:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708638.778635:0:15756:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789708638.778639:0:15756:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9bee3fa76000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789708638.778652:0:15756:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff9bed09710000) has exports, disconnecting them 00000020:00080000:3.0:1789708638.778657:0:15756:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9bee3fa76000), last request at 1789708531 00000020:00000080:3.0:1789708638.778661:0:15756:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cbfe 00000020:00080000:3.0:1789708638.778674:0:15756:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bee3fa76000): rc 0 00000020:00000080:3.0:1789708638.778679:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bee3fa76000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789708638.778712:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa76000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789708638.779927:0:15756:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789708638.779958:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789708638.779961:0:15756:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789708638.779966:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789708638.779993:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed07d39800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789708638.780024:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789708638.780074:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789708638.780118:0:7426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1789708638.780243:0:10362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1789708638.780395:0:6468:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bee06535a00:6468] 1 exiting: rc = 0 00000100:00100000:2.0:1789708638.780414:0:6467:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bee06534600:6467] 0 exiting: rc = 1 00000100:00100000:0.0:1789708638.780488:0:7425:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9bee1898ae00:7425] 2 exiting: rc = 0 00000100:00100000:0.0:1789708638.780622:0:9489:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_003: service thread [ffff9bed08713600:9489] 3 exiting: rc = 0 00000100:00100000:2.0:1789708638.780685:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708638.781038:0:6469:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bee05131400:6469] 0 exiting: rc = 1 00000100:00100000:0.0:1789708638.781077:0:7427:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9bee1898ba00:7427] 4 exiting: rc = 0 00000100:00100000:1.0:1789708638.781119:0:6471:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bee05130e00:6471] 2 exiting: rc = 0 00000100:00100000:1.0:1789708638.781222:0:6514:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bee18125000:6514] 3 exiting: rc = 0 00000100:00100000:0.0:1789708638.781236:0:8413:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_005: service thread [ffff9bed07dc9600:8413] 5 exiting: rc = 0 00000100:00100000:3.0:1789708638.781313:0:6470:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bee05130200:6470] 1 exiting: rc = 0 00000100:00100000:2.0:1789708638.781516:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781525:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781532:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781538:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781544:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781550:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781558:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781565:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781572:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781579:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781584:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781590:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781596:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781602:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781609:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781615:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781621:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781628:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781635:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781641:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781647:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781654:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781660:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781666:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781672:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781677:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781683:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781689:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781702:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781708:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781713:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781717:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781721:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781725:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781728:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781734:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781739:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781745:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781751:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781757:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781763:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781768:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781774:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781780:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781786:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781792:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781798:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781803:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781809:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781814:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781820:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781825:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781830:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781836:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781842:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781847:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781852:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781856:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781861:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781866:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781870:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781874:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781878:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.781887:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789708638.782702:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708638.782713:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789708638.782719:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bed08a9d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789708638.782724:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08a9d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789708638.782729:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789708638.782782:0:15756:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed08a9c000 1 00000020:00000080:2.0:1789708638.782789:0:15756:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47cb8e 00000020:00000080:2.0:1789708638.782796:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bee3727e800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789708638.782813:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789708638.782818:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708638.782823:0:15756:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789708638.782826:0:15756:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff9bee2f48b380) has no exports 00000020:00000080:1.0:1789708638.782845:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3727e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789708638.795484:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708638.795498:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789708638.795503:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bed08a98800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789708638.795508:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08a98800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789708638.795513:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789708638.795808:0:15756:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bed08a9b000 00000020:01000000:3.0:1789708638.795834:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789708638.795838:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708638.795841:0:15756:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789708638.795844:0:15756:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9bee2f48cd40) has no exports 00000020:00000080:3.0:1789708638.795861:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708638.795864:0:15756:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789708638.795866:0:15756:0:(genops.c:885:class_export_put()) final put ffff9bee2f442000/OSS_uuid 00000020:00000080:3.0:1789708638.795867:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f442000/OSS_uuid for OSS 00000020:01000000:3.0:1789708638.795870:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789708638.795910:0:6480:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789708638.795988:0:8398:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9bee2f559600:8398] 1 exiting: rc = 0 00000100:00100000:1.0:1789708638.795995:0:8399:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9bee2f558e00:8399] 2 exiting: rc = 0 00000100:00100000:2.0:1789708638.796078:0:8397:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9bee06534a00:8397] 0 exiting: rc = 1 00000100:00100000:0.0:1789708638.796089:0:9145:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9bee18107a00:9145] 3 exiting: rc = 0 00000100:00100000:2.0:1789708638.796136:0:10054:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff9bee3e869600:10054] 4 exiting: rc = 0 00000100:00100000:3.0:1789708638.796210:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796224:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796232:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796240:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796252:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796283:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796292:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796300:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796311:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796327:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796333:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796340:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796346:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796352:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796359:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796365:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796371:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796376:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796382:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796389:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796394:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796400:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796407:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796413:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796419:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796426:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796432:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796439:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796445:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796451:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796457:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796463:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796469:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796474:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796480:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796495:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796500:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796506:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796512:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796518:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796525:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796531:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796537:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796543:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796555:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796564:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796570:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796576:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796582:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796588:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796594:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796600:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796607:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796613:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796620:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796625:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796631:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796637:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796643:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796651:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796658:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796664:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796671:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.796677:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708638.797640:0:8401:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bee2f51f600:8401] 1 exiting: rc = 0 00000100:00100000:2.0:1789708638.797652:0:13774:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9bed09bf8200:13774] 2 exiting: rc = 0 00000100:00100000:0.0:1789708638.797665:0:8400:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bee2f559c00:8400] 0 exiting: rc = 1 00000100:00100000:3.0:1789708638.797695:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797705:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797716:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797723:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797727:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797736:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797750:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797755:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797761:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797766:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797772:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797778:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797782:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797786:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797790:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797796:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797802:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797810:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797816:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797822:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797827:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797832:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797836:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797840:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797843:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797847:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797851:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797854:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797857:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797860:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797863:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797865:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797868:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797872:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797876:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797880:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797883:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797886:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797889:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797893:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797897:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797906:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797910:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797913:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797917:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797920:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797924:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797927:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797931:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797935:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797959:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797964:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797968:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797971:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797975:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797978:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797981:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797985:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797988:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797992:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797995:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.797998:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.798001:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.798005:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.801487:0:8404:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bee1107fa00:8404] 2 exiting: rc = 0 00000100:00100000:0.0:1789708638.801494:0:8402:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bee2f51ca00:8402] 0 exiting: rc = 1 00000100:00100000:1.0:1789708638.801928:0:8403:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bee37252400:8403] 1 exiting: rc = 0 00000100:00100000:2.0:1789708638.802016:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802026:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802031:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802042:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802054:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802059:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802064:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802068:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802080:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802084:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802089:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802093:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802100:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802108:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802129:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802136:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802142:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802147:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802152:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802188:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802198:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802205:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802209:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802214:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802218:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802223:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802226:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802231:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802234:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802238:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802242:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802246:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802249:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802253:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802257:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802284:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802293:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802301:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802310:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802322:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802328:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802333:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802344:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802369:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802377:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802383:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802389:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802395:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802401:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802415:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802420:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802427:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802435:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802441:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802448:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802463:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802472:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802486:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802499:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802504:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802509:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802513:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802517:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.802521:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708638.808748:0:8405:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bee37253200:8405] 0 exiting: rc = 1 00000100:00100000:0.0:1789708638.808791:0:8406:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bee07e0de00:8406] 1 exiting: rc = 0 00000100:00100000:3.0:1789708638.808861:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808877:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808884:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808895:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808901:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808905:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808907:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808911:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808914:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808917:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808919:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.808922:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809029:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809032:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809036:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809039:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809042:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809045:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809048:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809051:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809054:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809057:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809060:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809062:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809065:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809068:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809070:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809073:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809094:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809098:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809101:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809104:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809107:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809110:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809113:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809116:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809119:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809121:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809124:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809127:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809130:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809132:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809135:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809138:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809141:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809145:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809149:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809160:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809164:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809169:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809174:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809178:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809184:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809188:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809194:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809199:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809204:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809209:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809214:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809219:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809224:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809229:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809235:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.809242:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708638.809921:0:8407:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bed03ca7800:8407] 0 exiting: rc = 1 00000100:00100000:2.0:1789708638.809960:0:8408:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bed07dc9800:8408] 1 exiting: rc = 0 00000100:00100000:3.0:1789708638.810019:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810031:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810036:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810039:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810043:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810047:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810058:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810062:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810066:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810069:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810084:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810088:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810092:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810096:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810101:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810105:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810109:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810112:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810130:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810134:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810138:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810141:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810146:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810151:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810156:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810162:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810181:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810186:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810192:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810198:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810217:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810225:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810230:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810234:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810238:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810242:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810246:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810250:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810254:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810257:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810363:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810379:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810425:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810468:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810478:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810492:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810504:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810509:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810513:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810517:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810521:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810524:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810528:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810539:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810554:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810558:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810561:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810565:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810569:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810572:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810576:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810579:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810582:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708638.810590:0:15756:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789708638.843845:0:15756:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789708645.264684:0:16520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789708648.962608:0:17118:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789708648.962613:0:17118:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789708648.962614:0:17118:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789708648.962718:0:17118:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bed0a28c800 00000020:01000004:2.0:1789708648.962732:0:17118:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789708648.962760:0:17118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789708648.962774:0:17118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bed095fb380) 00000020:00000080:2.0:1789708648.962786:0:17118:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789708648.989284:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.990131:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789708648.990824:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789708648.991802:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789708648.992071:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789708648.992208:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789708648.992376:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789708648.992534:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789708648.992670:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789708648.992889:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789708648.993068:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789708648.993234:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789708648.993401:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789708648.993547:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789708648.993715:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789708648.994320:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.994434:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.994565:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.994711:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.994868:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.995010:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.995146:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.995278:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.995415:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.995564:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.995716:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.995882:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.996024:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.996164:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.998205:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.998508:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.998658:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.998849:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.999029:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.999163:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789708648.999313:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.999431:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.999571:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.999722:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789708648.999912:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789708649.000052:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789708649.000190:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789708649.000327:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789708649.000457:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789708649.000598:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789708649.000735:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789708649.000898:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789708649.001643:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789708649.001889:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789708649.002002:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789708649.002277:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789708649.002469:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789708649.002627:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1789708649.003215:0:17118:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789708649.003477:0:17118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789708649.003484:0:17118:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789708649.003495:0:17118:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47dd62 00000020:01000004:2.0:1789708649.003503:0:17118:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789708649.003508:0:17118:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789708649.003514:0:17118:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bed0a28c800 from MGS 00000020:01000004:2.0:1789708649.003521:0:17118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789708649.003529:0:17118:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bed095f8000) 00000020:00000080:2.0:1789708649.003536:0:17118:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789708649.003587:0:17118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed0a28c800 from MGS, refs=2 00080000:01000000:2.0:1789708649.003592:0:17118:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789708649.003597:0:17118:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47dd70 00000100:00100000:2.0:1789708649.003693:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789708649.003816:0:17118:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789708649.003822:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789708649.004091:0:17118:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789708649.004098:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789708649.004877:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708649.004994:0:17118:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789708649.004998:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789708649.005315:0:17118:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789708649.005322:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789708649.005503:0:17118:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789708649.005510:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789708649.005884:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708649.005888:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708649.005890:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708649.006056:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708649.006059:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708649.006061:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708649.006377:0:17118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789708649.007298:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789708649.008925:0:17118:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789708649.009496:0:17130:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789708649.009521:0:17118:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789708649.009559:0:17118:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789708649.010048:0:17118:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789708649.010863:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708649.011022:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789708649.011028:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789708649.011469:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789708649.011477:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789708649.011641:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789708649.011648:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1789708649.011967:0:17135:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1789708649.012152:0:17118:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789708649.012170:0:17118:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.152@tcp' 00000020:01000004:0.0:1789708649.012172:0:17118:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789708649.012199:0:17118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.152@tcp (typ=mgc) 00000020:00000080:0.0:1789708649.012211:0:17118:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.152@tcp (ffff9bed09714d40) 00000020:00000080:0.0:1789708649.012225:0:17118:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789708649.012328:0:17118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee06859000@MGC192.168.201.152@tcp: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1789708649.012496:0:17118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.152@tcp-0 is initialized 00000040:01000000:0.0:1789708649.012503:0:17118:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789708649.013853:0:17136:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789708649.013921:0:17118:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.152@tcp (uuid fda82b2e-0d6b-4cb4-a087-54f6744e5277) 00000020:00000080:1.0:1789708649.013939:0:17118:0:(genops.c:1384:class_connect()) connect: client fda82b2e-0d6b-4cb4-a087-54f6744e5277, cookie 0xf45f43947e47dd7e 00000100:00080000:1.0:1789708649.013949:0:17118:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708649.013958:0:17118:0:(import.c:666:import_select_connection()) MGC192.168.201.152@tcp: import ffff9bee06859000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708649.014004:0:17118:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f3100 x1876645365524224/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708649.014033:0:17118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS 00000020:01000004:1.0:1789708649.014050:0:17118:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789708649.014055:0:17118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789708649.014066:0:17118:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bee3dc38000) 00000020:00000080:1.0:1789708649.014078:0:17118:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789708649.014083:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3614:1876645365524224:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789708649.014151:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708649.014237:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365524224 00000100:00100000:0.0:1789708649.014244:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365524224 00000100:00100000:0.0:1789708649.014303:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708649.014311:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09858850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3614:x1876645365524224:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789708649.014334:0:17132:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from fda82b2e-0d6b-4cb4-a087-54f6744e5277@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:0.0:1789708649.014354:0:17132:0:(genops.c:1384:class_connect()) connect: client fda82b2e-0d6b-4cb4-a087-54f6744e5277, cookie 0xf45f43947e47dd8c 00000100:00080000:0.0:1789708649.014475:0:17132:0:(import.c:65:import_set_state_nolock()) ffff9bee0685e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708649.014527:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09858850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+5:3614:x1876645365524224:12345-0@lo:250:mount.lustre.0 Request processed in 215us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.014535:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708649.014576:0:3614:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789708649.014584:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.152@tcp: connect to target with instance 0 00000100:00080000:0.0:1789708649.014590:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789708649.014594:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789708649.014597:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee06859000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789708649.014600:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789708649.014607:0:3614:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789708649.014612:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3614:1876645365524224:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789708649.025048:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708649.025238:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789708649.025245:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789708649.025814:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789708649.025821:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789708649.026108:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789708649.026115:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789708649.026970:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708649.027125:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789708649.027130:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789708649.027441:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789708649.027448:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789708649.077218:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708649.077421:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789708649.077427:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789708649.078545:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789708649.078552:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789708649.079156:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708649.079334:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789708649.079339:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789708649.079665:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789708649.079671:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789708649.080195:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708649.080373:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789708649.080379:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789708649.081129:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789708649.081137:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789708649.081690:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708649.081802:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789708649.081805:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789708649.082110:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789708649.082116:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789708649.099476:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708649.099655:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789708649.099666:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789708649.100674:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789708649.100679:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789708649.101412:0:17118:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789708649.101416:0:17118:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789708649.102293:0:17118:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789708649.102314:0:17118:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789708649.102319:0:17118:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789708649.102401:0:17118:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789708649.102426:0:17118:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789708649.102429:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789708649.102431:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789708649.102432:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708649.102433:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708649.102433:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708649.102434:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708649.102435:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708649.102436:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789708649.102437:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708649.102438:0:17118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789708649.102440:0:17118:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789708649.102442:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708649.102442:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789708649.102443:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708649.102444:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708649.102444:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708649.102445:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708649.102445:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708649.102446:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789708649.102447:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708649.102448:0:17118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789708649.102474:0:17118:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789708649.102489:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524352:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789708649.102543:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708649.102572:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365524352 00000100:00100000:0.0:1789708649.102579:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365524352 00000100:00100000:1.0:1789708649.102580:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.102610:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708649.102618:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+5:17118:x1876645365524352:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789708649.102663:0:17134:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789708649.102665:0:17134:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789708649.102667:0:17134:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789708649.102835:0:17154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789708649.103112:0:17134:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1789708649.103893:0:17155:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789708649.103896:0:17155:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789708649.103898:0:17155:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789708649.103900:0:17155:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789708649.104034:0:17155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789708649.104124:0:17134:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789708649.104129:0:17134:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789708649.104883:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+5:17118:x1876645365524352:12345-0@lo:253:mount.lustre.0 Request processed in 2264us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.104892:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708649.104919:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524352:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789708649.104932:0:17118:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789708649.104934:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789708649.104935:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789708649.104936:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708649.104937:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708649.104937:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708649.104938:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708649.104939:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708649.104940:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789708649.104940:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708649.104941:0:17118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789708649.104958:0:17118:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bed0a28c800 from lustre-MDT0000 10000000:01000000:1.0:1789708649.104982:0:17118:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789708649.104985:0:17118:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789708649.104988:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bed09714d40 10000000:01000000:1.0:1789708649.104992:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789708649.104999:0:17118:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bed09714d40 from 1 10000000:01000000:1.0:1789708649.105002:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789708649.105029:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.105040:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.105049:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708649.105062:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789708649.105090:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708649.105110:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.105133:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365524480 00000100:00100000:0.0:1789708649.105139:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365524480 00000100:00100000:0.0:1789708649.105162:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708649.105169:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09858450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+5:17118:x1876645365524480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708649.105176:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708649.105187:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d1200/0xf45f43947e47dd9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47dd93 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.105204:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d1200/0xf45f43947e47dd9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47dd93 expref: 6 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.105214:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d1200/0xf45f43947e47dd9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47dd93 expref: 6 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.105223:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1200, rc 0) 00000100:00100000:0.0:1789708649.105255:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09858450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+6:17118:x1876645365524480:12345-0@lo:101:mount.lustre.0 Request processed in 87us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.105287:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708649.105293:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708649.105307:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.105322:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708649.105366:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708649.105383:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708649.105400:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.105422:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365524608 00000100:00100000:0.0:1789708649.105427:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365524608 00000100:00100000:0.0:1789708649.105451:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708649.105458:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+6:17118:x1876645365524608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708649.105504:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+6:17118:x1876645365524608:12345-0@lo:501:mount.lustre.0 Request processed in 46us (118us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789708649.105518:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708649.105523:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:1.0:1789708649.105545:0:17118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789708649.105562:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.105571:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708649.105578:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bed0a28c800 10000000:01000000:1.0:1789708649.105582:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789708649.105587:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bed0a28c800 10000000:01000000:1.0:1789708649.105589:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789708649.105592:0:17118:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bed0a28c800 from 1 10000000:01000000:1.0:1789708649.105595:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789708649.105608:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.105615:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.105622:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708649.105641:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789708649.105660:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708649.105672:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.105690:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365524736 00000100:00100000:0.0:1789708649.105694:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365524736 00000100:00100000:0.0:1789708649.105711:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708649.105717:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+6:17118:x1876645365524736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708649.105724:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708649.105731:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d1400/0xf45f43947e47dda8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47dda1 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.105756:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d1400/0xf45f43947e47dda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47dda1 expref: 7 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.105765:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d1400/0xf45f43947e47dda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47dda1 expref: 7 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.105772:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1400, rc 0) 00000100:00100000:0.0:1789708649.105802:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+7:17118:x1876645365524736:12345-0@lo:101:mount.lustre.0 Request processed in 86us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.105808:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708649.105826:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708649.105838:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.105846:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708649.105855:0:17118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789708649.105865:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.105872:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708649.105879:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789708649.105883:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789708649.105888:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bed0a28c800 10000000:01000000:1.0:1789708649.105890:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789708649.105892:0:17118:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789708649.105895:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789708649.105908:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.105915:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.105929:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708649.105941:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789708649.105965:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708649.105983:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.105994:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365524864 00000100:00100000:0.0:1789708649.105998:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365524864 00000100:00100000:0.0:1789708649.106016:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708649.106021:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+7:17118:x1876645365524864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708649.106029:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708649.106035:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d1000/0xf45f43947e47ddb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ddaf expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.106048:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d1000/0xf45f43947e47ddb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ddaf expref: 8 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.106062:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d1000/0xf45f43947e47ddb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ddaf expref: 8 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.106068:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1000, rc 0) 00000100:00100000:0.0:1789708649.106098:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+8:17118:x1876645365524864:12345-0@lo:101:mount.lustre.0 Request processed in 77us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.106104:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708649.106120:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708649.106132:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.106140:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708649.106173:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708649.106196:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708649.106210:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.106225:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365524992 00000100:00100000:0.0:1789708649.106228:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365524992 00000100:00100000:0.0:1789708649.106245:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708649.106250:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+8:17118:x1876645365524992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708649.106350:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+9:17118:x1876645365524992:12345-0@lo:501:mount.lustre.0 Request processed in 99us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.106357:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708649.106373:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365524992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708649.106406:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365525120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708649.106434:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708649.106455:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.106462:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365525120 00000100:00100000:0.0:1789708649.106467:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365525120 00000100:00100000:0.0:1789708649.106487:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708649.106493:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+9:17118:x1876645365525120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708649.106857:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+9:17118:x1876645365525120:12345-0@lo:503:mount.lustre.0 Request processed in 364us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.106864:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708649.106887:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365525120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708649.107131:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17156:1876645365525248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708649.107165:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708649.107180:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.107190:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365525248 00000100:00100000:0.0:1789708649.107194:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365525248 00000100:00100000:0.0:1789708649.107215:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708649.107220:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+9:17156:x1876645365525248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708649.107554:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+9:17156:x1876645365525248:12345-0@lo:502:llog_process_th.0 Request processed in 333us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.107566:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708649.107582:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17156:1876645365525248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708649.107606:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708649.107615:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708649.107617:0:17156:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789708649.107620:0:17156:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789708649.107622:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708649.107632:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bed095fcd40) 00000020:00000080:2.0:1789708649.107677:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789708649.107686:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789708649.107755:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789708649.107762:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47ddc4 00000020:00000080:2.0:1789708649.107903:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789708649.107906:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708649.107908:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708649.107909:0:17156:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789708649.107911:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708649.107913:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708649.107914:0:17156:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789708649.107916:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708649.107921:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bed095f99c0) 00000020:00000080:2.0:1789708649.107927:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789708649.107929:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789708649.107931:0:17156:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789708649.107932:0:17156:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789708649.107936:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789708649.107957:0:17156:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed0a28c800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789708649.107965:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bee3dd7cd40) 00000020:00000080:2.0:1789708649.107970:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789708649.108007:0:17156:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789708649.108010:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ddd9 00000020:00000080:2.0:1789708649.108064:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789708649.108068:0:17156:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789708649.108070:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf45f43947e47dde0 00080000:01000000:2.0:1789708649.108073:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789708649.108075:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47dde7 00010000:00010000:2.0:1789708649.140567:0:17156:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789708649.140990:0:17156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967512 00000001:00080000:2.0:1789708649.141209:0:17156:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789708649.141663:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bee3dd799c0) 00000020:00000080:2.0:1789708649.141680:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789708649.141788:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789708649.141803:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47ddf5 00000020:00000080:2.0:1789708649.142203:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789708649.144290:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf45f43947e47ddfc 00000020:00000080:0.0:1789708649.144505:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789708649.144518:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708649.144525:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.144527:0:17156:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789708649.144531:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789708649.144533:0:17156:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1789708649.144535:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708649.144536:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708649.144538:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789708649.144542:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.144544:0:17156:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789708649.144548:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708649.144553:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.144555:0:17156:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789708649.144562:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789708649.144604:0:17156:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789708649.144632:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708649.144636:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.144637:0:17156:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789708649.144639:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708649.144642:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.144643:0:17156:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789708649.144646:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789708649.144651:0:17156:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:00000080:0.0:1789708649.144675:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789708649.144690:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9bed097119c0) 00000020:00000080:0.0:1789708649.144720:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789708649.144727:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789708649.144803:0:17156:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789708649.144810:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789708649.144819:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47de0a 00010000:00080000:0.0:1789708649.144866:0:17156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee0685d800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1789708649.146891:0:17156:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789708649.148047:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789708649.148060:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789708649.148090:0:17156:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789708649.148111:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47de11 00000100:00080000:0.0:1789708649.148120:0:17156:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708649.148132:0:17156:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee0685d800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708649.148167:0:17156:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cc380 x1876645365525376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708649.148189:0:17156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789708649.148232:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365525376:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789708649.148248:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708649.148252:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.148253:0:17156:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789708649.148255:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789708649.148274:0:17156:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1789708649.148276:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708649.148278:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708649.148280:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789708649.148283:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.148284:0:17156:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789708649.148287:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789708649.148291:0:17156:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789708649.148294:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.148295:0:17156:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789708649.148297:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789708649.148300:0:17156:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:0.0:1789708649.148318:0:17156:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789708649.148320:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:2.0:1789708649.148327:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789708649.148330:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bed09713380) 00000020:00000080:0.0:1789708649.148341:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789708649.148352:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1789708649.148411:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365525376 00000100:00100000:2.0:1789708649.148419:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365525376 00000004:00080000:0.0:1789708649.148433:0:17156:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789708649.148440:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789708649.148448:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47de1f 00000100:00100000:2.0:1789708649.148454:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708649.148462:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365525376:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789708649.148477:0:17143:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789708649.148477:0:17156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee18452000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.152@tcp at head 00000100:00100000:2.0:1789708649.148517:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365525376:12345-0@lo:38:llog_process_th.0 Request processed in 54us (191us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789708649.148524:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789708649.148560:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee0685d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708649.148565:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708649.148569:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365525376:0@lo:38:llog_process_th.0 00010000:00010000:0.0:1789708649.148821:0:17156:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789708649.149972:0:17156:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789708649.150179:0:17156:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789708649.151531:0:17156:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 0, last_idx 1 00000040:00080000:0.0:1789708649.152359:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708649.152540:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789708649.155664:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789708649.156449:0:17162:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:0.0:1789708649.156454:0:17162:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789708649.157004:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789708649.157016:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789708649.157048:0:17156:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789708649.157067:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47de26 00000100:00080000:0.0:1789708649.157076:0:17156:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708649.157086:0:17156:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bee18452000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708649.157123:0:17156:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cd500 x1876645365525504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708649.157151:0:17156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789708649.157180:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365525504:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1789708649.157212:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708649.157218:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.157220:0:17156:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789708649.157224:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789708649.157227:0:17156:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1789708649.157229:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708649.157231:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708649.157233:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000400:00000100:2.0:1789708649.157235:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365525504 offset 0 length 520: 4 00000020:00000080:0.0:1789708649.157243:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.157245:0:17156:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789708649.157250:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789708649.157255:0:17156:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789708649.157298:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.157300:0:17156:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789708649.157307:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789708649.157312:0:17156:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:0.0:1789708649.157344:0:17156:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789708649.157348:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789708649.157360:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bed09710000) 00000020:00000080:0.0:1789708649.157375:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789708649.157381:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789708649.157433:0:17156:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789708649.157438:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789708649.157444:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47de34 00010000:00080000:0.0:1789708649.157476:0:17156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee18455800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1789708649.157683:0:17156:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789708649.157737:0:17156:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789708649.157764:0:17156:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789708649.158368:0:17156:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000040:00080000:0.0:1789708649.159188:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708649.163473:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789708649.163661:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789708649.164070:0:17164:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:0.0:1789708649.164074:0:17164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789708649.165132:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789708649.165144:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789708649.165178:0:17156:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789708649.165196:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47de3b 00000100:00080000:2.0:1789708649.165205:0:17156:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708649.165216:0:17156:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bee18455800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708649.165248:0:17156:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed09b80700 x1876645365525632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708649.165776:0:17156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789708649.165795:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365525632:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1789708649.165844:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708649.165849:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708649.165852:0:17156:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000400:00000100:0.0:1789708649.165853:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365525632 offset 0 length 520: 4 00000020:01000000:2.0:1789708649.165858:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708649.165863:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708649.165865:0:17156:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789708649.165869:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789708649.165871:0:17156:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789708649.165874:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708649.165877:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708649.165879:0:17156:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789708649.165882:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708649.165885:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708649.165887:0:17156:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789708649.165892:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789708649.165920:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17156:1876645365525760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708649.165969:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708649.165990:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.166023:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365525760 00000100:00100000:0.0:1789708649.166030:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365525760 00000100:00100000:0.0:1789708649.166078:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708649.166086:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+9:17156:x1876645365525760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708649.166192:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+9:17156:x1876645365525760:12345-0@lo:502:llog_process_th.0 Request processed in 106us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.166199:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789708649.166234:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17156:1876645365525760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708649.166256:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708649.166283:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708649.166285:0:17156:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789708649.166288:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789708649.166349:0:17118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789708649.166382:0:17118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789708649.166399:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.166417:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708649.166424:0:17118:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bed0a28c800 from 1 10000000:01000000:1.0:1789708649.166427:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789708649.166450:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.166458:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708649.166468:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708649.166479:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365525888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789708649.166514:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708649.166539:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.166590:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365525888 00000100:00100000:0.0:1789708649.166595:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365525888 00000100:00100000:0.0:1789708649.166647:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708649.166653:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+9:17118:x1876645365525888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708649.166661:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708649.166672:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d0a00/0xf45f43947e47de49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47de42 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.166691:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d0a00/0xf45f43947e47de49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47de42 expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.166701:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d0a00/0xf45f43947e47de49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47de42 expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.166711:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0a00, rc 0) 00000100:00100000:0.0:1789708649.166740:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+10:17118:x1876645365525888:12345-0@lo:101:mount.lustre.0 Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.166758:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789708649.166783:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365525888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708649.166796:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708649.166804:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708649.167177:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526016:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789708649.167201:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708649.167219:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708649.167245:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365526016 00000100:00100000:1.0:1789708649.167250:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365526016 00000100:00100000:1.0:1789708649.167294:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708649.167300:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+10:17118:x1876645365526016:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789708649.167313:0:17133:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789708649.167320:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789708649.167385:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+10:17118:x1876645365526016:12345-0@lo:256:mount.lustre.0 Request processed in 85us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708649.167392:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708649.167395:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526016:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789708649.167895:0:17118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789708649.167907:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708649.167913:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708649.167918:0:17118:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed0a28c800 from 1 10000000:01000000:2.0:1789708649.167919:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708649.167933:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708649.167938:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708649.167943:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708649.167952:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789708649.167972:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708649.167988:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.168006:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365526144 00000100:00100000:0.0:1789708649.168011:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365526144 00000100:00100000:0.0:1789708649.168035:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708649.168045:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+10:17118:x1876645365526144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708649.168052:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708649.168067:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d1600/0xf45f43947e47de57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47de50 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.168082:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d1600/0xf45f43947e47de57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47de50 expref: 11 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.168090:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d1600/0xf45f43947e47de57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47de50 expref: 11 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.168097:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1600, rc 0) 00000100:00100000:0.0:1789708649.168125:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17118:x1876645365526144:12345-0@lo:101:mount.lustre.0 Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.168132:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708649.168147:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708649.168162:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708649.168167:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708649.168202:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708649.168220:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708649.168231:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708649.168252:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365526272 00000100:00100000:1.0:1789708649.168276:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365526272 00000100:00100000:1.0:1789708649.168301:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708649.168308:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17118:x1876645365526272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708649.168420:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17118:x1876645365526272:12345-0@lo:501:mount.lustre.0 Request processed in 113us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708649.168427:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708649.168435:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708649.168470:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708649.168504:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708649.168529:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.168564:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365526400 00000100:00100000:0.0:1789708649.168569:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365526400 00000100:00100000:0.0:1789708649.168594:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789708649.168600:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17118:x1876645365526400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708649.168687:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17118:x1876645365526400:12345-0@lo:503:mount.lustre.0 Request processed in 85us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708649.168702:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708649.168705:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789708649.169003:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17166:1876645365526528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708649.169039:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708649.169056:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e872480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708649.169080:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365526528 00000100:00100000:1.0:1789708649.169085:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365526528 00000100:00100000:1.0:1789708649.169112:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789708649.169119:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17166:x1876645365526528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708649.169425:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17166:x1876645365526528:12345-0@lo:502:llog_process_th.0 Request processed in 307us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708649.169431:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708649.169461:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17166:1876645365526528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789708649.169494:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708649.169503:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.169505:0:17166:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789708649.169512:0:17166:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bed0a28c800 00000020:00000080:0.0:1789708649.169519:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708649.169527:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708649.169530:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.169531:0:17166:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789708649.169533:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708649.169536:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.169537:0:17166:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789708649.169540:0:17166:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bed0a28c800 00000020:00000080:0.0:1789708649.169542:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708649.169593:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708649.169597:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.169598:0:17166:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789708649.169602:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708649.169605:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.169606:0:17166:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789708649.169610:0:17166:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bed0a28c800 00000020:00000080:0.0:1789708649.169612:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708649.169630:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708649.169633:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.169634:0:17166:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789708649.169637:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708649.169639:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.169641:0:17166:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789708649.169644:0:17166:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bed0a28c800 00000020:00000080:0.0:1789708649.169646:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789708649.169676:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17166:1876645365526656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708649.169710:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708649.169754:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e872480 going to sleep for 11 seconds 00000100:00100000:2.0:1789708649.169791:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365526656 00000100:00100000:2.0:1789708649.169795:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365526656 00000100:00100000:2.0:1789708649.169822:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708649.169829:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17166:x1876645365526656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708649.169911:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17166:x1876645365526656:12345-0@lo:502:llog_process_th.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708649.169918:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789708649.169937:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17166:1876645365526656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789708649.169959:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708649.169963:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708649.169968:0:17166:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789708649.169972:0:17166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789708649.170040:0:17118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789708649.170067:0:17118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708649.170081:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708649.170103:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708649.170152:0:17118:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789708649.170154:0:17118:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bed0a28c800 10000000:01000000:2.0:1789708649.170157:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bed0a28c800 10000000:01000000:2.0:1789708649.170162:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789708649.170167:0:17118:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bed0a28c800 from 1 10000000:01000000:2.0:1789708649.170170:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789708649.170190:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708649.170195:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708649.170201:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708649.170210:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789708649.170233:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708649.170249:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708649.170298:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365526784 00000100:00100000:3.0:1789708649.170303:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365526784 00000100:00100000:3.0:1789708649.170341:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789708649.170351:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17118:x1876645365526784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708649.170359:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708649.170372:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509800/0xf45f43947e47de65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47de5e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.170391:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509800/0xf45f43947e47de65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47de5e expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.170401:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509800/0xf45f43947e47de65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47de5e expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.170409:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509800, rc 0) 00000100:00100000:3.0:1789708649.170444:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17118:x1876645365526784:12345-0@lo:101:mount.lustre.0 Request processed in 96us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708649.170458:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789708649.170465:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708649.170478:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708649.170487:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708649.170558:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708649.170580:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708649.170601:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.170609:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365526912 00000100:00100000:0.0:1789708649.170614:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365526912 00000100:00100000:0.0:1789708649.170644:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708649.170652:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0a8a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17118:x1876645365526912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708649.170757:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0a8a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17118:x1876645365526912:12345-0@lo:501:mount.lustre.0 Request processed in 94us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.170765:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708649.170787:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365526912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708649.170823:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365527040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708649.170863:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708649.170881:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee37250900 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.170887:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365527040 00000100:00100000:0.0:1789708649.170892:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365527040 00000100:00100000:0.0:1789708649.170924:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708649.170930:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0a8a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17118:x1876645365527040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708649.171016:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0a8a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17118:x1876645365527040:12345-0@lo:503:mount.lustre.0 Request processed in 85us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.171023:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789708649.171040:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365527040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708649.171252:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17168:1876645365527168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708649.171321:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708649.171341:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365527168 00000100:00100000:3.0:1789708649.171345:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee372506c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.171347:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365527168 00000100:00100000:0.0:1789708649.171389:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789708649.171396:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17168:x1876645365527168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708649.171492:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17168:x1876645365527168:12345-0@lo:502:llog_process_th.0 Request processed in 96us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.171500:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789708649.171517:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17168:1876645365527168:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789708649.171567:0:17168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789708649.171580:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bed08670000) 00000020:00000080:3.0:1789708649.171597:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789708649.171710:0:17168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed0a28c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789708649.171714:0:17168:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bed0a28c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789708649.171717:0:17168:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed0a28c800 4 00010000:00080000:3.0:1789708649.171760:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee3fa8e000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789708649.173683:0:17168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789708649.173888:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789708649.173930:0:17168:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789708649.173940:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf45f43947e47de73 00000100:00080000:3.0:1789708649.173949:0:17168:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708649.173958:0:17168:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bee3fa8e000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708649.173988:0:17168:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a3a5500 x1876645365527296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708649.174026:0:17168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789708649.174045:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365527296:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789708649.174100:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708649.174153:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365527296 00000100:00100000:3.0:1789708649.174160:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365527296 00000100:00100000:3.0:1789708649.174188:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708649.174195:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365527296:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708649.174252:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365527296:12345-0@lo:38:llog_process_th.0 Request processed in 55us (150us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789708649.174282:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708649.174286:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708649.174295:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa8e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708649.174304:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789708649.174310:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365527296:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789708649.175834:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17168:1876645365527424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708649.175896:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708649.175926:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e872f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.175943:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365527424 00000100:00100000:0.0:1789708649.175948:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365527424 00000100:00100000:0.0:1789708649.175985:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708649.175994:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17168:x1876645365527424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708649.176111:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17168:x1876645365527424:12345-0@lo:502:llog_process_th.0 Request processed in 118us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.176117:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708649.176164:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17168:1876645365527424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708649.176201:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17168:1876645365527552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708649.176236:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708649.176252:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee182d2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.176306:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365527552 00000100:00100000:0.0:1789708649.176311:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365527552 00000100:00100000:0.0:1789708649.176336:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708649.176342:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17168:x1876645365527552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708649.176418:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17168:x1876645365527552:12345-0@lo:502:llog_process_th.0 Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.176424:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708649.176456:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17168:1876645365527552:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789708649.176482:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789708649.176584:0:17118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789708649.176614:0:17118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708649.176627:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.176639:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789708649.176685:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789708649.176687:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708649.176688:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708649.176689:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708649.176690:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708649.176692:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708649.176693:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708649.176694:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708649.176696:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708649.176697:0:17118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789708649.176700:0:17118:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789708649.176703:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789708649.176704:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708649.176705:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708649.176707:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708649.176708:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708649.176709:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708649.176710:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708649.176711:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708649.176712:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708649.176713:0:17118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789708649.176730:0:17118:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789708649.176739:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365527680:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789708649.176783:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708649.176803:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e872f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.176822:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365527680 00000100:00100000:0.0:1789708649.176831:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365527680 00000100:00100000:0.0:1789708649.176858:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708649.176866:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17118:x1876645365527680:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789708649.176885:0:17134:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789708649.176898:0:17134:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789708649.178064:0:17134:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789708649.178082:0:17134:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789708649.178110:0:17154:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789708649.178115:0:17154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789708649.178135:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.178149:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee2f7d0a00/0xf45f43947e47de49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47de42 expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.178157:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.178187:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee2f7d0a00/0xf45f43947e47de49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47de42 expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.178201:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee2f7d0a00/0xf45f43947e47de49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47de42 expref: 12 pid: 17132 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708649.178211:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365527808:0@lo:104: 00000100:00100000:0.0:1789708649.178235:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17118:x1876645365527680:12345-0@lo:253:mount.lustre.0 Request processed in 1368us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.178244:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708649.178250:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708649.178306:0:17154:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee37250180 going to sleep for 11 seconds 00000100:00100000:0.0:1789708649.178312:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365527808 00000100:00100000:0.0:1789708649.178318:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365527808 00000100:00100000:0.0:1789708649.178349:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708649.178357:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+3:17154:x1876645365527808:12345-0@lo:104: 00000100:00100000:3.0:1789708649.178359:0:17123:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:0.0:1789708649.178369:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708649.178375:0:17123:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1789708649.178422:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708649.178428:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+3:17154:x1876645365527808:12345-0@lo:104: Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708649.178434:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365527808:0@lo:104: 00000100:00100000:0.0:1789708649.178439:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789708649.178457:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.178542:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708649.178548:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.178557:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949c00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708649.178561:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.178580:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708649.178587:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708649.178593:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708649.178623:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.178630:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708649.178652:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.178659:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47de42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47de49 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708649.178680:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708649.178682:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708649.178684:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708649.178719:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365527936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708649.178763:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708649.178821:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365527936 00000100:00100000:3.0:1789708649.178827:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365527936 00010000:00010000:3.0:1789708649.178854:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee2f7d0a00/0xf45f43947e47de49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47de42 expref: 12 pid: 17132 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708649.178864:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17118:1876645365527680:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789708649.178877:0:17118:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789708649.178881:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708649.178883:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708649.178885:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708649.178887:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:3.0:1789708649.178888:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:0.0:1789708649.178889:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708649.178897:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708649.178899:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708649.178902:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:3.0:1789708649.178904:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:3617:x1876645365527936:12345-0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1789708649.178904:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708649.178908:0:17118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1789708649.178921:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708649.178928:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee2f7d0a00/0xf45f43947e47de49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47de42 expref: 12 pid: 17132 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1789708649.178932:0:17118:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789708649.178943:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee2f7d0a00/0xf45f43947e47de49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47de42 expref: 12 pid: 17132 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.178957:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d0a00/0xf45f43947e47de49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47de42 expref: 12 pid: 17132 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.178968:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.178975:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789708649.178987:0:17124:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000872515s 00010000:00010000:3.0:1789708649.178991:0:17124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.179009:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.179016:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.179023:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.179029:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708649.179034:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.179042:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.179060:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.179071:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708649.179106:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:3617:x1876645365527936:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708649.179114:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789708649.179137:0:17154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.179145:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708649.179152:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509400/0xf45f43947e47de7a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708649.179546:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365527936:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789708649.185651:0:17118:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789708649.185966:0:17118:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789708649.185966:0:17179:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789708649.185972:0:17179:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789708649.186157:0:17180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789708649.186170:0:17118:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789708649.186402:0:17180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1789708649.186654:0:17181:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9bed0a2cd180 x1876645365528064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708649.186666:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5e40 going to sleep for 0 seconds 00000040:01000000:2.0:1789708649.186843:0:17118:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789708649.186875:0:17118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789708649.188038:0:17118:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789708649.188064:0:17118:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789708649.188121:0:17118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708649.189006:0:17180:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789708649.189071:0:17180:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1789708649.189609:0:17118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789708649.190133:0:17118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789708649.190202:0:17118:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789708649.190779:0:17118:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1789708649.191514:0:17118:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789708649.192415:0:17118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789708649.193160:0:17118:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789708649.193177:0:17118:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbde281ca3988 00100000:10000000:2.0:1789708649.193183:0:17118:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789708649.193508:0:17118:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789708649.193524:0:17118:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789708649.193548:0:17118:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789708649.193564:0:17118:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789708649.194423:0:17118:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708649.194642:0:17118:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789708650.022438:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708650.214678:0:17175:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708650.214690:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789708650.215338:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5e40 going to sleep for 0 seconds 00000040:00080000:2.0:1789708650.216115:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789708650.216138:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1789708650.407775:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789708650.407783:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bed0a28c800 from 7 10000000:01000000:2.0:1789708650.407789:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789708650.407837:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708650.407849:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708650.407868:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708650.407896:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365528192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708650.407965:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708650.408013:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004900 going to sleep for 11 seconds 00000100:00100000:3.0:1789708650.408018:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365528192 00000100:00100000:3.0:1789708650.408028:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365528192 00000100:00100000:3.0:1789708650.408091:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708650.408102:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+11:17136:x1876645365528192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708650.408116:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708650.408130:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509400/0xf45f43947e47de88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47de81 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708650.408155:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509400/0xf45f43947e47de88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47de81 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708650.408165:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509400/0xf45f43947e47de88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47de81 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708650.408176:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509400, rc 0) 00000100:00100000:3.0:1789708650.408227:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17136:x1876645365528192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708650.408233:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789708650.408321:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365528192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708650.408337:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708650.408347:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708650.408391:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365528320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789708650.408426:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708650.408469:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708650.408496:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365528320 00000100:00100000:1.0:1789708650.408502:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365528320 00000100:00100000:1.0:1789708650.408757:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708650.408767:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17136:x1876645365528320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789708650.408782:0:17134:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789708650.408800:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789708650.408804:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789708650.408889:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17136:x1876645365528320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708650.408901:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708650.408962:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365528320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789708650.409007:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708650.409013:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708650.409023:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1789708650.553058:0:17423:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1789708650.882020:0:17475:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708650.882175:0:17475:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708651.046348:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789708651.186361:0:17525:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708651.186509:0:17525:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789708651.238331:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5e40 going to sleep for 0 seconds 00000040:00080000:2.0:1789708651.238419:0:17175:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708651.238425:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708651.238452:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789708651.238467:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789708652.071032:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708652.262295:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5e40 going to sleep for 0 seconds 00010000:00010000:2.0:1789708653.094383:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708653.286431:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5e40 going to sleep for 0 seconds 00000020:01000004:0.0:1789708653.357314:0:17870:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789708653.357318:0:17870:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789708653.357319:0:17870:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789708653.357424:0:17870:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bee0446d000 00000020:01000004:0.0:1789708653.357437:0:17870:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789708653.357447:0:17870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789708653.357458:0:17870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9bee2d9899c0) 00000020:00000080:0.0:1789708653.357472:0:17870:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789708653.381421:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789708653.381626:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.383253:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.383427:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.383594:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.383768:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.383925:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.384082:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.384233:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.384404:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.384567:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.384729:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.384882:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.385044:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.385200:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.385341:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.385488:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.385634:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.385816:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.385955:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.386104:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.386250:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.386419:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.386577:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.386745:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.386910:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.387062:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.387210:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.387374:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.387517:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.387680:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.387834:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1789708653.387989:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.388145:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789708653.390939:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789708653.391446:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789708653.391626:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789708653.391794:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789708653.391972:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789708653.392236:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789708653.392464:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789708653.392643:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789708653.392839:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789708653.392986:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789708653.393136:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789708653.393279:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:0.0:1789708653.393736:0:17870:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789708653.393886:0:17870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789708653.393895:0:17870:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789708653.393902:0:17870:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47de96 00000020:01000004:0.0:1789708653.393907:0:17870:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789708653.393923:0:17870:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789708653.393926:0:17870:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789708653.393930:0:17870:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789708653.393954:0:17870:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789708653.393957:0:17870:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789708653.396797:0:17870:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789708653.396830:0:17870:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.152@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789708653.396835:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789708653.396837:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789708653.396838:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708653.396839:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708653.396840:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708653.396842:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708653.396843:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708653.396845:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708653.396846:0:17870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789708653.396849:0:17870:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789708653.396851:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789708653.396852:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789708653.396854:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708653.396855:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708653.396856:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708653.396857:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708653.396858:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708653.396859:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708653.396860:0:17870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789708653.396894:0:17870:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789708653.396913:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365528448:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789708653.397010:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708653.397071:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365528448 00000100:00100000:3.0:1789708653.397079:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365528448 00000100:00100000:0.0:1789708653.397082:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a31000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708653.397124:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789708653.397134:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17870:x1876645365528448:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789708653.397163:0:17133:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789708653.397166:0:17133:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789708653.397172:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789708653.397359:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17870:x1876645365528448:12345-0@lo:253:mount.lustre.0 Request processed in 226us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708653.397366:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789708653.397385:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365528448:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789708653.397396:0:17870:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789708653.397398:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708653.397400:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789708653.397401:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708653.397402:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708653.397403:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708653.397404:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708653.397405:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708653.397412:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708653.397413:0:17870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789708653.397437:0:17870:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bee0446d000 from lustre-MDT0001 10000000:01000000:0.0:1789708653.397456:0:17870:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789708653.397458:0:17870:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789708653.397462:0:17870:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bed09714d40 local copy 00010000:00010000:0.0:1789708653.397469:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708653.397536:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365528576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708653.397569:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.397596:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708653.397614:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365528576 00000100:00100000:2.0:1789708653.397619:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365528576 00000100:00100000:2.0:1789708653.397645:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708653.397650:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17870:x1876645365528576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708653.397724:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17870:x1876645365528576:12345-0@lo:501:mount.lustre.0 Request processed in 73us (154us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708653.397738:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708653.397742:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365528576:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789708653.397759:0:17870:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789708653.397778:0:17870:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789708653.397784:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.397792:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708653.397811:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bee0446d000 10000000:01000000:0.0:1789708653.397816:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789708653.397820:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bed09714d40 10000000:01000000:0.0:1789708653.397822:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789708653.397825:0:17870:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bed09714d40 from 1 10000000:01000000:0.0:1789708653.397827:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789708653.397844:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1e00/0xf45f43947e47de9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.397861:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1e00/0xf45f43947e47de9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.397870:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1e00/0xf45f43947e47de9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708653.397882:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365528704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708653.397907:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.397925:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a310c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708653.397948:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365528704 00000100:00100000:3.0:1789708653.397954:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365528704 00000100:00100000:3.0:1789708653.397996:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789708653.398003:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+12:17870:x1876645365528704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708653.398011:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708653.398024:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01508200/0xf45f43947e47dea4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47de9d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.398044:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01508200/0xf45f43947e47dea4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47de9d expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.398053:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01508200/0xf45f43947e47dea4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47de9d expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.398062:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508200, rc 0) 00000100:00100000:3.0:1789708653.398102:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+13:17870:x1876645365528704:12345-0@lo:101:mount.lustre.0 Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708653.398109:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789708653.398117:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365528704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708653.398130:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1e00/0xf45f43947e47de9d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dea4 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.398138:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1e00/0xf45f43947e47de9d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dea4 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708653.398152:0:17870:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789708653.398169:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1e00/0xf45f43947e47de9d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dea4 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.398176:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1e00/0xf45f43947e47de9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dea4 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708653.398182:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bee0446d000 10000000:01000000:0.0:1789708653.398185:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789708653.398188:0:17870:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bee0446d000 from 1 10000000:01000000:0.0:1789708653.398190:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789708653.398208:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.398215:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.398222:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708653.398232:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365528832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708653.398254:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.398297:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22a310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708653.398299:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365528832 00000100:00100000:2.0:1789708653.398304:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365528832 00000100:00100000:2.0:1789708653.398339:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789708653.398347:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+13:17870:x1876645365528832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708653.398353:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708653.398365:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb4a00/0xf45f43947e47deb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47deab expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708653.398379:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb4a00/0xf45f43947e47deb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47deab expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708653.398388:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb4a00/0xf45f43947e47deb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47deab expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708653.398396:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4a00, rc 0) 00000100:00100000:2.0:1789708653.398433:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+14:17870:x1876645365528832:12345-0@lo:101:mount.lustre.0 Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708653.398439:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789708653.398491:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365528832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708653.398501:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.398509:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708653.398520:0:17870:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789708653.398533:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.398538:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708653.398542:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789708653.398544:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708653.398547:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bee0446d000 10000000:01000000:3.0:1789708653.398549:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789708653.398552:0:17870:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789708653.398553:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789708653.398568:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.398575:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.398582:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708653.398601:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365528960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708653.398628:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708653.398645:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20facd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708653.398684:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365528960 00000100:00100000:1.0:1789708653.398689:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365528960 00000100:00100000:1.0:1789708653.398719:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708653.398726:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+14:17870:x1876645365528960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708653.398733:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708653.398743:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e949800/0xf45f43947e47dec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47deb9 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.398756:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e949800/0xf45f43947e47dec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47deb9 expref: 15 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.398765:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e949800/0xf45f43947e47dec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47deb9 expref: 15 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.398771:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949800, rc 0) 00000100:00100000:1.0:1789708653.398803:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+15:17870:x1876645365528960:12345-0@lo:101:mount.lustre.0 Request processed in 79us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.398809:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789708653.398831:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365528960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708653.398840:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.398847:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708653.399574:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789708653.400021:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708653.402415:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789708653.402454:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789708653.402469:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789708653.402484:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789708653.402498:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789708653.402513:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789708653.402529:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789708653.402543:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789708653.402557:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789708653.402570:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789708653.402578:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789708653.402585:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789708653.402592:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789708653.402599:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789708653.402606:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789708653.402613:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789708653.402620:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789708653.402636:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789708653.402644:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789708653.402651:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789708653.402661:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789708653.402687:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789708653.402701:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789708653.402724:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789708653.402730:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789708653.402846:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365529088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708653.402901:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708653.402939:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20fac600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708653.402958:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365529088 00000100:00100000:2.0:1789708653.402965:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365529088 00000100:00100000:2.0:1789708653.403008:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789708653.403018:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+15:17870:x1876645365529088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708653.403149:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+15:17870:x1876645365529088:12345-0@lo:501:mount.lustre.0 Request processed in 134us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708653.403155:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789708653.403186:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365529088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708653.403228:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365529216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708653.403310:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708653.403346:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20fac600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708653.403357:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365529216 00000100:00100000:1.0:1789708653.403363:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365529216 00000100:00100000:1.0:1789708653.403409:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789708653.403420:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+15:17870:x1876645365529216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708653.404239:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+15:17870:x1876645365529216:12345-0@lo:503:mount.lustre.0 Request processed in 821us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.404247:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789708653.404287:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365529216:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789708653.404684:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789708653.404749:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365529344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708653.404797:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708653.404833:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20facd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708653.404839:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365529344 00000100:00100000:0.0:1789708653.404845:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365529344 00000100:00100000:0.0:1789708653.404880:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789708653.404888:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed099ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+15:17870:x1876645365529344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708653.408050:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed099ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+15:17870:x1876645365529344:12345-0@lo:502:mount.lustre.0 Request processed in 3156us (3245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708653.408063:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789708653.408080:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365529344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708653.408239:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789708653.408301:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1789708653.408316:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1789708653.408337:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1789708653.408353:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1789708653.408367:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1789708653.408387:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1789708653.408394:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1789708653.408400:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1789708653.408413:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1789708653.408422:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1789708653.408428:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1789708653.408435:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1789708653.408442:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1789708653.408461:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1789708653.408476:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1789708653.408491:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1789708653.408503:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1789708653.408528:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1789708653.408541:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1789708653.408554:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1789708653.408569:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1789708653.408582:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1789708653.408598:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1789708653.408612:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1789708653.408620:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1789708653.408626:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1789708653.408633:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1789708653.408639:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1789708653.408646:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1789708653.408652:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1789708653.408658:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1789708653.408679:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1789708653.408694:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1789708653.408709:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1789708653.408723:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1789708653.408743:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1789708653.408752:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1789708653.408765:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1789708653.408787:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1789708653.408801:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1789708653.408813:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1789708653.408821:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1789708653.408827:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1789708653.408851:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365529472:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708653.408888:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708653.408914:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20facd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708653.408937:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365529472 00000100:00100000:1.0:1789708653.408943:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365529472 00000100:00100000:1.0:1789708653.408974:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789708653.408980:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed099cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+15:17870:x1876645365529472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708653.409073:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed099cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+15:17870:x1876645365529472:12345-0@lo:502:mount.lustre.0 Request processed in 93us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.409079:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789708653.409099:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365529472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708653.409129:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1789708653.409133:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789708653.409648:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708653.409656:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708653.409658:0:17874:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789708653.409662:0:17874:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789708653.409677:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789708653.409688:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9bed086719c0) 00000020:00000080:3.0:1789708653.409701:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789708653.409705:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789708653.409769:0:17874:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789708653.409777:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47dece 00000020:00000080:3.0:1789708653.409964:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789708653.409968:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708653.409972:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708653.409973:0:17874:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789708653.409976:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708653.409978:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708653.409979:0:17874:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789708653.409981:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789708653.409988:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9bed08673380) 00000020:00000080:3.0:1789708653.409999:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789708653.410010:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789708653.410011:0:17874:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789708653.410014:0:17874:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789708653.410021:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789708653.410070:0:17874:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee0446d000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789708653.410082:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9bed08674d40) 00000020:00000080:3.0:1789708653.410090:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789708653.410149:0:17874:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789708653.410154:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47dee3 00000020:00000080:3.0:1789708653.410244:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789708653.410251:0:17874:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789708653.410255:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf45f43947e47deea 00080000:01000000:3.0:1789708653.410284:0:17874:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789708653.410288:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47def1 00010000:00010000:3.0:1789708653.444178:0:17874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1789708653.444510:0:17874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1789708653.444737:0:17874:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789708653.445313:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789708653.445322:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708653.445328:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708653.445330:0:17874:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789708653.445332:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708653.445336:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708653.445338:0:17874:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789708653.445341:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789708653.445345:0:17874:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:00000080:1.0:1789708653.445368:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708653.445379:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9bee3dc3cd40) 00000020:00000080:1.0:1789708653.445395:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789708653.445400:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789708653.445457:0:17874:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789708653.445462:0:17874:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789708653.445468:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47deff 00010000:00080000:1.0:1789708653.445496:0:17874:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee02bf5000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789708653.446953:0:17874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789708653.447583:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789708653.447598:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789708653.447642:0:17874:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789708653.447679:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47df06 00000100:00080000:2.0:1789708653.447687:0:17874:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708653.447696:0:17874:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bee02bf5000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708653.447729:0:17874:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed09b81f80 x1876645365529600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708653.447755:0:17874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789708653.447787:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365529600:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789708653.447809:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789708653.447815:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789708653.447818:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee0685d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708653.447824:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 219 00000020:01000000:2.0:1789708653.447825:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708653.447830:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.447833:0:17874:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789708653.447839:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:1.0:1789708653.447841:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000020:01000000:2.0:1789708653.447843:0:17874:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789708653.447846:0:17874:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789708653.447848:0:17874:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00080000:1.0:1789708653.447850:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee0685d800 using connection 192.168.201.152@tcp/0@lo 00000020:01000000:2.0:1789708653.447851:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789708653.447857:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.447859:0:17874:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789708653.447862:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708653.447867:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.447869:0:17874:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789708653.447875:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789708653.447875:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f1500 x1876645365529728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708653.447882:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789708653.447895:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708653.447898:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789708653.447900:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708653.447903:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789708653.447906:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789708653.447910:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000004:01000000:2.0:1789708653.447912:0:17874:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00080000:1.0:1789708653.447912:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa8e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708653.447920:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bee3fa8e000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708653.447937:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f1180 x1876645365529856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:2.0:1789708653.447942:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708653.447949:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.447951:0:17874:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:0.0:1789708653.447955:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365529728:0@lo:38:kworker.0 00000020:01000000:2.0:1789708653.447957:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789708653.447961:0:17874:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789708653.447964:0:17874:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789708653.447966:0:17874:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789708653.447968:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789708653.447973:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.447980:0:17874:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789708653.447985:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789708653.447989:0:17874:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000100:00100000:1.0:1789708653.447994:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365529600 00000020:00000080:2.0:1789708653.447995:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.447999:0:17874:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000100:00100000:0.0:1789708653.447999:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.448002:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365529600 00000020:00000080:2.0:1789708653.448007:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789708653.448012:0:17874:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000100:00100000:1.0:1789708653.448023:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365529728 00000100:00100000:1.0:1789708653.448026:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365529728 00000100:00100000:0.0:1789708653.448029:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365529856:0@lo:38:kworker.0 00000020:01000000:2.0:1789708653.448032:0:17874:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789708653.448038:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:1.0:1789708653.448041:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000020:00000080:2.0:1789708653.448048:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9bee3dd7b380) 00000100:00100000:1.0:1789708653.448049:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365529600:12345-0@lo:38:llog_process_th.0 00000020:00000080:2.0:1789708653.448066:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00010000:00080000:1.0:1789708653.448071:0:17143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:2.0:1789708653.448076:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1789708653.448077:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1789708653.448104:0:17143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47df14 00000004:00100000:1.0:1789708653.448116:0:17143:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789708653.448119:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365529856 00000001:00000004:1.0:1789708653.448121:0:17143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789708653.448126:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365529856 00000100:00100000:3.0:1789708653.448158:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000004:00080000:2.0:1789708653.448162:0:17874:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00000100:00100000:3.0:1789708653.448166:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876645365529856:12345-0@lo:38:kworker.0 00080000:01000000:2.0:1789708653.448171:0:17874:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789708653.448180:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47df1b 00010000:00080000:3.0:1789708653.448184:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00010000:00080000:2.0:1789708653.448207:0:17874:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee02bf6000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.152@tcp at head 00000020:00000080:3.0:1789708653.448222:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf45f43947e47df22 00000004:00100000:3.0:1789708653.448230:0:17140:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789708653.448383:0:17140:0:(import.c:65:import_set_state_nolock()) ffff9bee18012000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708653.448437:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876645365529856:12345-0@lo:38:kworker.0 Request processed in 271us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708653.448446:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789708653.448471:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bed0a2f1180 x1876645365529856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1789708653.448483:0:17874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1789708653.448501:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789708653.448509:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789708653.448514:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789708653.448517:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa8e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789708653.448525:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365529856:0@lo:38:kworker.0 00000040:01000000:2.0:1789708653.449178:0:17874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789708653.449340:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1789708653.449706:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708653.449767:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3614:x1876645365529600:12345-0@lo:38:llog_process_th.0 Request processed in 1716us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708653.449775:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708653.449796:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708653.449801:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365529728:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789708653.449819:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708653.449833:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789708653.449839:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00100000:2.0:1789708653.449845:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365529728:12345-0@lo:38:kworker.0 Request processed in 40us (1847us total) trans 0 rc -11/-11 00000100:00080000:1.0:1789708653.449845:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:2.0:1789708653.449856:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789708653.449856:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789708653.449874:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365529600:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789708653.449907:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708653.449913:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee0685d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789708653.449917:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789708653.449922:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365529728:0@lo:38:kworker.0 00000100:00100000:0.0:1789708653.449935:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365529984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708653.449970:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708653.450009:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365529984 00000100:00100000:2.0:1789708653.450015:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365529984 00000100:00100000:2.0:1789708653.450053:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708653.450069:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876645365529984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789708653.450102:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1789708653.450180:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876645365529984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708653.450189:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708653.450212:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365529984:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789708653.450410:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708653.450589:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789708653.450759:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1789708653.451012:0:17879:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789708653.451017:0:17879:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789708653.451392:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789708653.451402:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789708653.451435:0:17874:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789708653.451451:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47df29 00000100:00080000:1.0:1789708653.451458:0:17874:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708653.451466:0:17874:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bee02bf6000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708653.451488:0:17874:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f1500 x1876645365530112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708653.451511:0:17874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789708653.451544:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365530112:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1789708653.451575:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000400:00000100:0.0:1789708653.451579:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365530112 offset 0 length 520: 4 00000020:00000080:1.0:1789708653.451582:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708653.451586:0:17874:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789708653.451590:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789708653.451593:0:17874:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789708653.451595:0:17874:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708653.451597:0:17874:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708653.451604:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789708653.451608:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708653.451610:0:17874:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789708653.451613:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789708653.451617:0:17874:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789708653.451620:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708653.451622:0:17874:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789708653.451625:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789708653.451628:0:17874:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:1.0:1789708653.451644:0:17874:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789708653.451647:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708653.451656:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9bee3dc399c0) 00000020:00000080:1.0:1789708653.451680:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789708653.451686:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789708653.451736:0:17874:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789708653.451743:0:17874:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789708653.451748:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47df37 00010000:00080000:1.0:1789708653.451771:0:17874:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed0a0a4800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789708653.451953:0:17874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789708653.452005:0:17874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789708653.452016:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1789708653.452135:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708653.452140:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708653.452142:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708653.452145:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789708653.453060:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708653.453219:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789708653.453334:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789708653.453563:0:17881:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789708653.453568:0:17881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789708653.453965:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789708653.453974:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789708653.454006:0:17874:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789708653.454020:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47df3e 00000100:00080000:2.0:1789708653.454027:0:17874:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708653.454035:0:17874:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bed0a0a4800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708653.454060:0:17874:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed09b80380 x1876645365530240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708653.454082:0:17874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789708653.454121:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365530240:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1789708653.454142:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708653.454147:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.454149:0:17874:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789708653.454154:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708653.454157:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.454159:0:17874:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789708653.454163:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789708653.454165:0:17874:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000400:00000100:0.0:1789708653.454168:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365530240 offset 0 length 520: 4 00000020:01000000:2.0:1789708653.454169:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708653.454178:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.454180:0:17874:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789708653.454184:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708653.454187:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.454188:0:17874:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789708653.454192:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789708653.454212:0:17874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708653.454215:0:17874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708653.454216:0:17874:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789708653.454219:0:17874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789708653.454309:0:17870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789708653.454355:0:17870:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789708653.454377:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.454387:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789708653.454396:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 10000000:01000000:0.0:1789708653.454401:0:17870:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee0446d000 from 1 00000100:00080000:1.0:1789708653.454402:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789708653.454404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708653.454407:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 10000000:01000000:0.0:1789708653.454412:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789708653.454436:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.454445:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.454456:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708653.454472:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365530368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708653.454505:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.454541:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7e0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708653.454596:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365530368 00000100:00100000:3.0:1789708653.454602:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365530368 00000100:00100000:3.0:1789708653.454650:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789708653.454674:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed099cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+15:17870:x1876645365530368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708653.454688:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708653.454701:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509200/0xf45f43947e47df4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47df45 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.454723:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509200/0xf45f43947e47df4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47df45 expref: 16 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.454733:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509200/0xf45f43947e47df4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47df45 expref: 16 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.454741:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509200, rc 0) 00000100:00100000:3.0:1789708653.454829:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed099cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+16:17870:x1876645365530368:12345-0@lo:101:mount.lustre.0 Request processed in 171us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708653.454836:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789708653.454896:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365530368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708653.454908:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.454916:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708653.455505:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365530496:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789708653.455539:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.455563:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7e0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708653.455585:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365530496 00000100:00100000:1.0:1789708653.455590:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365530496 00000100:00100000:1.0:1789708653.455625:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789708653.455632:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+16:17870:x1876645365530496:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789708653.455655:0:17134:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789708653.455685:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789708653.455689:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789708653.455776:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+16:17870:x1876645365530496:12345-0@lo:256:mount.lustre.0 Request processed in 143us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.455784:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708653.455794:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365530496:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789708653.456323:0:17870:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789708653.456344:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.456364:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708653.456373:0:17870:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee0446d000 from 1 10000000:01000000:0.0:1789708653.456376:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708653.456391:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.456396:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.456401:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708653.456409:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365530624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708653.456428:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.456445:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7e0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708653.456474:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365530624 00000100:00100000:3.0:1789708653.456479:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365530624 00000100:00100000:3.0:1789708653.456508:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789708653.456516:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+16:17870:x1876645365530624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708653.456523:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708653.456533:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01508000/0xf45f43947e47df5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47df53 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.456547:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01508000/0xf45f43947e47df5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47df53 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.456555:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01508000/0xf45f43947e47df5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47df53 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.456572:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508000, rc 0) 00000100:00100000:3.0:1789708653.456606:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17870:x1876645365530624:12345-0@lo:101:mount.lustre.0 Request processed in 92us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708653.456612:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789708653.456641:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365530624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708653.456652:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.456678:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708653.456788:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708653.456828:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365530752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708653.456851:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.456874:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7e03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708653.456897:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365530752 00000100:00100000:1.0:1789708653.456902:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365530752 00000100:00100000:1.0:1789708653.456931:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789708653.456938:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17870:x1876645365530752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708653.457012:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17870:x1876645365530752:12345-0@lo:501:mount.lustre.0 Request processed in 75us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.457019:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708653.457042:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365530752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708653.457074:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365530880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708653.457110:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.457126:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708653.457147:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365530880 00000100:00100000:3.0:1789708653.457153:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365530880 00000100:00100000:3.0:1789708653.457181:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789708653.457188:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17870:x1876645365530880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708653.457543:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17870:x1876645365530880:12345-0@lo:503:mount.lustre.0 Request processed in 354us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708653.457551:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789708653.457564:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365530880:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789708653.457875:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708653.457930:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708653.457965:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.457987:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7e0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708653.458013:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365531008 00000100:00100000:1.0:1789708653.458018:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365531008 00000100:00100000:1.0:1789708653.458044:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789708653.458050:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17870:x1876645365531008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708653.458138:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17870:x1876645365531008:12345-0@lo:502:mount.lustre.0 Request processed in 87us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.458146:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789708653.458156:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789708653.458351:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789708653.458372:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1789708653.458383:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1789708653.458393:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1789708653.458404:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1789708653.458414:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1789708653.458424:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1789708653.458435:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1789708653.458445:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789708653.458468:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1789708653.458480:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1789708653.458496:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708653.458527:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.458547:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2c7e0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708653.458562:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365531136 00000100:00100000:3.0:1789708653.458567:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365531136 00000100:00100000:3.0:1789708653.458592:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789708653.458600:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17870:x1876645365531136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708653.458706:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17870:x1876645365531136:12345-0@lo:502:mount.lustre.0 Request processed in 106us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708653.458717:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708653.458718:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:0.0:1789708653.458762:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1789708653.458775:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789708653.459021:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708653.459029:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708653.459031:0:17883:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789708653.459037:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee0446d000 00000020:00000080:0.0:1789708653.459040:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708653.459046:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708653.459049:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708653.459050:0:17883:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789708653.459052:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708653.459054:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708653.459056:0:17883:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789708653.459059:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee0446d000 00000020:00000080:0.0:1789708653.459061:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708653.459109:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708653.459112:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708653.459114:0:17883:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789708653.459117:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708653.459119:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708653.459120:0:17883:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789708653.459124:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee0446d000 00000020:00000080:0.0:1789708653.459126:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708653.459141:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708653.459143:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708653.459145:0:17883:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789708653.459147:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708653.459149:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708653.459151:0:17883:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789708653.459154:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee0446d000 00000020:00000080:0.0:1789708653.459156:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708653.459172:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708653.459176:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708653.459177:0:17883:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789708653.459180:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1789708653.459248:0:17870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789708653.459300:0:17870:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708653.459313:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.459328:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708653.459374:0:17870:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789708653.459376:0:17870:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bee0446d000 10000000:01000000:1.0:1789708653.459379:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bee0446d000 10000000:01000000:1.0:1789708653.459384:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789708653.459388:0:17870:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee0446d000 from 1 10000000:01000000:1.0:1789708653.459391:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789708653.459409:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.459416:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.459423:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708653.459436:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789708653.459467:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.459494:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20fac540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708653.459507:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365531264 00000100:00100000:0.0:1789708653.459513:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365531264 00000100:00100000:0.0:1789708653.459544:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789708653.459553:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17870:x1876645365531264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708653.459561:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708653.459571:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d0400/0xf45f43947e47df68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47df61 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.459588:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d0400/0xf45f43947e47df68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47df61 expref: 18 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.459598:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d0400/0xf45f43947e47df68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47df61 expref: 18 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.459605:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0400, rc 0) 00000100:00100000:0.0:1789708653.459637:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531264:12345-0@lo:101:mount.lustre.0 Request processed in 87us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708653.459644:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789708653.459685:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708653.459698:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.459707:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789708653.460600:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789708653.460809:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708653.460971:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789708653.460996:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1789708653.461012:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1789708653.461030:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1789708653.461060:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1789708653.461078:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1789708653.461096:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1789708653.461113:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1789708653.461134:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1789708653.461151:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1789708653.461175:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1789708653.461197:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1789708653.461215:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1789708653.461231:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1789708653.461250:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1789708653.461296:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1789708653.461320:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1789708653.461337:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1789708653.461355:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1789708653.461372:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1789708653.461408:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1789708653.461433:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1789708653.461457:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1789708653.461483:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1789708653.461506:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1789708653.461530:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1789708653.461555:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1789708653.461575:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1789708653.461601:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1789708653.461615:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789708653.461696:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708653.461731:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.461764:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20facd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708653.461776:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365531392 00000100:00100000:0.0:1789708653.461783:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365531392 00000100:00100000:0.0:1789708653.461823:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789708653.461832:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708653.461930:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531392:12345-0@lo:501:mount.lustre.0 Request processed in 99us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708653.461939:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789708653.461953:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708653.461995:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708653.462042:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.462063:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20facd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708653.462079:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365531520 00000100:00100000:0.0:1789708653.462084:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365531520 00000100:00100000:0.0:1789708653.462114:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789708653.462122:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708653.462232:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531520:12345-0@lo:503:mount.lustre.0 Request processed in 110us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708653.462239:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789708653.462282:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789708653.462606:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708653.462682:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708653.462728:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.462753:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1892c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789708653.462768:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365531648 00000100:00100000:0.0:1789708653.462774:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365531648 00000100:00100000:0.0:1789708653.462806:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789708653.462815:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708653.462919:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531648:12345-0@lo:502:mount.lustre.0 Request processed in 105us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708653.462927:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789708653.462933:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708653.463103:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789708653.463129:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1789708653.463150:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1789708653.463166:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1789708653.463181:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1789708653.463212:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1789708653.463235:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1789708653.463255:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1789708653.463297:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1789708653.463324:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1789708653.463344:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1789708653.463362:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1789708653.463381:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1789708653.463409:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1789708653.463425:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1789708653.463442:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1789708653.463477:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1789708653.463497:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1789708653.463515:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1789708653.463531:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1789708653.463546:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1789708653.463578:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1789708653.463595:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1789708653.463608:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1789708653.463623:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1789708653.463642:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1789708653.463662:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1789708653.463696:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1789708653.463713:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1789708653.463730:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1789708653.463753:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1789708653.463773:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1789708653.463790:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1789708653.463806:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1789708653.463823:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1789708653.463838:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1789708653.463857:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1789708653.463886:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1789708653.463903:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1789708653.463917:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1789708653.463932:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1789708653.463948:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1789708653.463969:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1789708653.463984:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1789708653.464004:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1789708653.464026:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1789708653.464053:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1789708653.464071:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1789708653.464104:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708653.464153:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.464183:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1892c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789708653.464195:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365531776 00000100:00100000:0.0:1789708653.464201:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365531776 00000100:00100000:0.0:1789708653.464236:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789708653.464246:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708653.464393:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531776:12345-0@lo:502:mount.lustre.0 Request processed in 148us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708653.464401:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789708653.464405:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708653.464558:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1789708653.464586:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1789708653.464608:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708653.464656:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.464699:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1892c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789708653.464704:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365531904 00000100:00100000:0.0:1789708653.464710:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365531904 00000100:00100000:0.0:1789708653.464746:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789708653.464756:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708653.464860:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365531904:12345-0@lo:502:mount.lustre.0 Request processed in 105us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708653.464868:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789708653.464871:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365531904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708653.464922:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1789708653.464931:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789708653.465506:0:17887:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789708653.465519:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9bee2d98cd40) 00000020:00000080:0.0:1789708653.465544:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789708653.465644:0:17887:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee0446d000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789708653.465649:0:17887:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee0446d000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789708653.465651:0:17887:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee0446d000 3 00010000:00080000:0.0:1789708653.465699:0:17887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed08bfe800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1789708653.467655:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789708653.467883:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789708653.467926:0:17887:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789708653.467940:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf45f43947e47df76 00000100:00080000:0.0:1789708653.467949:0:17887:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708653.467959:0:17887:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bed08bfe800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708653.467989:0:17887:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cca80 x1876645365532032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708653.468022:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365532032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789708653.468090:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.468162:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365532032 00000100:00100000:0.0:1789708653.468168:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365532032 00000100:00100000:0.0:1789708653.468198:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708653.468204:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876645365532032:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789708653.468226:0:17139:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1789708653.468321:0:17139:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf45f43947e47df7d 00000004:00100000:0.0:1789708653.468336:0:17139:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789708653.468366:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9bed0a045800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708653.468414:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876645365532032:12345-0@lo:38:llog_process_th.0 Request processed in 209us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708653.468422:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789708653.468459:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bed0a2cca80 x1876645365532032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708653.468474:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708653.468481:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789708653.468488:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789708653.468492:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789708653.468494:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08bfe800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789708653.468500:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365532032:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789708653.468519:0:17887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789708653.468542:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708653.468547:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789708653.468550:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708653.468553:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789708653.468725:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1789708653.468796:0:17870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789708653.468842:0:17870:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789708653.468860:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.468871:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789708653.468928:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789708653.468931:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789708653.468932:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708653.468934:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708653.468935:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708653.468937:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708653.468939:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708653.468941:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708653.468948:0:17870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708653.468951:0:17870:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789708653.468954:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708653.468956:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789708653.468958:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708653.468959:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708653.468960:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708653.468962:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708653.468963:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708653.468964:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708653.468966:0:17870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708653.468991:0:17870:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789708653.469003:0:17870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365532160:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789708653.469053:0:17870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.469087:0:17870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1892c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789708653.469097:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365532160 00000100:00100000:0.0:1789708653.469103:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365532160 00000100:00100000:0.0:1789708653.469171:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789708653.469180:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365532160:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789708653.469203:0:17134:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789708653.469216:0:17134:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789708653.470448:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789708653.470495:0:17134:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789708653.470510:0:17134:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789708653.470533:0:17154:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789708653.470539:0:17154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789708653.470556:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.470569:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01509400/0xf45f43947e47de88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47de81 expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.470578:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01509200/0xf45f43947e47df4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47df45 expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.470592:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.470619:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01509200/0xf45f43947e47df4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47df45 expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.470631:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee01509200/0xf45f43947e47df4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47df45 expref: 18 pid: 17133 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708653.470641:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365532288:0@lo:104: 00000100:00100000:3.0:1789708653.470686:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.470728:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17870:x1876645365532160:12345-0@lo:253:mount.lustre.0 Request processed in 1549us (1673us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708653.470730:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01509400/0xf45f43947e47de88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47de81 expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708653.470744:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1789708653.470745:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee01509400/0xf45f43947e47de88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47de81 expref: 18 pid: 17133 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708653.470756:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365532416:0@lo:104: 00000100:00100000:3.0:1789708653.470783:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708653.470802:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365532288 00000100:00100000:3.0:1789708653.470804:0:17154:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e8939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708653.470807:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365532288 00000100:00100000:3.0:1789708653.470826:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365532416 00000100:00100000:3.0:1789708653.470832:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365532416 00000100:00100000:0.0:1789708653.470869:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708653.470879:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708653.470881:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:17154:x1876645365532288:12345-0@lo:104: 00000100:00100000:3.0:1789708653.470891:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:17154:x1876645365532416:12345-0@lo:104: 00010000:00010000:0.0:1789708653.470895:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.470901:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708653.470956:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708653.470964:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:17154:x1876645365532288:12345-0@lo:104: Request processed in 87us (277us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708653.470965:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708653.470972:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708653.470983:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:17154:x1876645365532416:12345-0@lo:104: Request processed in 93us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708653.470991:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708653.471018:0:17870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17870:1876645365532160:0@lo:253:mount.lustre.0 00010000:00010000:3.0:1789708653.471023:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789708653.471032:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708653.471032:0:17870:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789708653.471038:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708653.471041:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789708653.471044:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:3.0:1789708653.471046:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc13d2d20) 00000020:01000004:0.0:1789708653.471046:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708653.471050:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 10000000:00010000:3.0:1789708653.471052:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789708653.471053:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708653.471056:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708653.471059:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708653.471062:0:17870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1789708653.471066:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708653.471074:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708653.471080:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:02000000:0.0:1789708653.471088:0:17870:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789708653.471114:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.471121:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708653.471142:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.471150:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0800/0xf45f43947e47df45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47df4c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.471163:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789708653.471166:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789708653.471167:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708653.471180:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365532544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708653.471191:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5a00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708653.471195:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.471202:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708653.471208:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708653.471214:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789708653.471221:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708653.471238:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.471246:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789708653.471321:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365532672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708653.471350:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708653.471365:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.471374:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47de81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47de88 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708653.471392:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708653.471395:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708653.471398:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708653.471406:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365532544 00000100:00100000:1.0:1789708653.471412:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365532544 00010000:00010000:3.0:1789708653.471435:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708653.471437:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01509200/0xf45f43947e47df4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47df45 expref: 18 pid: 17133 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708653.471463:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365532672 00000100:00100000:1.0:1789708653.471466:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365532672 00000100:00100000:3.0:1789708653.471472:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365532288:0@lo:104: 00010000:00010000:1.0:1789708653.471483:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01509400/0xf45f43947e47de88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47de81 expref: 19 pid: 17133 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708653.471488:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365532416:0@lo:104: 00000100:00100000:1.0:1789708653.471504:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708653.471516:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:3616:x1876645365532544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708653.471517:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471542:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708653.471550:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01509200/0xf45f43947e47df4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47df45 expref: 19 pid: 17133 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471563:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01509200/0xf45f43947e47df4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47df45 expref: 19 pid: 17133 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471577:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509200/0xf45f43947e47df4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47df45 expref: 19 pid: 17133 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708653.471581:0:17126:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1789708653.471588:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708653.471591:0:17126:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789708653.471628:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:3616:x1876645365532544:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.471635:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708653.471656:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708653.471679:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:3616:x1876645365532672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708653.471688:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708653.471693:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01509400/0xf45f43947e47de88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47de81 expref: 17 pid: 17133 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471706:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01509400/0xf45f43947e47de88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47de81 expref: 17 pid: 17133 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471720:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509400/0xf45f43947e47de88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47de81 expref: 17 pid: 17133 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471733:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471741:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789708653.471760:0:17124:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001222048s 00010000:00010000:1.0:1789708653.471765:0:17124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471773:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471779:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471785:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471791:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708653.471795:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471802:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471821:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708653.471830:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708653.471843:0:17154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708653.471852:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708653.471859:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+16:3616:x1876645365532672:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (509us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708653.471860:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509e00/0xf45f43947e47df84 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708653.471876:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708653.471910:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365532672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708653.471925:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365532544:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789708653.473032:0:17894:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000040:01000000:1.0:1789708653.473033:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789708653.473036:0:17894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789708653.473200:0:17895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789708653.473212:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789708653.473470:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1876645365532800:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789708653.473471:0:17895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708653.473517:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1789708653.473533:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1789708653.473545:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365532800 00000100:00100000:1.0:1789708653.473550:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365532800 00000100:00100000:1.0:1789708653.473579:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1789708653.473585:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708653.473589:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17896:x1876645365532800:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789708653.473646:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17896:x1876645365532800:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 60us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.473652:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708653.473685:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed088b5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708653.473700:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1876645365532800:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789708653.473725:0:17896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789708653.473753:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1876645365532928:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789708653.473794:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.473812:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365532928 00000100:00100000:1.0:1789708653.473815:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365532928 00000100:00100000:1.0:1789708653.473835:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708653.473842:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17896:x1876645365532928:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789708653.473925:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17896:x1876645365532928:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 83us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.473930:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708653.473945:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed088b5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708653.473956:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1876645365532928:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789708653.474011:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17896:1876645365533056:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789708653.474043:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.474057:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed088b5000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708653.474469:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365533056 00000100:00100000:1.0:1789708653.474474:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365533056 00000100:00100000:1.0:1789708653.474498:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708653.474506:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1876645365533056:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789708653.474544:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1876645365533056:12345-0@lo:900:lod0001_rec0000.0 Request processed in 40us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.474550:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789708653.474573:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bed0a2f3800 x1876645365533056/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789708669 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708653.474583:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17896:1876645365533056:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789708653.474619:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1876645365533184:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789708653.474654:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708653.474688:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365533184 00000100:00100000:1.0:1789708653.474692:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365533184 00000100:00100000:1.0:1789708653.474713:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708653.474719:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17896:x1876645365533184:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789708653.474761:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17896:x1876645365533184:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 42us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708653.474767:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708653.474785:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed088b5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708653.474797:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17896:1876645365533184:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789708653.474850:0:17896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789708653.475582:0:17870:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789708653.475590:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789708653.475642:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708653.481417:0:17895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789708653.481495:0:17895:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1789708653.483793:0:17870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789708653.486480:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789708653.486525:0:17896:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789708653.486529:0:17896:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1789708653.486577:0:17870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789708653.486638:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789708653.486781:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789708653.487209:0:17870:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1789708653.488454:0:17870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789708653.491784:0:17870:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789708653.491819:0:17870:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbde281c73988 00100000:10000000:3.0:1789708653.491827:0:17870:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789708653.492115:0:17870:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789708653.492144:0:17870:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789708653.492161:0:17870:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789708653.492173:0:17870:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789708653.493073:0:17870:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708653.493319:0:17870:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789708654.118331:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708654.310323:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5e40 going to sleep for 0 seconds 10000000:01000000:2.0:1789708654.502306:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789708654.502314:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee0446d000 from 8 10000000:01000000:2.0:1789708654.502319:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789708654.502363:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708654.502374:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708654.502395:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708654.502419:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365533312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708654.502477:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708654.502518:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40e8d540 going to sleep for 11 seconds 00000040:00080000:0.0:1789708654.502825:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789708654.502913:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365533312 00000100:00100000:0.0:1789708654.502920:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365533312 00000100:00100000:0.0:1789708654.502967:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789708654.502977:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+16:17136:x1876645365533312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708654.502990:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708654.503004:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47df92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47df8b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708654.503033:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47df92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47df8b expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708654.503043:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47df92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47df8b expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708654.503053:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0e00, rc 0) 00000100:00100000:0.0:1789708654.503096:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17136:x1876645365533312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708654.503103:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789708654.503118:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365533312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708654.503130:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708654.503140:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708654.503181:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365533440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789708654.503203:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708654.503216:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40e8d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708654.503232:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365533440 00000100:00100000:3.0:1789708654.503238:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365533440 00000100:00100000:3.0:1789708654.503293:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789708654.503300:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17136:x1876645365533440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789708654.503314:0:17134:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789708654.503328:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789708654.503330:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789708654.503401:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17136:x1876645365533440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708654.503408:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789708654.503415:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365533440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789708654.503460:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789708654.503467:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708654.503476:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708654.503485:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789708654.503487:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bed0a28c800 from 8 10000000:01000000:2.0:1789708654.503493:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789708654.503508:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708654.503515:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708654.503523:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708654.503535:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365533568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708654.503560:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708654.503581:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40e8d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708654.503581:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365533568 00000100:00100000:0.0:1789708654.503585:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365533568 00000100:00100000:0.0:1789708654.503612:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789708654.503618:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17136:x1876645365533568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708654.503625:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708654.503633:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47dfa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47df99 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708654.503659:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47dfa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47df99 expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708654.503668:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47dfa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47df99 expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708654.503682:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1800, rc 0) 00000100:00100000:0.0:1789708654.503717:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17136:x1876645365533568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708654.503729:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365533568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708654.503732:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1789708654.503739:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708654.503747:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708654.503779:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365533696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789708654.503804:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708654.503821:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40e8d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708654.503844:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365533696 00000100:00100000:0.0:1789708654.503848:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365533696 00000100:00100000:0.0:1789708654.503871:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789708654.503878:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17136:x1876645365533696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789708654.503887:0:17134:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789708654.503897:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789708654.503900:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789708654.503961:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17136:x1876645365533696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 83us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708654.503968:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365533696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789708654.503968:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 10000000:01000000:2.0:1789708654.503995:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789708654.504000:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708654.504016:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1789708654.824514:0:18140:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789708655.142368:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789708655.156041:0:18192:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708655.156175:0:18192:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789708655.334363:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5e40 going to sleep for 0 seconds 00000020:00000004:2.0:1789708655.490441:0:18242:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708655.490673:0:18242:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789708655.528055:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1789708655.816654:0:18290:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4e96d320 20000000:00000080:3.0:1789708655.816671:0:18290:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bee28a63800 uarg=0000000000000000 20000000:01000000:3.0:1789708655.816711:0:18290:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789708655.816718:0:18290:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789708655.816723:0:18290:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789708655.817081:0:18291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789708655.817168:0:18290:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789708655.821338:0:18290:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789708655.821372:0:18290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.821390:0:18290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee2f7d1600/0xf45f43947e47de57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47de50 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.821398:0:18290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01508000/0xf45f43947e47df5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47df53 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.821405:0:18290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.821453:0:18290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01508000/0xf45f43947e47df5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47df53 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.821483:0:18290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee01508000/0xf45f43947e47df5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47df53 expref: 17 pid: 17133 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708655.821498:0:18290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18290:1876645365533824:0@lo:104: 00000100:00100000:0.0:1789708655.821567:0:18290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708655.821660:0:18290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee2f7d1600/0xf45f43947e47de57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47de50 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.821668:0:18290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee2f7d1600/0xf45f43947e47de57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47de50 expref: 17 pid: 17132 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708655.821672:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365533824 00000100:00100000:0.0:1789708655.821679:0:18290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18290:1876645365533952:0@lo:104: 00000100:00100000:2.0:1789708655.821683:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365533824 00000100:00100000:0.0:1789708655.821705:0:18290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708655.821729:0:18290:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708655.821743:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365533952 00000100:00100000:2.0:1789708655.821747:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365533952 00000100:00100000:2.0:1789708655.821768:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708655.821777:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:18290:x1876645365533824:12345-0@lo:104: 00010000:00010000:2.0:1789708655.821792:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708655.821814:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708655.821828:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:18290:x1876645365533952:12345-0@lo:104: 00010000:00010000:1.0:1789708655.821839:0:17174:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.821863:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789708655.821870:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:18290:x1876645365533824:12345-0@lo:104: Request processed in 94us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708655.821877:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789708655.821895:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789708655.821903:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+3:18290:x1876645365533952:12345-0@lo:104: Request processed in 80us (198us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708655.821904:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789708655.821913:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789708655.821917:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.821927:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708655.821931:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.821940:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708655.821960:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708655.821967:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789708655.821986:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708655.822001:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.822009:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708655.822036:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.822043:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0200/0xf45f43947e47df53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47df5a expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.822058:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708655.822060:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708655.822063:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708655.822091:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708655.822105:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365534080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708655.822144:0:18290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18290:1876645365533824:0@lo:104: 00010000:00010000:2.0:1789708655.822317:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708655.822319:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708655.822322:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708655.822501:0:18290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18290:1876645365533952:0@lo:104: 00000100:00100000:3.0:1789708655.822511:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708655.822523:0:18290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708655.822559:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365534080 00010000:00010000:0.0:1789708655.822560:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708655.822564:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365534080 00010000:00010000:0.0:1789708655.822572:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5e00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708655.822575:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822584:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.822586:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01508000/0xf45f43947e47df5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47df53 expref: 18 pid: 17133 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708655.822604:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708655.822610:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789708655.822642:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789708655.822645:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708655.822655:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:3618:x1876645365534080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708655.822655:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708655.822671:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708655.822674:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.822679:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01508000/0xf45f43947e47df5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47df53 expref: 18 pid: 17133 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708655.822683:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789708655.822684:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5e00/0xf45f43947e47de50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47de57 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708655.822697:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365534208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708655.822718:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708655.822722:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708655.822724:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01508000/0xf45f43947e47df5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47df53 expref: 18 pid: 17133 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822726:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708655.822737:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708655.822743:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01508000/0xf45f43947e47df5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47df53 expref: 18 pid: 17133 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.822754:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708655.822779:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365534208 00000100:00100000:2.0:1789708655.822784:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:3618:x1876645365534080:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708655.822785:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365534208 00000100:00100000:2.0:1789708655.822792:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789708655.822803:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee2f7d1600/0xf45f43947e47de57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47de50 expref: 17 pid: 17132 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708655.822822:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365534080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708655.822836:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708655.822846:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:3617:x1876645365534208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708655.822854:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708655.822858:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee2f7d1600/0xf45f43947e47de57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47de50 expref: 17 pid: 17132 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822868:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee2f7d1600/0xf45f43947e47de57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47de50 expref: 17 pid: 17132 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822885:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d1600/0xf45f43947e47de57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47de50 expref: 17 pid: 17132 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822896:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822903:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822917:0:17125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822924:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822932:0:17125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822939:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822946:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708655.822950:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822958:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822976:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708655.822996:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708655.823012:0:18290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708655.823023:0:18290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708655.823037:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+16:3617:x1876645365534208:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (300us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708655.823048:0:18290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d0800/0xf45f43947e47dfa7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708655.823052:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708655.823095:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365534208:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1789708655.926346:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789708655.926356:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee0446d000 from 13 10000000:01000000:2.0:1789708655.926363:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708655.926425:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.926439:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.926452:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708655.926485:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708655.926568:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708655.926635:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365534336 00000100:00100000:3.0:1789708655.926645:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365534336 00000100:00100000:2.0:1789708655.926661:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708655.926740:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789708655.926749:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+16:17136:x1876645365534336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708655.926764:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708655.926783:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509400/0xf45f43947e47dfb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47dfae expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708655.926810:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509400/0xf45f43947e47dfb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47dfae expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708655.926821:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509400/0xf45f43947e47dfb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47dfae expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708655.926829:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509400, rc 0) 00000100:00100000:3.0:1789708655.926901:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17136:x1876645365534336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708655.926913:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789708655.926950:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708655.926971:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.926994:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708655.927063:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708655.927093:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708655.927112:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708655.927153:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365534464 00000100:00100000:3.0:1789708655.927165:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365534464 00000100:00100000:3.0:1789708655.927196:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789708655.927204:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17136:x1876645365534464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708655.927355:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17136:x1876645365534464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708655.927363:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789708655.927389:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708655.927436:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708655.927485:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708655.927508:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708655.927535:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365534592 00000100:00100000:3.0:1789708655.927541:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365534592 00000100:00100000:3.0:1789708655.927572:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789708655.927580:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17136:x1876645365534592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708655.927693:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17136:x1876645365534592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708655.927701:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789708655.927730:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789708655.928595:0:18305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789708655.928716:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789708655.928773:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708655.928780:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708655.928787:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708655.928796:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708655.928798:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed0a28c800 from 13 10000000:01000000:3.0:1789708655.928800:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708655.928829:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708655.928835:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708655.928849:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708655.928866:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708655.928894:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708655.928933:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365534720 00000100:00100000:3.0:1789708655.928938:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708655.928942:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365534720 00000100:00100000:2.0:1789708655.929007:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789708655.929021:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+17:17136:x1876645365534720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708655.929032:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708655.929047:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb5e00/0xf45f43947e47dfc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47dfbc expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.929069:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb5e00/0xf45f43947e47dfc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47dfbc expref: 18 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.929078:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb5e00/0xf45f43947e47dfc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47dfbc expref: 18 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.929100:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5e00, rc 0) 00000100:00100000:2.0:1789708655.929149:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17136:x1876645365534720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708655.929159:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789708655.929196:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708655.929211:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708655.929220:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708655.929301:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708655.929328:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708655.929353:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365534848 00000100:00100000:2.0:1789708655.929358:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365534848 00000100:00100000:3.0:1789708655.929363:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708655.929413:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789708655.929423:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17136:x1876645365534848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708655.929523:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17136:x1876645365534848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708655.929529:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789708655.929556:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708655.929596:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708655.929649:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708655.929665:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708655.929681:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365534976 00000100:00100000:2.0:1789708655.929686:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365534976 00000100:00100000:2.0:1789708655.929729:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789708655.929740:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17136:x1876645365534976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708655.929837:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:17136:x1876645365534976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708655.929846:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789708655.929871:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365534976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789708655.930512:0:18306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789708655.930585:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789708655.930643:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708655.930650:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708655.930658:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708656.166464:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708656.358371:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5e40 going to sleep for 0 seconds 00010000:00010000:1.0:1789708657.190372:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708657.383306:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5e40 going to sleep for 0 seconds 00000020:01000004:0.0:1789708658.056108:0:18639:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789708658.056113:0:18639:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789708658.056114:0:18639:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789708658.056286:0:18639:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bed0a047000 00000020:01000004:0.0:1789708658.056304:0:18639:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789708658.056318:0:18639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789708658.056332:0:18639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bee2d98b380) 00000020:00000080:0.0:1789708658.056348:0:18639:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789708658.076367:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789708658.077541:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789708658.077704:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789708658.077838:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789708658.077970:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789708658.078184:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789708658.078310:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1789708658.079220:0:18639:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789708658.079403:0:18639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789708658.079414:0:18639:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789708658.079423:0:18639:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45f43947e47dfd1 00000020:01000004:0.0:1789708658.079427:0:18639:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789708658.079444:0:18639:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789708658.079451:0:18639:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789708658.079458:0:18639:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789708658.079464:0:18639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789708658.079475:0:18639:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bee2d988000) 00000020:00000080:0.0:1789708658.079487:0:18639:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1789708658.081234:0:18639:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708658.081444:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789708658.081451:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789708658.081874:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789708658.081881:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789708658.082085:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789708658.082092:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789708658.083751:0:18639:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708658.083884:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789708658.083888:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789708658.084180:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789708658.084185:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789708658.103369:0:18639:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708658.103545:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789708658.103549:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789708658.104805:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789708658.104815:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789708658.105745:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789708658.105753:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789708658.108344:0:18639:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708658.108534:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789708658.108541:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789708658.108936:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789708658.108942:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789708658.153501:0:18639:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708658.153706:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789708658.153714:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789708658.154785:0:18639:0:(service.c:3474:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789708658.154801:0:18639:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789708658.155075:0:18639:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789708658.155102:0:18639:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789708658.155108:0:18639:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789708658.159822:0:18639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789708658.159857:0:18639:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789708658.159861:0:18639:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789708658.159863:0:18639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789708658.159865:0:18639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708658.159866:0:18639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708658.159867:0:18639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708658.159868:0:18639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708658.159870:0:18639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708658.159871:0:18639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708658.159872:0:18639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789708658.159876:0:18639:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789708658.159878:0:18639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708658.159879:0:18639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789708658.159880:0:18639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708658.159881:0:18639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708658.159882:0:18639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708658.159883:0:18639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708658.159884:0:18639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708658.159885:0:18639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708658.159887:0:18639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789708658.159917:0:18639:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789708658.159936:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535104:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789708658.160033:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708658.160084:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365535104 00000100:00100000:2.0:1789708658.160094:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365535104 00000100:00100000:1.0:1789708658.160094:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0651ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.160149:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789708658.160162:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:18639:x1876645365535104:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789708658.160202:0:17133:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789708658.160207:0:17133:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789708658.160210:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789708658.160562:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:18639:x1876645365535104:12345-0@lo:253:mount.lustre.0 Request processed in 402us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.160572:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789708658.160590:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535104:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789708658.160602:0:18639:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789708658.160605:0:18639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789708658.160606:0:18639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789708658.160607:0:18639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708658.160609:0:18639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708658.160610:0:18639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708658.160612:0:18639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708658.160614:0:18639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708658.160615:0:18639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708658.160616:0:18639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789708658.160647:0:18639:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bed0a047000 from lustre-OST0000 10000000:01000000:1.0:1789708658.160672:0:18639:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789708658.160675:0:18639:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789708658.160683:0:18639:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bed09714d40 local copy 00010000:00010000:1.0:1789708658.160692:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708658.160779:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708658.160804:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.160828:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0651fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.160851:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365535232 00000100:00100000:2.0:1789708658.160856:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365535232 00000100:00100000:2.0:1789708658.160884:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789708658.160893:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:18639:x1876645365535232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708658.160959:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:18639:x1876645365535232:12345-0@lo:501:mount.lustre.0 Request processed in 67us (153us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708658.160967:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789708658.160973:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535232:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789708658.160989:0:18639:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789708658.161007:0:18639:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789708658.161013:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.161021:0:18639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708658.161042:0:18639:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bed0a047000 10000000:01000000:1.0:1789708658.161046:0:18639:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789708658.161050:0:18639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789708658.161053:0:18639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789708658.161057:0:18639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789708658.161060:0:18639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789708658.161078:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.161084:0:18639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.161100:0:18639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708658.161112:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789708658.161136:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.161153:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0651fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.161181:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365535360 00000100:00100000:2.0:1789708658.161187:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365535360 00000100:00100000:2.0:1789708658.161211:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789708658.161219:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+18:18639:x1876645365535360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708658.161228:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708658.161241:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb5800/0xf45f43947e47dfe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47dfdf expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.161287:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb5800/0xf45f43947e47dfe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47dfdf expref: 19 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.161306:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb5800/0xf45f43947e47dfe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47dfdf expref: 19 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.161316:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5800, rc 0) 00000100:00100000:2.0:1789708658.161349:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:18639:x1876645365535360:12345-0@lo:101:mount.lustre.0 Request processed in 131us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.161357:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789708658.161366:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708658.161381:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.161391:0:18639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789708658.161973:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789708658.162429:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708658.163765:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789708658.163792:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789708658.163807:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789708658.163821:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789708658.163835:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789708658.163848:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789708658.163867:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789708658.163873:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789708658.163944:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708658.163988:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.164022:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0651f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.164037:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365535488 00000100:00100000:2.0:1789708658.164044:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365535488 00000100:00100000:2.0:1789708658.164078:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789708658.164087:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:18639:x1876645365535488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708658.164193:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:18639:x1876645365535488:12345-0@lo:501:mount.lustre.0 Request processed in 106us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.164202:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789708658.164211:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708658.164255:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708658.164325:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.164350:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0651f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.164378:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365535616 00000100:00100000:2.0:1789708658.164383:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365535616 00000100:00100000:2.0:1789708658.164411:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789708658.164420:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:18639:x1876645365535616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708658.164874:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:18639:x1876645365535616:12345-0@lo:503:mount.lustre.0 Request processed in 455us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.164879:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708658.164911:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789708658.165167:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708658.165217:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708658.165245:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.165284:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.165287:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365535744 00000100:00100000:2.0:1789708658.165291:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365535744 00000100:00100000:2.0:1789708658.165311:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789708658.165316:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09858850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:18639:x1876645365535744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708658.165612:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09858850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:18639:x1876645365535744:12345-0@lo:502:mount.lustre.0 Request processed in 296us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.165623:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789708658.165638:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708658.165731:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789708658.165746:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789708658.165754:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789708658.165760:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789708658.165767:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789708658.165773:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789708658.165791:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789708658.165798:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789708658.165805:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789708658.165811:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789708658.165817:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789708658.165824:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789708658.165837:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708658.165861:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.165874:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.165891:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365535872 00000100:00100000:2.0:1789708658.165895:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365535872 00000100:00100000:2.0:1789708658.165912:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789708658.165917:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:18639:x1876645365535872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708658.165975:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:18639:x1876645365535872:12345-0@lo:502:mount.lustre.0 Request processed in 58us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.165980:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789708658.166001:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365535872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708658.166030:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789708658.166039:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789708658.166425:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789708658.166432:0:18656:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789708658.166443:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708658.166445:0:18656:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789708658.166450:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708658.166461:0:18656:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bee3dd78000) 00000020:00000080:2.0:1789708658.166480:0:18656:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789708658.166487:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789708658.166549:0:18656:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed0a047000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789708658.166555:0:18656:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789708658.166560:0:18656:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45f43947e47dff4 00010000:00010000:2.0:1789708658.168901:0:18656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789708658.169192:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1789708658.169994:0:18656:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789708658.170725:0:18656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789708658.170734:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708658.170740:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708658.170742:0:18656:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789708658.170746:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789708658.170748:0:18656:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1789708658.170750:0:18656:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708658.170751:0:18656:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708658.170753:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789708658.170755:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708658.170757:0:18656:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789708658.170761:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708658.170763:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708658.170765:0:18656:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789708658.170768:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789708658.170770:0:18656:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789708658.170773:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708658.170775:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708658.170776:0:18656:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789708658.170779:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708658.170782:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708658.170784:0:18656:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789708658.170789:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789708658.170807:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708658.170811:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708658.170817:0:18656:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789708658.170822:0:18656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789708658.170907:0:18639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789708658.170940:0:18639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789708658.170963:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.170973:0:18639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708658.170980:0:18639:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed0a047000 from 1 10000000:01000000:1.0:1789708658.170982:0:18639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708658.171009:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.171014:0:18639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.171022:0:18639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708658.171037:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789708658.171084:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708658.171122:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365536000 00000100:00100000:1.0:1789708658.171122:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708658.171135:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365536000 00000100:00100000:3.0:1789708658.171170:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789708658.171177:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09858450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:18639:x1876645365536000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708658.171188:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708658.171199:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01508e00/0xf45f43947e47e002 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47dffb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.171217:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01508e00/0xf45f43947e47e002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47dffb expref: 20 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.171225:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01508e00/0xf45f43947e47e002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47dffb expref: 20 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.171231:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508e00, rc 0) 00000100:00100000:3.0:1789708658.171289:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09858450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:18639:x1876645365536000:12345-0@lo:101:mount.lustre.0 Request processed in 112us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708658.171294:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789708658.171318:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708658.171330:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.171336:0:18639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789708658.171987:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789708658.172172:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708658.172367:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789708658.172392:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789708658.172408:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789708658.172413:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789708658.172467:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708658.172494:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.172521:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.172526:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365536128 00000100:00100000:2.0:1789708658.172531:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365536128 00000100:00100000:2.0:1789708658.172557:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789708658.172564:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:18639:x1876645365536128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708658.172645:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:18639:x1876645365536128:12345-0@lo:501:mount.lustre.0 Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.172657:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789708658.172662:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708658.172701:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708658.172735:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.172753:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.172757:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365536256 00000100:00100000:2.0:1789708658.172762:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365536256 00000100:00100000:2.0:1789708658.172785:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789708658.172791:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:18639:x1876645365536256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708658.172868:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:18639:x1876645365536256:12345-0@lo:503:mount.lustre.0 Request processed in 76us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.172874:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789708658.172883:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536256:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789708658.173110:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708658.173152:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708658.173186:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.173205:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.173214:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365536384 00000100:00100000:2.0:1789708658.173218:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365536384 00000100:00100000:2.0:1789708658.173242:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789708658.173251:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:18639:x1876645365536384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708658.173346:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:18639:x1876645365536384:12345-0@lo:502:mount.lustre.0 Request processed in 98us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.173352:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789708658.173368:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708658.173498:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789708658.173519:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789708658.173534:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789708658.173548:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789708658.173562:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789708658.173588:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789708658.173613:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789708658.173628:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789708658.173640:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789708658.173653:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789708658.173667:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789708658.173685:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708658.173716:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.173738:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.173752:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365536512 00000100:00100000:2.0:1789708658.173757:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365536512 00000100:00100000:2.0:1789708658.173784:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789708658.173792:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:18639:x1876645365536512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708658.173870:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:18639:x1876645365536512:12345-0@lo:502:mount.lustre.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.173877:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789708658.173880:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708658.173915:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789708658.173921:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789708658.174339:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708658.174346:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708658.174348:0:18660:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789708658.174354:0:18660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bed0a047000 00000020:00000080:1.0:1789708658.174356:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789708658.174362:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708658.174364:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708658.174365:0:18660:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789708658.174367:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708658.174369:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708658.174371:0:18660:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789708658.174374:0:18660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bed0a047000 00000020:00000080:1.0:1789708658.174376:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789708658.174410:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708658.174413:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708658.174414:0:18660:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789708658.174418:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708658.174420:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708658.174422:0:18660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789708658.174425:0:18660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bed0a047000 00000020:00000080:1.0:1789708658.174432:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789708658.174452:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708658.174455:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708658.174456:0:18660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789708658.174459:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708658.174461:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708658.174463:0:18660:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789708658.174466:0:18660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bed0a047000 00000020:00000080:1.0:1789708658.174468:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789708658.174487:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708658.174489:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708658.174491:0:18660:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789708658.174493:0:18660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789708658.174544:0:18639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789708658.174588:0:18639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708658.174604:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.174620:0:18639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708658.174673:0:18639:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789708658.174676:0:18639:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bed0a047000 10000000:01000000:2.0:1789708658.174679:0:18639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bed0a047000 10000000:01000000:2.0:1789708658.174684:0:18639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789708658.174689:0:18639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bed0a047000 from 1 10000000:01000000:2.0:1789708658.174692:0:18639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789708658.174714:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.174720:0:18639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.174727:0:18639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708658.174737:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789708658.174765:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708658.174788:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365536640 00000100:00100000:2.0:1789708658.174791:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365536640 00000100:00100000:2.0:1789708658.174816:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789708658.174821:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:18639:x1876645365536640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708658.174826:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708658.174836:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb4600/0xf45f43947e47e010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e009 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.174859:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb4600/0xf45f43947e47e010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e009 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.174867:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb4600/0xf45f43947e47e010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e009 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.174873:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4600, rc 0) 00000100:00100000:2.0:1789708658.174892:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365536640:12345-0@lo:101:mount.lustre.0 Request processed in 72us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.174897:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789708658.174929:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee0840 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.174940:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708658.174949:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.174955:0:18639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708658.175690:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789708658.175870:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708658.176012:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789708658.176038:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789708658.176057:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789708658.176072:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789708658.176090:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789708658.176105:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789708658.176116:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789708658.176125:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789708658.176162:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789708658.176182:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789708658.176200:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789708658.176213:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789708658.176227:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789708658.176241:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789708658.176307:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789708658.176325:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789708658.176339:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789708658.176350:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789708658.176361:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789708658.176374:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789708658.176384:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789708658.176393:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789708658.176408:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789708658.176422:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789708658.176435:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789708658.176445:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789708658.176458:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789708658.176480:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789708658.176501:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789708658.176524:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789708658.176560:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789708658.176592:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789708658.176609:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789708658.176626:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789708658.176645:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789708658.176656:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789708658.176667:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789708658.176683:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789708658.176687:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789708658.176752:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708658.176799:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708658.176830:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708658.176842:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365536768 00000100:00100000:3.0:1789708658.176849:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365536768 00000100:00100000:3.0:1789708658.176889:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789708658.176900:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365536768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708658.176995:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365536768:12345-0@lo:501:mount.lustre.0 Request processed in 98us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708658.177004:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789708658.177018:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708658.177059:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708658.177105:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708658.177123:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708658.177144:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365536896 00000100:00100000:3.0:1789708658.177149:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365536896 00000100:00100000:3.0:1789708658.177180:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789708658.177189:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365536896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708658.177313:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365536896:12345-0@lo:503:mount.lustre.0 Request processed in 125us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708658.177320:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789708658.177332:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365536896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789708658.177682:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708658.177759:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365537024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708658.177805:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708658.177833:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365537024 00000100:00100000:2.0:1789708658.177836:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789708658.177838:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365537024 00000100:00100000:3.0:1789708658.177872:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789708658.177880:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365537024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708658.177975:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365537024:12345-0@lo:502:mount.lustre.0 Request processed in 97us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.177980:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365537024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708658.177985:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000040:00080000:2.0:1789708658.178109:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789708658.178129:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789708658.178143:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789708658.178160:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789708658.178178:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789708658.178195:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789708658.178223:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789708658.178241:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789708658.178282:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789708658.178304:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789708658.178326:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789708658.178340:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789708658.178351:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789708658.178360:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789708658.178372:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789708658.178387:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789708658.178396:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789708658.178404:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789708658.178411:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789708658.178420:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789708658.178428:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789708658.178436:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789708658.178452:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789708658.178462:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789708658.178473:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789708658.178481:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789708658.178492:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789708658.178500:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789708658.178509:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789708658.178517:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789708658.178527:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789708658.178535:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789708658.178545:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789708658.178553:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789708658.178561:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789708658.178569:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789708658.178593:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789708658.178606:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789708658.178623:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789708658.178634:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789708658.178652:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789708658.178672:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789708658.178687:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789708658.178703:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789708658.178720:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789708658.178730:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789708658.178738:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789708658.178745:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789708658.178788:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365537152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708658.178844:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708658.178877:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365537152 00000100:00100000:2.0:1789708658.178878:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789708658.178885:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365537152 00000100:00100000:3.0:1789708658.178934:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789708658.178945:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365537152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708658.179084:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365537152:12345-0@lo:502:mount.lustre.0 Request processed in 142us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708658.179092:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789708658.179125:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365537152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789708658.179386:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789708658.179412:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789708658.179434:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365537280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708658.179478:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708658.179503:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789708658.179549:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365537280 00000100:00100000:3.0:1789708658.179555:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365537280 00000100:00100000:3.0:1789708658.179598:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789708658.179608:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365537280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708658.179691:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365537280:12345-0@lo:502:mount.lustre.0 Request processed in 84us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708658.179700:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789708658.179704:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365537280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789708658.179761:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789708658.179771:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789708658.180887:0:18664:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789708658.180906:0:18664:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bee3dc3b380) 00000020:00000080:1.0:1789708658.180930:0:18664:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789708658.181049:0:18664:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed0a047000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789708658.181054:0:18664:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bed0a047000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789708658.181057:0:18664:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed0a047000 3 00010000:00080000:1.0:1789708658.181098:0:18664:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed01d73000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789708658.182757:0:18664:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789708658.182992:0:18664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789708658.183031:0:18664:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789708658.183043:0:18664:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf45f43947e47e01e 00000100:00080000:1.0:1789708658.183053:0:18664:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708658.183062:0:18664:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bed01d73000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708658.183101:0:18664:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f0a80 x1876645365537408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708658.183121:0:18664:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789708658.183174:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789708658.183181:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789708658.183193:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee0685d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708658.183201:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee0685d800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708658.183224:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a3a6d80 x1876645365537536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708658.183238:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708658.183242:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708658.183245:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708658.183248:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708658.183332:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708658.183336:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708658.183340:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708658.183343:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789708658.183351:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365537792:0@lo:400:kworker.0 00000100:00100000:3.0:1789708658.183396:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365537664:0@lo:400:kworker.0 00000100:00100000:1.0:1789708658.183448:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708658.183485:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708658.183529:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708658.183531:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365537792 00000100:00100000:1.0:1789708658.183538:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365537792 00000100:00100000:3.0:1789708658.183540:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365537920:0@lo:400:kworker.0 00000100:00100000:1.0:1789708658.183589:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708658.183595:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.183600:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365537792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708658.183635:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365537664 00000100:00100000:3.0:1789708658.183642:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365537664 00000100:00100000:1.0:1789708658.183652:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365537792:12345-0@lo:400:kworker.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708658.183659:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708658.183689:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365537920 00000100:00100000:3.0:1789708658.183694:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365537920 00000100:00100000:1.0:1789708658.183704:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365537792:0@lo:400:kworker.0 00000100:00100000:3.0:1789708658.183726:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708658.183740:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365537664:12345-0@lo:400:kworker.0 00000020:01000004:1.0:1789708658.183749:0:18664:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789708658.183769:0:18664:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9bee2f48cd40) 00000020:00000080:1.0:1789708658.183786:0:18664:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:3.0:1789708658.183792:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365537664:12345-0@lo:400:kworker.0 Request processed in 55us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708658.183808:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708658.183826:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708658.183835:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365537920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708658.183878:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365537920:12345-0@lo:400:kworker.0 Request processed in 45us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708658.183885:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1789708658.183887:0:18664:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed0a047000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789708658.183891:0:18664:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bed0a047000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789708658.183894:0:18664:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed0a047000 3 00010000:00080000:3.0:1789708658.183916:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bed0a3a5880 x1876645365537920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708658.183927:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365537920:0@lo:400:kworker.0 00010000:00080000:1.0:1789708658.183932:0:18664:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed01d71800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.152@tcp at head 00010000:00080000:3.0:1789708658.183950:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bed0a3a7100 x1876645365537664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708658.183959:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365537664:0@lo:400:kworker.0 00000100:00100000:3.0:1789708658.184005:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365537408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708658.184040:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708658.184067:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365537536:0@lo:38:kworker.0 00000100:00100000:3.0:1789708658.184113:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708658.184156:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365537536 00000100:00100000:3.0:1789708658.184160:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365537536 00000100:00100000:3.0:1789708658.184182:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708658.184187:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365537536:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789708658.184209:0:17143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:3.0:1789708658.184257:0:17143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47e02c 00000004:00100000:3.0:1789708658.184299:0:17143:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789708658.184313:0:17143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789708658.184390:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365537408 00000100:00100000:3.0:1789708658.184395:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365537408 00000100:00100000:3.0:1789708658.184414:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708658.184420:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876645365537408:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789708658.184434:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:3.0:1789708658.184474:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf45f43947e47e033 00000004:00100000:3.0:1789708658.184484:0:17140:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789708658.184516:0:17140:0:(import.c:65:import_set_state_nolock()) ffff9bed018e5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708658.184559:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876645365537408:12345-0@lo:38:llog_process_th.0 Request processed in 137us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708658.184566:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789708658.184610:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bed0a2f0a80 x1876645365537408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708658.184619:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789708658.184625:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789708658.184632:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789708658.184637:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789708658.184640:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed01d73000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789708658.184645:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365537408:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1789708658.185706:0:18664:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789708658.185907:0:18664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789708658.185956:0:18664:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789708658.185965:0:18664:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf45f43947e47e03a 00000100:00080000:1.0:1789708658.185970:0:18664:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708658.185976:0:18664:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9bed01d71800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708658.185998:0:18664:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f2300 x1876645365538048/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708658.186019:0:18664:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789708658.186043:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876645365538048:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708658.186091:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789708658.186149:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708658.186155:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708658.186158:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708658.186168:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708658.186172:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708658.186176:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708658.186179:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708658.186182:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789708658.186205:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365538048 00000100:00100000:3.0:1789708658.186210:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365538048 00000040:00080000:1.0:1789708658.186231:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:3.0:1789708658.186240:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708658.186246:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876645365538048:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789708658.186289:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:3.0:1789708658.186332:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf45f43947e47e041 00000004:00100000:3.0:1789708658.186344:0:17140:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:2.0:1789708658.186350:0:18639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789708658.186401:0:18639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789708658.186422:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.186433:0:18639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789708658.186488:0:18639:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789708658.186491:0:18639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789708658.186493:0:18639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708658.186494:0:18639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708658.186496:0:18639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708658.186497:0:18639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708658.186499:0:18639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708658.186501:0:18639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708658.186503:0:18639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789708658.186508:0:18639:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000100:00080000:3.0:1789708658.186514:0:17140:0:(import.c:65:import_set_state_nolock()) ffff9bed018e4000 : changing import state from RECOVER to FULL 00000020:01000004:2.0:1789708658.186518:0:18639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789708658.186521:0:18639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789708658.186522:0:18639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708658.186524:0:18639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708658.186525:0:18639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708658.186527:0:18639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708658.186528:0:18639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708658.186529:0:18639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708658.186530:0:18639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789708658.186558:0:18639:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789708658.186564:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876645365538048:12345-0@lo:38:llog_process_th.0 Request processed in 316us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.186585:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365538176:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789708658.186587:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708658.186645:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708658.186684:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708658.186853:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365538176 00000100:00100000:3.0:1789708658.186857:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365538176 00000100:00100000:3.0:1789708658.186901:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789708658.186910:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:18639:x1876645365538176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789708658.186932:0:17133:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789708658.186952:0:17133:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789708658.187133:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bed0a2f2300 x1876645365538048/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708658.187140:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789708658.187151:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789708658.187157:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789708658.187160:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789708658.187162:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed01d71800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789708658.187168:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876645365538048:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789708658.187748:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9bed018e1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708658.187794:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1876645365537536:12345-0@lo:38:kworker.0 Request processed in 3605us (3680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708658.187801:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789708658.187809:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789708658.187816:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789708658.187819:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789708658.187821:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee0685d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789708658.187835:0:3614:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c0c59383): req@ffff9bed0a2cd180 x1876645365528064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708658.187849:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365537536:0@lo:38:kworker.0 00000100:00100000:3.0:1789708658.187873:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365538304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789708658.187895:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708658.187920:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365538304 00000100:00100000:2.0:1789708658.187923:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365538304 00000100:00100000:2.0:1789708658.187949:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708658.187954:0:17143:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789708658.187955:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365538304:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789708658.187965:0:17143:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:2.0:1789708658.187981:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789708658.188068:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365538304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.188072:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708658.188098:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365538304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789708658.188203:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708658.188226:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365528064 00000100:00100000:2.0:1789708658.188230:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365528064 00000100:00100000:0.0:1789708658.188230:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e9b5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.188257:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789708658.188313:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17181:x1876645365528064:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789708658.188366:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17181:x1876645365528064:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 56us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.188370:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708658.188562:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17181:1876645365528064:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789708658.188688:0:17181:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789708658.188728:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17181:1876645365538432:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789708658.188772:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708658.188811:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708658.188829:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365538432 00000100:00100000:0.0:1789708658.188833:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365538432 00000100:00100000:0.0:1789708658.188861:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708658.188870:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17181:x1876645365538432:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789708658.188982:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17181:x1876645365538432:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 114us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708658.188989:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708658.189018:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17181:1876645365538432:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789708658.189094:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17181:1876645365538560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789708658.189127:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708658.189145:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2005c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708658.189157:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365538560 00000100:00100000:2.0:1789708658.189163:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365538560 00000100:00100000:2.0:1789708658.189190:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708658.189200:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17181:x1876645365538560:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789708658.189249:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17181:x1876645365538560:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.189255:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708658.189356:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17181:1876645365538560:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1789708658.189414:0:17181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708658.191054:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 20000000:01000000:3.0:1789708658.191089:0:17133:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789708658.191099:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000004:00080000:0.0:1789708658.191115:0:17181:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 9, retries 0 00000004:00080000:0.0:1789708658.191120:0:17181:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 20000000:01000000:3.0:1789708658.191141:0:17154:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789708658.191146:0:17154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789708658.191162:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.191174:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47df92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47df8b expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.191189:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47dfa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47df99 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.191194:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.191222:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47dfa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47df99 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.191231:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47dfa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47df99 expref: 21 pid: 17133 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708658.191240:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365538688:0@lo:104: 00000100:00100000:3.0:1789708658.191299:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708658.191333:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365538688 00010000:00010000:3.0:1789708658.191345:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47df92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47df8b expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708658.191346:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365538688 00010000:00010000:3.0:1789708658.191354:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47df92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47df8b expref: 21 pid: 17133 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708658.191360:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365538816:0@lo:104: 00000100:00100000:3.0:1789708658.191380:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708658.191391:0:17154:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed04272600 going to sleep for 11 seconds 00000100:00100000:0.0:1789708658.191402:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789708658.191411:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365538816 00000100:00100000:3.0:1789708658.191415:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365538816 00000100:00100000:0.0:1789708658.191417:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708658.191422:0:17174:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:0.0:1789708658.191427:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:17154:x1876645365538688:12345-0@lo:104: 00000100:00100000:3.0:1789708658.191434:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789708658.191442:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708658.191443:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2c798050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:17154:x1876645365538816:12345-0@lo:104: 00000100:00100000:1.0:1789708658.191443:0:17174:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1789708658.191454:0:17174:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:3.0:1789708658.191468:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708658.191492:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708658.191498:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:17154:x1876645365538688:12345-0@lo:104: Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708658.191504:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789708658.191520:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789708658.191522:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708658.191529:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708658.191530:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2c798050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+3:17154:x1876645365538816:12345-0@lo:104: Request processed in 88us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708658.191542:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5400 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708658.191545:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708658.191546:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789708658.191552:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708658.191557:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708658.191561:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708658.191605:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708658.191606:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.191610:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708658.191612:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708658.191617:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4e00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708658.191621:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.191627:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708658.191632:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708658.191635:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708658.191640:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708658.191646:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5400/0xf45f43947e47df99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47dfa0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708658.191648:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365538944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708658.191659:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365538688:0@lo:104: 00010000:00010000:3.0:1789708658.191660:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708658.191660:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708658.191664:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708658.191669:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708658.191671:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789708658.191679:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365538816:0@lo:104: 00000100:00100000:2.0:1789708658.191684:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708658.191694:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708658.191701:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365539072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708658.191704:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4e00/0xf45f43947e47df8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47df92 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.191712:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708658.191721:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708658.191725:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708658.191728:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708658.191732:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708658.191756:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365538944 00000100:00100000:2.0:1789708658.191759:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365539072 00000100:00100000:1.0:1789708658.191762:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365538944 00000100:00100000:2.0:1789708658.191765:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365539072 00000100:00100000:3.0:1789708658.191783:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:18639:x1876645365538176:12345-0@lo:253:mount.lustre.0 Request processed in 4875us (5139us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708658.191790:0:17891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47dfa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47df99 expref: 23 pid: 17133 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708658.191794:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:2.0:1789708658.191794:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47df92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47df8b expref: 23 pid: 17133 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708658.191828:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708658.191841:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:3615:x1876645365538944:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708658.191842:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708658.191849:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:18639:1876645365538176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789708658.191856:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36241450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:3616:x1876645365539072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708658.191858:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:3.0:1789708658.191860:0:18639:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789708658.191864:0:18639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708658.191866:0:18639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789708658.191868:0:18639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708658.191869:0:18639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:2.0:1789708658.191869:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708658.191869:0:17891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47dfa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47df99 expref: 22 pid: 17133 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789708658.191872:0:18639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708658.191875:0:18639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708658.191878:0:18639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:2.0:1789708658.191878:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47df92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47df8b expref: 22 pid: 17133 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789708658.191880:0:18639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708658.191883:0:18639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1789708658.191896:0:17891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47dfa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47df99 expref: 22 pid: 17133 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1789708658.191903:0:18639:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789708658.191909:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47df92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47df8b expref: 22 pid: 17133 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.191935:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47dfa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47df99 expref: 22 pid: 17133 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.191939:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47df92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47df8b expref: 22 pid: 17133 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.191967:0:17891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.191977:0:17891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.191985:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:1.0:1789708658.191991:0:17891:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001222048s 00010000:00010000:1.0:1789708658.192005:0:17891:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.192014:0:17891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708658.192018:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36241450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:3616:x1876645365539072:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.192030:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789708658.192032:0:17891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708658.192034:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365539072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708658.192046:0:17891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.192052:0:17891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708658.192056:0:17891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.192064:0:17891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.192084:0:17891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.192095:0:17154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708658.192097:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708658.192103:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708658.192108:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509200/0xf45f43947e47e048 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708658.192146:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:3615:x1876645365538944:12345-0@lo:103:ldlm_bl.0 Request processed in 307us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708658.192150:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365538944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708658.192160:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000001:00000004:0.0:1789708658.195971:0:18639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789708658.199641:0:18639:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789708658.199649:0:18639:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789708658.199692:0:18639:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789708658.199733:0:18639:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789708658.199750:0:18639:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789708658.199768:0:18639:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789708658.200794:0:18639:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708658.200945:0:18639:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789708658.214490:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789708658.523087:0:18722:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708658.523249:0:18722:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789708658.534426:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708658.534449:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365539200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789708658.534526:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708658.534583:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365539200 00000100:00100000:0.0:1789708658.534592:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365539200 00000100:00100000:0.0:1789708658.534649:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708658.534658:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365539200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789708658.534690:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1789708658.534767:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365539200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708658.534775:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708658.534808:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365539200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708659.238353:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708649/real 1789708649] req@ffff9bed09b80700 x1876645365525632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789708659.238383:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708659.238384:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bed09b80700 x1876645365525632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708659.238398:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708649/real 1789708649] req@ffff9bed0a2cd500 x1876645365525504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708659.238415:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bed0a2cd500 x1876645365525504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708659.238434:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee18455800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708659.238454:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789708659.238458:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365525632:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789708659.238466:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee18452000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708659.238480:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789708659.238485:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365525504:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789708659.238519:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708659.238532:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365539328:0@lo:400:kworker.0 00000100:00080000:1.0:1789708659.238536:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789708659.238540:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365539456:0@lo:400:kworker.0 00000100:00080000:1.0:1789708659.238542:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789708659.238547:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bee18452000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708659.238572:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 219 00000100:00080000:1.0:1789708659.238578:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789708659.238589:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bee18452000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708659.238613:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f3800 x1876645365539584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708659.238616:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708659.238617:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789708659.238636:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708659.238640:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789708659.238642:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bee18455800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708659.238647:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 219 00000100:00080000:1.0:1789708659.238651:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1789708659.238653:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365539456 00000100:00080000:1.0:1789708659.238657:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bee18455800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708659.238662:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365539456 00000100:00100000:1.0:1789708659.238672:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f0380 x1876645365539712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708659.238696:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365539328 00000100:00100000:0.0:1789708659.238701:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365539328 00000100:00100000:3.0:1789708659.238708:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708659.238720:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365539456:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789708659.238727:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708659.238731:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789708659.238735:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708659.238738:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789708659.238747:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789708659.238760:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:3617:x1876645365539328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708659.238773:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365539456:12345-0@lo:400:kworker.0 Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708659.238781:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789708659.238799:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708659.238803:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789708659.238808:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789708659.238808:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:3617:x1876645365539328:12345-0@lo:400:kworker.0 Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00080000:1.0:1789708659.238817:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789708659.238822:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789708659.238846:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365540096:0@lo:400:kworker.0 00000100:00100000:0.0:1789708659.238864:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365539840:0@lo:400:kworker.0 00000100:00100000:0.0:1789708659.238902:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708659.238912:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365540224:0@lo:400:kworker.0 00000100:00100000:3.0:1789708659.238942:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708659.238946:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365540352:0@lo:400:kworker.0 00000100:00100000:1.0:1789708659.238966:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708659.238970:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708659.238978:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365539968:0@lo:400:kworker.0 00000100:00100000:2.0:1789708659.238979:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365539840 00000100:00100000:2.0:1789708659.238986:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365539840 00000100:00100000:0.0:1789708659.238991:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708659.239009:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365539456:0@lo:400:kworker.0 00000100:00100000:3.0:1789708659.239016:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708659.239028:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365540096 00000100:00100000:2.0:1789708659.239033:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365540096 00000100:00100000:0.0:1789708659.239039:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365539328:0@lo:400:kworker.0 00000100:00100000:3.0:1789708659.239059:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365540224 00000100:00100000:2.0:1789708659.239060:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365540352 00000100:00100000:3.0:1789708659.239066:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365540224 00000100:00100000:2.0:1789708659.239066:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365540352 00000100:00100000:0.0:1789708659.239070:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365539584:0@lo:8:kworker.0 00000100:00100000:1.0:1789708659.239102:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365539968 00000100:00100000:1.0:1789708659.239107:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365539968 00000100:00100000:0.0:1789708659.239110:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708659.239116:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708659.239125:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708659.239129:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365539840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708659.239138:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365539712:0@lo:8:kworker.0 00000100:00100000:2.0:1789708659.239140:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365540096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708659.239143:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789708659.239155:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365539968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708659.239185:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365539840:12345-0@lo:400:kworker.0 Request processed in 61us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708659.239191:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708659.239197:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708659.239213:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365540096:12345-0@lo:400:kworker.0 Request processed in 76us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708659.239216:0:17139:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789708659.239222:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365539968:12345-0@lo:400:kworker.0 Request processed in 66us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708659.239229:0:17139:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789708659.239230:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708659.239236:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708659.239241:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365539584 00000100:00100000:0.0:1789708659.239246:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365539584 00000100:00100000:2.0:1789708659.239279:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708659.239285:0:17140:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789708659.239286:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365539712 00000100:00100000:0.0:1789708659.239292:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365539712 00000100:00100000:2.0:1789708659.239293:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365540224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708659.239300:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708659.239311:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365540352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708659.239316:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708659.239325:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876645365539584:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789708659.239343:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365540224:12345-0@lo:400:kworker.0 Request processed in 55us (376us total) trans 0 rc 0/0 00010000:00080000:0.0:1789708659.239351:0:18644:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000100:00100000:2.0:1789708659.239356:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708659.239361:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365540352:12345-0@lo:400:kworker.0 Request processed in 51us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708659.239367:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365539968:0@lo:400:kworker.0 00000100:00100000:1.0:1789708659.239373:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789708659.239383:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a2f2d80 x1876645365540096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1789708659.239384:0:18644:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47e04f 00000100:00100000:3.0:1789708659.239394:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365540096:0@lo:400:kworker.0 00002000:00100000:0.0:1789708659.239401:0:18644:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bed04165000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00010000:00080000:2.0:1789708659.239405:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a2f0000 x1876645365540224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1789708659.239407:0:18644:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00080000:1.0:1789708659.239412:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00100000:0.0:1789708659.239413:0:18644:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1789708659.239418:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708659.239425:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365540224:0@lo:400:kworker.0 00010000:00080000:2.0:1789708659.239584:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a2f3480 x1876645365539840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708659.239595:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365539840:0@lo:400:kworker.0 00010000:00080000:2.0:1789708659.239612:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a2f1880 x1876645365540352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708659.239622:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365540352:0@lo:400:kworker.0 00002000:00080000:0.0:1789708659.239632:0:18644:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789708659.239659:0:18644:0:(import.c:65:import_set_state_nolock()) ffff9bed04163800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708659.239700:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1876645365539584:12345-0@lo:8:kworker.0 Request processed in 375us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708659.239709:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789708659.239717:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a2f3800 x1876645365539584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708659.239727:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708659.239742:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1789708659.239743:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876645365539712:12345-0@lo:8:kworker.0 00000100:00080000:2.0:1789708659.239750:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00010000:00020000:0.0:1789708659.239758:0:18644:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789708659.239759:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789708659.239766:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789708659.239769:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee18452000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789708659.239790:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789708659.239796:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365539584:0@lo:8:kworker.0 00000004:00080000:3.0:1789708659.239821:0:17163:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789708659.239842:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17163:1876645365540736:0@lo:5:osp-pre-0-0.0 00000040:00080000:2.0:1789708659.239861:0:17162:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 9 count 2 00000100:00100000:3.0:1789708659.239868:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708659.239879:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee0cc0 going to sleep for 11 seconds 00000040:00080000:2.0:1789708659.239891:0:17162:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789708659.239896:0:17162:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1789708659.239899:0:18646:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789708659.239904:0:18646:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:2.0:1789708659.239924:0:17162:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789708659.239968:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365540608:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789708659.239980:0:17162:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 230049718810ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789708659.239989:0:17162:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789708659.239991:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708659.240006:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708659.240010:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365540480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708659.240025:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708659.240055:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365540736 00000100:00100000:3.0:1789708659.240058:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365540736 00000100:00100000:3.0:1789708659.240074:0:18646:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789708659.240078:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365540608 00000100:00100000:3.0:1789708659.240079:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365540608 00000100:00100000:3.0:1789708659.240131:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708659.240139:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:17163:x1876645365540736:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789708659.240147:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365540480 00000100:00100000:2.0:1789708659.240152:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365540480 00000100:00100000:2.0:1789708659.240179:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708659.240187:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3618:x1876645365540480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708659.240206:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789708659.240247:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3618:x1876645365540480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708659.240254:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789708659.240374:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a3a5f80 x1876645365540480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708659.240391:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365540480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789708659.240442:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789708659.240808:0:17119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789708659.241099:0:18838:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789708659.241105:0:18838:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789708659.241108:0:18838:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:3.0:1789708659.249280:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.249290:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ace53a/0xf45f43947e47e056 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249306:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.249311:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.249317:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042ace53a/0xf45f43947e47e056 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249336:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042ace53a/0xf45f43947e47e056 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249347:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ace53a/0xf45f43947e47e056 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249353:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042ace53a/0xf45f43947e47e056 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249371:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.249401:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.249408:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042ace53a/0xf45f43947e47e056 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249417:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.249420:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ace53a/0xf45f43947e47e056 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249435:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ace53a/0xf45f43947e47e056 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249450:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042ace53a/0xf45f43947e47e056 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249455:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042ace53a/0xf45f43947e47e056 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249470:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.249472:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.249473:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.249589:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.249593:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039543cfd/0xf45f43947e47e05d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249599:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.249601:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.249604:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039543cfd/0xf45f43947e47e05d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249618:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039543cfd/0xf45f43947e47e05d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249623:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039543cfd/0xf45f43947e47e05d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249627:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039543cfd/0xf45f43947e47e05d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249640:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.249663:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.249669:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039543cfd/0xf45f43947e47e05d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249677:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.249680:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039543cfd/0xf45f43947e47e05d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249686:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039543cfd/0xf45f43947e47e05d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249695:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039543cfd/0xf45f43947e47e05d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249708:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039543cfd/0xf45f43947e47e05d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249718:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.249719:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.249720:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.249836:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.249840:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aad870c8/0xf45f43947e47e064 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249845:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.249847:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.249849:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aad870c8/0xf45f43947e47e064 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249854:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aad870c8/0xf45f43947e47e064 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249859:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aad870c8/0xf45f43947e47e064 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249871:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aad870c8/0xf45f43947e47e064 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.249883:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.249899:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.249904:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aad870c8/0xf45f43947e47e064 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249911:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.249914:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aad870c8/0xf45f43947e47e064 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249919:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aad870c8/0xf45f43947e47e064 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249927:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aad870c8/0xf45f43947e47e064 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249932:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aad870c8/0xf45f43947e47e064 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.249942:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.249943:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.249944:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.250056:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.250060:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003bc17f1/0xf45f43947e47e06b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250065:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.250067:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.250070:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003bc17f1/0xf45f43947e47e06b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250075:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003bc17f1/0xf45f43947e47e06b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250079:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003bc17f1/0xf45f43947e47e06b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250084:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003bc17f1/0xf45f43947e47e06b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250095:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.250110:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.250117:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003bc17f1/0xf45f43947e47e06b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250125:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.250129:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003bc17f1/0xf45f43947e47e06b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250137:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003bc17f1/0xf45f43947e47e06b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250149:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003bc17f1/0xf45f43947e47e06b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250156:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003bc17f1/0xf45f43947e47e06b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250169:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.250171:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.250172:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.250310:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.250316:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47e072 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250329:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.250332:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.250336:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47e072 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250345:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47e072 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250351:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47e072 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250355:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47e072 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250366:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.250387:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.250393:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47e072 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250400:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.250404:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47e072 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250417:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47e072 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250426:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47e072 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250430:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f0d197e/0xf45f43947e47e072 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250439:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.250440:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.250441:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.250573:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.250579:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47e079 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250586:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.250589:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.250593:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47e079 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250601:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47e079 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250621:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47e079 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250628:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47e079 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250644:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.250656:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.250660:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47e079 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250666:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.250669:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47e079 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250674:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47e079 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250681:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47e079 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250694:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081cbb1fa/0xf45f43947e47e079 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250704:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.250705:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.250706:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.250850:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.250857:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a24ba846/0xf45f43947e47e080 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250865:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.250868:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.250872:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a24ba846/0xf45f43947e47e080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250882:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a24ba846/0xf45f43947e47e080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250890:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a24ba846/0xf45f43947e47e080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250898:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a24ba846/0xf45f43947e47e080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.250928:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.250940:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.250943:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a24ba846/0xf45f43947e47e080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250949:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.250952:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a24ba846/0xf45f43947e47e080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250957:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a24ba846/0xf45f43947e47e080 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250965:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a24ba846/0xf45f43947e47e080 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250970:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a24ba846/0xf45f43947e47e080 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.250980:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.250981:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.250982:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.251108:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.251114:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000407a083b/0xf45f43947e47e087 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251122:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.251125:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.251130:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000407a083b/0xf45f43947e47e087 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251138:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000407a083b/0xf45f43947e47e087 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251146:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000407a083b/0xf45f43947e47e087 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251152:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000407a083b/0xf45f43947e47e087 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251169:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.251182:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.251187:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000407a083b/0xf45f43947e47e087 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251193:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.251195:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000407a083b/0xf45f43947e47e087 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251201:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000407a083b/0xf45f43947e47e087 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251209:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000407a083b/0xf45f43947e47e087 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251214:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000407a083b/0xf45f43947e47e087 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251224:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.251225:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.251227:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.251355:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.251361:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bba25edb/0xf45f43947e47e08e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251369:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.251377:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.251381:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bba25edb/0xf45f43947e47e08e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251390:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bba25edb/0xf45f43947e47e08e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251398:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bba25edb/0xf45f43947e47e08e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251404:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bba25edb/0xf45f43947e47e08e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251419:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.251426:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.251430:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bba25edb/0xf45f43947e47e08e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251435:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.251439:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bba25edb/0xf45f43947e47e08e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251453:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bba25edb/0xf45f43947e47e08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251463:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bba25edb/0xf45f43947e47e08e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251468:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bba25edb/0xf45f43947e47e08e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251479:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.251480:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.251481:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708659.251544:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876645365539712:12345-0@lo:8:kworker.0 Request processed in 11797us (12344us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789708659.251565:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789708659.251579:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee18455800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708659.251586:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708659.251591:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365539712:0@lo:8:kworker.0 00000100:00100000:0.0:1789708659.251596:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708659.251608:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3618:x1876645365540608:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1789708659.251610:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.251618:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2c7f0fe/0xf45f43947e47e095 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251627:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.251630:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00002000:00080000:0.0:1789708659.251632:0:18644:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1789708659.251635:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c7f0fe/0xf45f43947e47e095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251647:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2c7f0fe/0xf45f43947e47e095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251657:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2c7f0fe/0xf45f43947e47e095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251670:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c7f0fe/0xf45f43947e47e095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251685:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.251693:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.251698:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2c7f0fe/0xf45f43947e47e095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251703:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.251706:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2c7f0fe/0xf45f43947e47e095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251711:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2c7f0fe/0xf45f43947e47e095 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251718:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2c7f0fe/0xf45f43947e47e095 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251730:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2c7f0fe/0xf45f43947e47e095 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251740:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.251742:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.251743:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708659.251823:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3618:x1876645365540608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 219us (11830us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708659.251829:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:2.0:1789708659.251835:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bed09b81c00, transno 0 00000004:00080000:2.0:1789708659.251841:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bed09b81c00/1, rc -2, transno 0 00000100:00100000:2.0:1789708659.251853:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365540608:0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1789708659.251909:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.251916:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47e09c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251923:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.251925:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.251927:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47e09c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251933:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47e09c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708659.251937:0:17162:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 1, last_idx 2 00010000:00010000:3.0:1789708659.251939:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47e09c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.251945:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47e09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708659.251953:0:17162:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00010000:00010000:3.0:1789708659.251959:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.251977:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.251982:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47e09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251988:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.251991:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47e09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.251996:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47e09c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252006:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47e09c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252010:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47e09c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252023:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.252025:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.252026:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.252142:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.252146:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47e0a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252157:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.252159:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.252163:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47e0a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252172:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47e0a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252180:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47e0a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252188:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47e0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252204:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.252218:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.252222:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47e0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252228:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.252230:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47e0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252235:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47e0a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252243:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47e0a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252248:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47e0a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252273:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.252275:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.252276:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.252390:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.252394:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c593c618/0xf45f43947e47e0aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252399:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.252401:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.252404:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c593c618/0xf45f43947e47e0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252409:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c593c618/0xf45f43947e47e0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252422:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c593c618/0xf45f43947e47e0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252426:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c593c618/0xf45f43947e47e0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252436:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.252443:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.252448:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c593c618/0xf45f43947e47e0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252454:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.252457:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c593c618/0xf45f43947e47e0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252471:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c593c618/0xf45f43947e47e0aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252479:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c593c618/0xf45f43947e47e0aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252484:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c593c618/0xf45f43947e47e0aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252494:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.252495:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.252496:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.252582:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.252586:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47e0b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252591:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.252593:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.252596:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47e0b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252601:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47e0b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252606:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47e0b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252610:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47e0b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252627:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.252634:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.252637:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47e0b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252644:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.252646:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47e0b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252651:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47e0b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252659:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47e0b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252672:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ea71910/0xf45f43947e47e0b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252683:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.252684:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.252685:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.252838:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.252842:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cf0c351/0xf45f43947e47e0b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252848:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.252850:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.252852:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cf0c351/0xf45f43947e47e0b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252858:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cf0c351/0xf45f43947e47e0b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252862:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cf0c351/0xf45f43947e47e0b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252868:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cf0c351/0xf45f43947e47e0b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.252879:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.252885:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.252891:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cf0c351/0xf45f43947e47e0b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252900:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.252903:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cf0c351/0xf45f43947e47e0b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252909:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cf0c351/0xf45f43947e47e0b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252917:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cf0c351/0xf45f43947e47e0b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252922:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cf0c351/0xf45f43947e47e0b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.252931:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.252932:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.252934:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.253049:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.253054:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47e0bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253059:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.253065:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.253068:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47e0bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253073:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47e0bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253078:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47e0bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253082:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47e0bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253092:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.253101:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.253107:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47e0bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253115:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.253119:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47e0bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253128:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47e0bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253138:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47e0bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253142:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47e0bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253152:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.253153:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.253154:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.253340:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.253346:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87fb9e2/0xf45f43947e47e0c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253355:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.253357:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.253361:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c87fb9e2/0xf45f43947e47e0c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253370:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c87fb9e2/0xf45f43947e47e0c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253378:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87fb9e2/0xf45f43947e47e0c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253391:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c87fb9e2/0xf45f43947e47e0c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253405:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.253412:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.253416:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c87fb9e2/0xf45f43947e47e0c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253421:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.253425:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87fb9e2/0xf45f43947e47e0c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253438:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87fb9e2/0xf45f43947e47e0c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253447:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c87fb9e2/0xf45f43947e47e0c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253452:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c87fb9e2/0xf45f43947e47e0c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253462:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.253463:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.253464:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.253585:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.253589:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47e0cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253595:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.253597:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.253599:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47e0cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253605:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47e0cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253609:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47e0cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253614:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47e0cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253623:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.253630:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.253635:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47e0cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253641:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.253644:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47e0cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253649:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47e0cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253657:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47e0cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253670:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61b3c23/0xf45f43947e47e0cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253679:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.253681:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.253682:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.253800:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.253804:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47e0d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253813:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.253814:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.253817:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47e0d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253823:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47e0d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253827:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47e0d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253832:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47e0d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.253841:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.253850:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.253854:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47e0d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253860:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.253863:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47e0d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253870:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47e0d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253878:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47e0d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253882:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47e0d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.253891:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.253893:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.253894:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.254006:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.254010:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c178535/0xf45f43947e47e0db lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254015:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.254017:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.254020:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c178535/0xf45f43947e47e0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254025:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c178535/0xf45f43947e47e0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254038:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c178535/0xf45f43947e47e0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254042:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c178535/0xf45f43947e47e0db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254051:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.254058:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.254062:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c178535/0xf45f43947e47e0db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254068:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.254070:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c178535/0xf45f43947e47e0db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254076:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c178535/0xf45f43947e47e0db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254084:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c178535/0xf45f43947e47e0db lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254091:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c178535/0xf45f43947e47e0db lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254106:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.254107:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.254109:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.254210:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.254214:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47e0e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254218:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.254220:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.254222:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47e0e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254228:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47e0e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254233:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47e0e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254238:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47e0e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254255:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.254279:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.254284:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47e0e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254289:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.254293:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47e0e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254306:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47e0e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254317:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47e0e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254322:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47e0e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254332:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.254334:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.254335:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.254459:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.254465:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47e0e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254473:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.254476:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.254480:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47e0e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254489:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47e0e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254497:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47e0e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254505:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47e0e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254519:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.254525:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.254529:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47e0e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254535:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.254537:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47e0e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254543:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47e0e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254550:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47e0e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254576:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47e0e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254587:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.254588:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.254590:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.254706:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.254712:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053a68c3a/0xf45f43947e47e0f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254720:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.254728:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.254733:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053a68c3a/0xf45f43947e47e0f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254742:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053a68c3a/0xf45f43947e47e0f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254750:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053a68c3a/0xf45f43947e47e0f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254757:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053a68c3a/0xf45f43947e47e0f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254771:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.254778:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.254784:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053a68c3a/0xf45f43947e47e0f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254793:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.254796:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053a68c3a/0xf45f43947e47e0f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254805:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053a68c3a/0xf45f43947e47e0f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254816:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053a68c3a/0xf45f43947e47e0f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254821:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053a68c3a/0xf45f43947e47e0f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.254830:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.254831:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.254832:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.254948:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.254953:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47e0f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254959:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.254960:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.254963:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47e0f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254968:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47e0f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254973:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47e0f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254982:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47e0f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.254991:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.254999:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.255003:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47e0f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255010:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.255012:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47e0f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255018:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47e0f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255025:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47e0f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255029:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47e0f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255039:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.255041:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.255042:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708659.255143:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708659.255147:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47e0fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.255152:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789708659.255154:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708659.255156:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47e0fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.255162:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47e0fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.255166:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47e0fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.255170:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47e0fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.255180:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.255188:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.255192:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47e0fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255199:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.255201:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47e0fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255215:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47e0fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255223:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47e0fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255228:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47e0fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255238:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.255239:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.255240:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708659.255457:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708659.255464:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3f6e3d5/0xf45f43947e47e105 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.255471:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=230s v=(0 0) 00010000:00010000:2.0:1789708659.255474:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708659.255477:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f6e3d5/0xf45f43947e47e105 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.255485:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3f6e3d5/0xf45f43947e47e105 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.255491:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3f6e3d5/0xf45f43947e47e105 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.255496:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f6e3d5/0xf45f43947e47e105 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.255507:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.255514:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.255518:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3f6e3d5/0xf45f43947e47e105 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255525:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.255527:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3f6e3d5/0xf45f43947e47e105 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255533:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3f6e3d5/0xf45f43947e47e105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255540:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3f6e3d5/0xf45f43947e47e105 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255553:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3f6e3d5/0xf45f43947e47e105 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255574:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.255575:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.255576:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708659.255696:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708659.255700:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7a1f6f2/0xf45f43947e47e10c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.255710:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=230s v=(0 0) 00010000:00010000:2.0:1789708659.255712:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708659.255715:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a1f6f2/0xf45f43947e47e10c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.255720:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7a1f6f2/0xf45f43947e47e10c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.255725:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7a1f6f2/0xf45f43947e47e10c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.255730:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a1f6f2/0xf45f43947e47e10c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.255740:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708659.255745:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.255749:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7a1f6f2/0xf45f43947e47e10c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255754:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708659.255757:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7a1f6f2/0xf45f43947e47e10c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255762:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7a1f6f2/0xf45f43947e47e10c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789708659.255770:0:18838:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:1.0:1789708659.255772:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7a1f6f2/0xf45f43947e47e10c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255781:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7a1f6f2/0xf45f43947e47e10c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.255794:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.255796:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.255798:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708659.255837:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17163:x1876645365540736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15696us (15969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708659.255861:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17163:1876645365540736:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789708659.255862:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:3.0:1789708659.255875:0:17163:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789708659.255924:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17163:1876645365540864:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789708659.255959:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708659.255986:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789708659.256013:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365540864 00000100:00100000:0.0:1789708659.256025:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365540864 00000100:00100000:0.0:1789708659.256069:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708659.256080:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17163:x1876645365540864:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789708659.256120:0:18646:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1789708659.259108:0:18640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789708659.259130:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789708659.259216:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17163:x1876645365540864:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3137us (3253us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789708659.259225:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708659.259247:0:17163:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789708659.259255:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17163:1876645365540864:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789708659.259287:0:17163:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 10000000:01000000:3.0:1789708659.494298:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708659.494305:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee0446d000 from 9 10000000:01000000:3.0:1789708659.494310:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708659.494352:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.494364:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.494377:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708659.494402:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365540992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708659.494467:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708659.494511:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f7d2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708659.494530:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365540992 00000100:00100000:1.0:1789708659.494538:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365540992 00000100:00100000:1.0:1789708659.494598:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789708659.494608:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:17136:x1876645365540992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708659.494620:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708659.494633:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e11a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e113 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.494656:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e113 expref: 20 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.494679:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e113 expref: 20 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.494688:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949400, rc 0) 00000100:00100000:1.0:1789708659.494729:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:17136:x1876645365540992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708659.494735:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789708659.494771:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365540992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708659.494787:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.494796:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708659.494847:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365541120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789708659.494879:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708659.494899:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f7d2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708659.494917:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365541120 00000100:00100000:1.0:1789708659.494921:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365541120 00000100:00100000:1.0:1789708659.494947:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789708659.494953:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:17136:x1876645365541120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789708659.494967:0:17134:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789708659.494984:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789708659.494986:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789708659.495066:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:17136:x1876645365541120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708659.495073:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789708659.495084:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365541120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789708659.495139:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789708659.495150:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.495158:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708659.495167:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789708659.495169:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bed0a28c800 from 9 10000000:01000000:2.0:1789708659.495171:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789708659.495187:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.495193:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.495200:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.495212:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365541248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708659.495240:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708659.495256:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee305f1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708659.495294:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365541248 00000100:00100000:1.0:1789708659.495303:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365541248 00000100:00100000:1.0:1789708659.495329:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789708659.495336:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:17136:x1876645365541248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708659.495343:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708659.495349:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e128 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e121 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.495358:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e121 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.495363:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e121 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.495369:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949a00, rc 0) 00000100:00100000:1.0:1789708659.495402:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:17136:x1876645365541248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708659.495408:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789708659.495434:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365541248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708659.495447:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.495456:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.495494:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365541376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789708659.495528:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708659.495565:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee305f1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708659.495572:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365541376 00000100:00100000:3.0:1789708659.495577:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365541376 00000100:00100000:3.0:1789708659.495607:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789708659.495614:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0a8a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:17136:x1876645365541376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789708659.495625:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789708659.495637:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789708659.495640:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789708659.495719:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0a8a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:17136:x1876645365541376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708659.495725:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365541376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789708659.495730:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 10000000:01000000:2.0:1789708659.495787:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789708659.495791:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.495796:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1789708660.142189:0:19014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789708660.267308:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789708660.483762:0:19066:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708660.483949:0:19066:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1789708660.802686:0:19116:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708660.802858:0:19116:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789708661.286624:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708661.478446:0:17175:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708661.478458:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708661.478480:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789708661.478492:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789708662.310556:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789708663.176994:0:19460:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789708663.176998:0:19460:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789708663.177000:0:19460:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789708663.177114:0:19460:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bee30700000 00000020:01000004:3.0:1789708663.177128:0:19460:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789708663.177142:0:19460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789708663.177165:0:19460:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bed04204d40) 00000020:00000080:3.0:1789708663.177181:0:19460:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789708663.199750:0:19460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789708663.201100:0:19460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789708663.201314:0:19460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789708663.201419:0:19460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789708663.201557:0:19460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789708663.201679:0:19460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789708663.201796:0:19460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1789708663.202300:0:19460:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789708663.202508:0:19460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789708663.202521:0:19460:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789708663.202529:0:19460:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45f43947e47e136 00000020:01000004:1.0:1789708663.202533:0:19460:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789708663.202550:0:19460:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789708663.202552:0:19460:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789708663.202557:0:19460:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789708663.202576:0:19460:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789708663.202579:0:19460:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789708663.205986:0:19460:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789708663.206023:0:19460:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.152@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789708663.206028:0:19460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789708663.206030:0:19460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708663.206031:0:19460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708663.206032:0:19460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708663.206033:0:19460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708663.206034:0:19460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708663.206036:0:19460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708663.206038:0:19460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708663.206039:0:19460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789708663.206042:0:19460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789708663.206045:0:19460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708663.206046:0:19460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708663.206047:0:19460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708663.206047:0:19460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708663.206048:0:19460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708663.206049:0:19460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708663.206050:0:19460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708663.206051:0:19460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708663.206051:0:19460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789708663.206082:0:19460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789708663.206103:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365541504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789708663.206176:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708663.206220:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04eea780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708663.206231:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365541504 00000100:00100000:3.0:1789708663.206239:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365541504 00000100:00100000:3.0:1789708663.206301:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789708663.206308:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0a8a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:19460:x1876645365541504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789708663.206333:0:17133:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789708663.206336:0:17133:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789708663.206344:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789708663.207143:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0a8a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:19460:x1876645365541504:12345-0@lo:253:mount.lustre.0 Request processed in 833us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708663.207151:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789708663.207177:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365541504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789708663.207185:0:19460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789708663.207187:0:19460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708663.207187:0:19460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708663.207188:0:19460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708663.207189:0:19460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708663.207190:0:19460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708663.207190:0:19460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708663.207191:0:19460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708663.207192:0:19460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708663.207193:0:19460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789708663.207215:0:19460:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bee30700000 from lustre-OST0001 10000000:01000000:3.0:1789708663.207233:0:19460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789708663.207234:0:19460:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789708663.207241:0:19460:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bed09714d40 local copy 00010000:00010000:3.0:1789708663.207248:0:19460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708663.207324:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365541632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708663.207344:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.207362:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04eea780 going to sleep for 11 seconds 00000100:00100000:0.0:1789708663.207389:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365541632 00000100:00100000:0.0:1789708663.207396:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365541632 00000100:00100000:0.0:1789708663.207428:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789708663.207437:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:19460:x1876645365541632:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708663.207516:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:19460:x1876645365541632:12345-0@lo:501:mount.lustre.0 Request processed in 81us (170us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708663.207525:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789708663.207547:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365541632:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789708663.207559:0:19460:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789708663.207571:0:19460:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789708663.207575:0:19460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.207581:0:19460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708663.207605:0:19460:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bee30700000 10000000:01000000:3.0:1789708663.207608:0:19460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789708663.207611:0:19460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789708663.207613:0:19460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708663.207615:0:19460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789708663.207617:0:19460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789708663.207632:0:19460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.207637:0:19460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.207643:0:19460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708663.207650:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365541760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708663.207666:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.207678:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04eea780 going to sleep for 11 seconds 00000100:00100000:1.0:1789708663.207705:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365541760 00000100:00100000:1.0:1789708663.207713:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365541760 00000100:00100000:1.0:1789708663.207741:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789708663.207747:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:19460:x1876645365541760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708663.207755:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708663.207768:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e948c00/0xf45f43947e47e144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e13d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708663.207787:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e948c00/0xf45f43947e47e144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e13d expref: 22 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708663.207797:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e948c00/0xf45f43947e47e144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e13d expref: 22 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708663.207806:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948c00, rc 0) 00000100:00100000:1.0:1789708663.207839:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:19460:x1876645365541760:12345-0@lo:101:mount.lustre.0 Request processed in 91us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708663.207845:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789708663.207851:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365541760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708663.207861:0:19460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.207868:0:19460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708663.208304:0:19460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789708663.208733:0:19460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708663.210015:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789708663.210050:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789708663.210066:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789708663.210079:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789708663.210093:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789708663.210106:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789708663.210126:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789708663.210132:0:19460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789708663.210209:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365541888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708663.210245:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.210292:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee182d20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708663.210307:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365541888 00000100:00100000:0.0:1789708663.210314:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365541888 00000100:00100000:0.0:1789708663.210355:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789708663.210361:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:19460:x1876645365541888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708663.210441:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:19460:x1876645365541888:12345-0@lo:501:mount.lustre.0 Request processed in 80us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708663.210451:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789708663.210457:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365541888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708663.210504:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708663.210540:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.210553:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee182d20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708663.210576:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365542016 00000100:00100000:1.0:1789708663.210582:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365542016 00000100:00100000:1.0:1789708663.210613:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789708663.210621:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:19460:x1876645365542016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708663.211027:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:19460:x1876645365542016:12345-0@lo:503:mount.lustre.0 Request processed in 407us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708663.211035:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789708663.211043:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789708663.211255:0:19460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789708663.211313:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708663.211352:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708663.211389:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365542144 00000100:00100000:3.0:1789708663.211393:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee054f8900 going to sleep for 11 seconds 00000100:00100000:0.0:1789708663.211394:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365542144 00000100:00100000:0.0:1789708663.211425:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789708663.211432:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:19460:x1876645365542144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708663.211678:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:19460:x1876645365542144:12345-0@lo:502:mount.lustre.0 Request processed in 246us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708663.211683:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789708663.211701:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708663.211794:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789708663.211808:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789708663.211816:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789708663.211823:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789708663.211830:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789708663.211846:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789708663.211853:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789708663.211866:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789708663.211873:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789708663.211885:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708663.211908:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.211921:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee054f8900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708663.211943:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365542272 00000100:00100000:1.0:1789708663.211948:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365542272 00000100:00100000:1.0:1789708663.211979:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789708663.211986:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:19460:x1876645365542272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708663.212061:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:19460:x1876645365542272:12345-0@lo:502:mount.lustre.0 Request processed in 74us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708663.212069:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789708663.212076:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708663.212106:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789708663.212111:0:19460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789708663.212472:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789708663.212478:0:19464:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789708663.212495:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708663.212498:0:19464:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789708663.212503:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789708663.212515:0:19464:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bed042019c0) 00000020:00000080:3.0:1789708663.212535:0:19464:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789708663.212541:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789708663.212612:0:19464:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee30700000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789708663.212622:0:19464:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789708663.212629:0:19464:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45f43947e47e152 00010000:00010000:3.0:1789708663.215078:0:19464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789708663.215341:0:19464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789708663.216071:0:19464:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1789708663.216657:0:19464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789708663.216665:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708663.216669:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708663.216671:0:19464:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789708663.216672:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708663.216675:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708663.216676:0:19464:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789708663.216678:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789708663.216679:0:19464:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789708663.216684:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708663.216686:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708663.216687:0:19464:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789708663.216688:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708663.216690:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708663.216691:0:19464:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789708663.216693:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789708663.216705:0:19464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708663.216707:0:19464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708663.216708:0:19464:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789708663.216710:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789708663.216794:0:19460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789708663.216833:0:19460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789708663.216850:0:19460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708663.216862:0:19460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708663.216872:0:19460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee30700000 from 1 10000000:01000000:2.0:1789708663.216875:0:19460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708663.216906:0:19460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708663.216914:0:19460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708663.216936:0:19460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708663.216956:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789708663.217013:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708663.217051:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee304643c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708663.217074:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365542400 00000100:00100000:0.0:1789708663.217082:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365542400 00000100:00100000:0.0:1789708663.217132:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789708663.217142:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:19460:x1876645365542400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708663.217155:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708663.217169:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47e160 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e159 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.217192:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47e160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e159 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.217211:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47e160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e159 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.217219:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0e00, rc 0) 00000100:00100000:0.0:1789708663.217294:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:19460:x1876645365542400:12345-0@lo:101:mount.lustre.0 Request processed in 153us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708663.217295:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708663.217307:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00010000:2.0:1789708663.217312:0:19460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708663.217322:0:19460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708663.217914:0:19460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789708663.218062:0:19460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708663.218209:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789708663.218227:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789708663.218240:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789708663.218243:0:19460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789708663.218322:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708663.218350:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708663.218373:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee30464cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708663.218379:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365542528 00000100:00100000:3.0:1789708663.218383:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365542528 00000100:00100000:3.0:1789708663.218410:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789708663.218418:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:19460:x1876645365542528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708663.218502:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:19460:x1876645365542528:12345-0@lo:501:mount.lustre.0 Request processed in 84us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.218510:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789708663.218516:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708663.218547:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708663.218579:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708663.218597:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee30464cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708663.218608:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365542656 00000100:00100000:3.0:1789708663.218612:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365542656 00000100:00100000:3.0:1789708663.218633:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789708663.218639:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:19460:x1876645365542656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708663.218714:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:19460:x1876645365542656:12345-0@lo:503:mount.lustre.0 Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.218721:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789708663.218728:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542656:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789708663.218924:0:19460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708663.218959:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708663.218985:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708663.219001:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee304643c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708663.219014:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365542784 00000100:00100000:3.0:1789708663.219018:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365542784 00000100:00100000:3.0:1789708663.219039:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789708663.219046:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:19460:x1876645365542784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708663.219125:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:19460:x1876645365542784:12345-0@lo:502:mount.lustre.0 Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.219132:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789708663.219134:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789708663.219287:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789708663.219312:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789708663.219329:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789708663.219343:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789708663.219357:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789708663.219370:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789708663.219396:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789708663.219411:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789708663.219423:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789708663.219436:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789708663.219453:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789708663.219474:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708663.219523:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708663.219555:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee304643c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708663.219564:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365542912 00000100:00100000:3.0:1789708663.219568:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365542912 00000100:00100000:3.0:1789708663.219596:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789708663.219602:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:19460:x1876645365542912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708663.219672:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:19460:x1876645365542912:12345-0@lo:502:mount.lustre.0 Request processed in 70us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708663.219678:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365542912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708663.219679:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000040:00080000:2.0:1789708663.219713:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789708663.219720:0:19460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789708663.220029:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708663.220035:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708663.220036:0:19468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789708663.220041:0:19468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee30700000 00000020:00000080:2.0:1789708663.220043:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708663.220051:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708663.220054:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708663.220055:0:19468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789708663.220057:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708663.220059:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708663.220060:0:19468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789708663.220064:0:19468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee30700000 00000020:00000080:2.0:1789708663.220066:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708663.220112:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708663.220114:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708663.220115:0:19468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789708663.220117:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708663.220119:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708663.220119:0:19468:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708663.220122:0:19468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee30700000 00000020:00000080:2.0:1789708663.220123:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708663.220142:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708663.220144:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708663.220145:0:19468:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708663.220149:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708663.220151:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708663.220152:0:19468:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789708663.220154:0:19468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee30700000 00000020:00000080:2.0:1789708663.220155:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708663.220169:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708663.220171:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708663.220172:0:19468:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789708663.220174:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789708663.220225:0:19460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789708663.220249:0:19460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708663.220280:0:19460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.220291:0:19460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708663.220343:0:19460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789708663.220346:0:19460:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bee30700000 10000000:01000000:3.0:1789708663.220350:0:19460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bee30700000 10000000:01000000:3.0:1789708663.220354:0:19460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708663.220359:0:19460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee30700000 from 1 10000000:01000000:3.0:1789708663.220362:0:19460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789708663.220379:0:19460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.220385:0:19460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.220397:0:19460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708663.220406:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708663.220425:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.220447:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708663.220614:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365543040 00000100:00100000:2.0:1789708663.220618:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365543040 00000100:00100000:2.0:1789708663.220639:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789708663.220644:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:19460:x1876645365543040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708663.220650:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708663.220663:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb4000/0xf45f43947e47e16e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e167 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708663.220677:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb4000/0xf45f43947e47e16e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e167 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708663.220684:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb4000/0xf45f43947e47e16e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e167 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708663.220689:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4000, rc 0) 00000100:00100000:2.0:1789708663.220718:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543040:12345-0@lo:101:mount.lustre.0 Request processed in 73us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708663.220724:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789708663.220743:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708663.220754:0:19460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.220762:0:19460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708663.221453:0:19460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1789708663.221638:0:19460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708663.221756:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789708663.221773:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789708663.221785:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789708663.221794:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789708663.221813:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789708663.221822:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789708663.221830:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789708663.221839:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789708663.221848:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789708663.221855:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789708663.221862:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789708663.221871:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789708663.221879:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789708663.221887:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789708663.221903:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789708663.221920:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789708663.221940:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789708663.221958:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789708663.221976:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789708663.221995:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789708663.222026:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789708663.222042:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789708663.222055:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789708663.222070:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789708663.222083:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789708663.222099:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789708663.222115:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789708663.222128:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789708663.222142:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789708663.222157:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789708663.222170:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789708663.222188:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789708663.222204:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789708663.222216:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789708663.222230:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789708663.222248:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789708663.222295:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789708663.222312:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789708663.222328:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1789708663.222342:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1789708663.222355:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1789708663.222368:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1789708663.222382:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1789708663.222395:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1789708663.222411:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1789708663.222428:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1789708663.222454:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1789708663.222467:0:19460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1789708663.222553:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708663.222586:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.222617:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789708663.222628:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365543168 00000100:00100000:1.0:1789708663.222634:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365543168 00000100:00100000:1.0:1789708663.222665:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789708663.222672:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708663.222759:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543168:12345-0@lo:501:mount.lustre.0 Request processed in 88us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708663.222766:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789708663.222788:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708663.222822:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708663.222861:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.222874:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9300 going to sleep for 11 seconds 00000100:00100000:2.0:1789708663.223908:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365543296 00000100:00100000:2.0:1789708663.223914:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365543296 00000100:00100000:2.0:1789708663.223951:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789708663.223959:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed099ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708663.224055:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed099ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543296:12345-0@lo:503:mount.lustre.0 Request processed in 96us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708663.224062:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789708663.224081:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543296:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789708663.224528:0:19460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708663.224610:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708663.224653:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708663.224692:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f00840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708663.224697:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365543424 00000100:00100000:0.0:1789708663.224703:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365543424 00000100:00100000:0.0:1789708663.224742:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789708663.224750:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed099cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708663.224857:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed099cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543424:12345-0@lo:502:mount.lustre.0 Request processed in 108us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708663.224867:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789708663.224881:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708663.225085:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789708663.225116:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789708663.225135:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789708663.225171:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789708663.225198:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789708663.225224:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789708663.225251:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789708663.225309:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789708663.225335:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789708663.225361:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789708663.225381:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789708663.225404:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789708663.225429:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789708663.225453:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789708663.225476:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789708663.225510:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789708663.225528:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789708663.225545:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789708663.225560:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789708663.225588:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789708663.225611:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789708663.225634:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789708663.225656:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789708663.225683:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789708663.225708:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789708663.225729:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789708663.225745:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789708663.225763:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789708663.225782:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789708663.225803:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789708663.225824:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789708663.225845:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789708663.225866:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789708663.225885:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789708663.225902:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789708663.225932:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789708663.225956:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789708663.225976:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789708663.225995:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789708663.226015:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789708663.226047:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789708663.226069:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789708663.226090:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789708663.226110:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789708663.226128:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789708663.226147:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789708663.226168:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789708663.226188:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789708663.226223:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708663.226297:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708663.226323:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee053c0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708663.226332:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365543552 00000100:00100000:0.0:1789708663.226338:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365543552 00000100:00100000:0.0:1789708663.226370:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789708663.226377:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed099cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708663.226492:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed099cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543552:12345-0@lo:502:mount.lustre.0 Request processed in 105us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708663.226501:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789708663.226506:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708663.226653:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789708663.226677:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789708663.226697:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708663.226738:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708663.226758:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f00840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708663.226775:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365543680 00000100:00100000:0.0:1789708663.226780:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365543680 00000100:00100000:0.0:1789708663.226807:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789708663.226815:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708663.226898:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365543680:12345-0@lo:502:mount.lustre.0 Request processed in 83us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708663.226912:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789708663.226914:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365543680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708663.226967:0:19460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789708663.226975:0:19460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789708663.227412:0:19472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789708663.227425:0:19472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bee2f48b380) 00000020:00000080:1.0:1789708663.227450:0:19472:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789708663.227537:0:19472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee30700000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789708663.227541:0:19472:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee30700000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789708663.227543:0:19472:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee30700000 3 00010000:00080000:1.0:1789708663.227573:0:19472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed0146d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789708663.229249:0:19472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789708663.229451:0:19472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789708663.229501:0:19472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789708663.229514:0:19472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf45f43947e47e17c 00000100:00080000:1.0:1789708663.229521:0:19472:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708663.229529:0:19472:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bed0146d000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708663.229554:0:19472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f0a80 x1876645365543808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708663.229576:0:19472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789708663.229594:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365543808:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789708663.229633:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1789708663.229826:0:19472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789708663.229849:0:19472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9bed015c99c0) 00000020:00000080:0.0:1789708663.229869:0:19472:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789708663.229967:0:19472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee30700000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789708663.229971:0:19472:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee30700000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789708663.229973:0:19472:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee30700000 3 00010000:00080000:0.0:1789708663.230001:0:19472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed04161000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.152@tcp at head 00000100:00100000:3.0:1789708663.231306:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365543808 00000100:00100000:3.0:1789708663.231313:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365543808 00000100:00100000:3.0:1789708663.231348:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708663.231355:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365543808:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789708663.231377:0:17138:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1789708663.231404:0:17138:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf45f43947e47e18a 00000004:00100000:3.0:1789708663.231416:0:17138:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789708663.231438:0:17138:0:(import.c:65:import_set_state_nolock()) ffff9bed04222800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708663.231505:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876645365543808:12345-0@lo:38:llog_process_th.0 Request processed in 149us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.231513:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789708663.231526:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a2f0a80 x1876645365543808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708663.231538:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708663.231545:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789708663.231553:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789708663.231559:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789708663.231560:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708663.231562:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0146d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789708663.231566:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789708663.231569:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bee18455800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789708663.231572:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365543808:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789708663.231573:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 230 00000100:00080000:3.0:1789708663.231578:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789708663.231585:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bee18455800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708663.231601:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a3a4700 x1876645365544192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789708663.231611:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365543936:0@lo:400:kworker.0 00000100:00100000:0.0:1789708663.231655:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365544192:0@lo:8:kworker.0 00000100:00080000:3.0:1789708663.231657:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789708663.231662:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789708663.231666:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708663.231669:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708663.231671:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789708663.231701:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365544576:0@lo:400:kworker.0 00000100:00100000:0.0:1789708663.231704:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708663.231737:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708663.231745:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365544192 00000100:00100000:0.0:1789708663.231751:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365544192 00000100:00100000:2.0:1789708663.231764:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789708663.231766:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365544576 00000100:00100000:3.0:1789708663.231772:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365544576 00000100:00100000:2.0:1789708663.231773:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365544064:0@lo:400:kworker.0 00000100:00100000:0.0:1789708663.231780:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708663.231787:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876645365544192:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789708663.231804:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.231812:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708663.231819:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365544576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708663.231829:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365544704:0@lo:400:kworker.0 00000100:00100000:0.0:1789708663.231843:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876645365544192:12345-0@lo:8:kworker.0 Request processed in 53us (140us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789708663.231856:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365544576:12345-0@lo:400:kworker.0 Request processed in 37us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708663.231861:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708663.231866:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708663.231870:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708663.231879:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365544064 00000100:00100000:0.0:1789708663.231884:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365544064 00000100:00100000:3.0:1789708663.231889:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365544704 00000100:00100000:3.0:1789708663.231893:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365544704 00010000:00080000:2.0:1789708663.231906:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a3a5f80 x1876645365544576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708663.231918:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365544576:0@lo:400:kworker.0 00000100:00100000:3.0:1789708663.231928:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708663.231937:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365544704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708663.231942:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708663.231952:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365544320:0@lo:400:kworker.0 00000100:00100000:0.0:1789708663.231954:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365544064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708663.231971:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365544704:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.231976:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708663.231990:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.232006:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365544320 00000100:00100000:0.0:1789708663.232007:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365544064:12345-0@lo:400:kworker.0 Request processed in 57us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.232011:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365544320 00000100:00100000:2.0:1789708663.232016:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365544832:0@lo:400:kworker.0 00000100:00100000:0.0:1789708663.232020:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708663.232037:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708663.232047:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.232048:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365544320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708663.232060:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708663.232066:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee18455800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1789708663.232068:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1789708663.232072:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789708663.232079:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365544448:0@lo:400:kworker.0 00000100:00100000:0.0:1789708663.232080:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365544192:0@lo:8:kworker.0 00000100:00100000:3.0:1789708663.232081:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365544320:12345-0@lo:400:kworker.0 Request processed in 37us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.232093:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708663.232110:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365544832 00000100:00100000:3.0:1789708663.232113:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365544832 00000100:00100000:2.0:1789708663.232117:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708663.232129:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708663.232134:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365544832:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789708663.232151:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a3a4e00 x1876645365544320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708663.232160:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365544832:12345-0@lo:400:kworker.0 Request processed in 26us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708663.232164:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365544320:0@lo:400:kworker.0 00000100:00100000:3.0:1789708663.232168:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789708663.232186:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a955500 x1876645365544832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708663.232196:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365544832:0@lo:400:kworker.0 00000100:00100000:2.0:1789708663.232226:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365543936 00000100:00100000:2.0:1789708663.232231:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365543936 00000100:00100000:2.0:1789708663.232280:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365544448 00000100:00100000:2.0:1789708663.232284:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365544448 00000100:00100000:3.0:1789708663.232296:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708663.232305:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365543936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708663.232311:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789708663.232321:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365544448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708663.232348:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365543936:12345-0@lo:400:kworker.0 Request processed in 44us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.232356:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708663.232372:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365544448:12345-0@lo:400:kworker.0 Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708663.232385:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789708663.232412:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708663.232416:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708663.232419:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789708663.232454:0:19472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:2.0:1789708663.232455:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365544448:0@lo:400:kworker.0 00000100:00100000:2.0:1789708663.232492:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365544064:0@lo:400:kworker.0 00010000:00080000:2.0:1789708663.232505:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a956d80 x1876645365544704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708663.232514:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365544704:0@lo:400:kworker.0 00000100:00100000:2.0:1789708663.232526:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365543936:0@lo:400:kworker.0 00000020:00000080:0.0:1789708663.232687:0:19472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789708663.232726:0:19472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789708663.232735:0:19472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf45f43947e47e191 00000100:00080000:0.0:1789708663.232740:0:19472:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708663.232745:0:19472:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9bed04161000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708663.232763:0:19472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cd180 x1876645365544960/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708663.232792:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876645365544960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789708663.232827:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708663.232857:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365544960 00000100:00100000:1.0:1789708663.232862:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365544960 00000100:00100000:1.0:1789708663.232888:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708663.232893:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876645365544960:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789708663.232908:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:1.0:1789708663.232940:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf45f43947e47e198 00000004:00100000:1.0:1789708663.232948:0:17140:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789708663.232965:0:17140:0:(import.c:65:import_set_state_nolock()) ffff9bed0146f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708663.233006:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876645365544960:12345-0@lo:38:llog_process_th.0 Request processed in 111us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708663.233013:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789708663.233021:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed0a2cd180 x1876645365544960/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708663.233030:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708663.233040:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789708663.233045:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789708663.233048:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789708663.233050:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed04161000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789708663.233055:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876645365544960:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789708663.233339:0:19472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1789708663.233544:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789708663.233616:0:19460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789708663.233664:0:19460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708663.233686:0:19460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.233698:0:19460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789708663.233750:0:19460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789708663.233753:0:19460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789708663.233754:0:19460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708663.233756:0:19460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708663.233758:0:19460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00080000:3.0:1789708663.233759:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000004:0.0:1789708663.233760:0:19460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708663.233763:0:19460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00080000:3.0:1789708663.233767:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1789708663.233767:0:19460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708663.233771:0:19460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:3.0:1789708663.233772:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 10000000:01000000:0.0:1789708663.233776:0:19460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000100:00080000:3.0:1789708663.233778:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1789708663.233780:0:19460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789708663.233784:0:19460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789708663.233785:0:19460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708663.233787:0:19460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708663.233788:0:19460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708663.233790:0:19460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708663.233791:0:19460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708663.233793:0:19460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708663.233794:0:19460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789708663.233815:0:19460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789708663.233826:0:19460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365545088:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789708663.233869:0:19460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708663.233899:0:19460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acf180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708663.233911:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365545088 00000100:00100000:1.0:1789708663.233917:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365545088 00000100:00100000:1.0:1789708663.233948:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789708663.233956:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365545088:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789708663.233976:0:17133:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789708663.233990:0:17133:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789708663.234759:0:17133:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789708663.234772:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789708663.234778:0:17154:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789708663.234782:0:17154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789708663.234797:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.234807:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e11a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e113 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.234813:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e128 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e121 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.234828:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.234853:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47e121 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.234865:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e128 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47e121 expref: 24 pid: 17133 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708663.234875:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365545216:0@lo:104: 00000100:00100000:3.0:1789708663.234906:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708663.234939:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47e113 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.234946:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e11a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47e113 expref: 24 pid: 17133 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708663.234952:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365545216 00000100:00100000:1.0:1789708663.234953:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:19460:x1876645365545088:12345-0@lo:253:mount.lustre.0 Request processed in 996us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.234954:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a956a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365545344:0@lo:104: 00000100:00100000:0.0:1789708663.234959:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365545216 00000100:00100000:1.0:1789708663.234969:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789708663.234981:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708663.234996:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365545344 00000100:00100000:0.0:1789708663.235000:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365545344 00000100:00100000:3.0:1789708663.235002:0:17154:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708663.235018:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708663.235026:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a956680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:17154:x1876645365545216:12345-0@lo:104: 00000100:00100000:0.0:1789708663.235031:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789708663.235035:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708663.235044:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:17154:x1876645365545344:12345-0@lo:104: 00010000:00010000:0.0:1789708663.235054:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235071:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789708663.235076:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a956680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:17154:x1876645365545216:12345-0@lo:104: Request processed in 53us (171us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708663.235083:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789708663.235092:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789708663.235093:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708663.235103:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5a00 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:0.0:1789708663.235104:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1789708663.235109:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708663.235114:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+3:17154:x1876645365545344:12345-0@lo:104: Request processed in 73us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.235120:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365545216:0@lo:104: 00010000:00010000:1.0:1789708663.235126:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708663.235131:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708663.235132:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a956a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876645365545344:0@lo:104: 10000000:00010000:1.0:1789708663.235144:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708663.235151:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708663.235152:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.235161:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708663.235167:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.235175:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493800 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708663.235178:0:18292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708663.235183:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.235186:0:18292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708663.235199:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789708663.235202:0:18292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708663.235210:0:18292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708663.235224:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708663.235226:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365545472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708663.235238:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5a00/0xf45f43947e47e121 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e128 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.235239:0:18292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.235254:0:18292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708663.235320:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708663.235328:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708663.235331:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708663.235334:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708663.235368:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365545472 00000100:00100000:1.0:1789708663.235374:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365545472 00010000:00010000:1.0:1789708663.235398:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e128 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47e121 expref: 24 pid: 17133 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708663.235428:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708663.235436:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3618:x1876645365545472:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708663.235441:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365545600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708663.235443:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708663.235446:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708663.235454:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e128 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47e121 expref: 24 pid: 17133 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.235457:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee30493800/0xf45f43947e47e113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e11a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708663.235470:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708663.235471:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47e121 expref: 24 pid: 17133 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.235496:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708663.235498:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e128 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47e121 expref: 24 pid: 17133 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708663.235502:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708663.235504:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365545600 00010000:00010000:0.0:1789708663.235508:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708663.235509:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365545600 00010000:00010000:1.0:1789708663.235512:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708663.235523:0:17891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e11a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47e113 expref: 24 pid: 17133 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708663.235537:0:19460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fda82b2e-0d6b-4cb4-a087-54f6744e5277:19460:1876645365545088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789708663.235545:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 10000000:01000000:0.0:1789708663.235550:0:19460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000100:00100000:1.0:1789708663.235552:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3618:x1876645365545472:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.235554:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3615:x1876645365545600:12345-0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1789708663.235555:0:19460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708663.235559:0:19460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789708663.235564:0:19460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708663.235566:0:19460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:3.0:1789708663.235567:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789708663.235570:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:01000004:0.0:1789708663.235571:0:19460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:3.0:1789708663.235574:0:17891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e11a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47e113 expref: 24 pid: 17133 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789708663.235575:0:19460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708663.235579:0:19460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708663.235582:0:19460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:3.0:1789708663.235584:0:17891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47e113 expref: 23 pid: 17133 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789708663.235585:0:19460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1789708663.235595:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e11a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47e113 expref: 23 pid: 17133 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235603:0:17891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1789708663.235609:0:19460:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789708663.235619:0:17891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789708663.235629:0:17891:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001222048s 00010000:00010000:3.0:1789708663.235632:0:17891:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235636:0:17891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235640:0:17891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235644:0:17891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235647:0:17891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708663.235649:0:17891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235654:0:17891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235662:0:17891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235668:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708663.235697:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:3615:x1876645365545600:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708663.235704:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708663.235711:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365545600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789708663.235743:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365545472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708663.235757:0:17154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235761:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708663.235766:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee30493200/0xf45f43947e47e19f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1789708663.236666:0:19460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789708663.238140:0:19460:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789708663.238146:0:19460:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789708663.238181:0:19460:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789708663.238214:0:19460:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789708663.238233:0:19460:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789708663.238247:0:19460:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789708663.241155:0:19460:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708663.241612:0:19460:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708663.334388:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789708663.570462:0:19526:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708663.570671:0:19526:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789708663.655409:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708663.655417:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708663.655433:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365545856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708663.655435:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365545728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789708663.655528:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708663.655573:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365545856 00000100:00100000:0.0:1789708663.655585:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365545856 00000100:00100000:1.0:1789708663.655594:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708663.655644:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365545728 00000100:00100000:2.0:1789708663.655651:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365545728 00000100:00100000:0.0:1789708663.655665:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708663.655676:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365545856:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708663.655693:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789708663.655708:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365545728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789708663.655729:0:18670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446289408 avail 1300049920 00000004:00000024:1.0:1789708663.655747:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789708663.655810:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365545856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708663.655822:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876645365545728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708663.655827:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789708663.655834:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365545856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708663.655842:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708663.655896:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365545728:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1789708664.169094:0:17871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789708664.296331:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708653/real 1789708653] req@ffff9bed09b80380 x1876645365530240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708663 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708664.296360:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bed09b80380 x1876645365530240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708663 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708664.296371:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708653/real 1789708653] req@ffff9bed0a2f1500 x1876645365530112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708663 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708664.296382:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bed0a2f1500 x1876645365530112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708663 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708664.296401:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0a0a4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708664.296429:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789708664.296433:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365530240:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789708664.296439:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708664.296443:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789708664.296446:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365530112:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789708664.296616:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365545984:0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.296636:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365546112:0@lo:400:kworker.0 00000100:00080000:3.0:1789708664.296712:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708664.296717:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789708664.296721:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bee18455800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789708664.296743:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365546240:0@lo:400:kworker.0 00000100:00100000:2.0:1789708664.297222:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708664.297252:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708664.297304:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708664.297324:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365545984 00000100:00100000:2.0:1789708664.297333:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365545984 00000100:00100000:0.0:1789708664.297377:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365546112 00000100:00100000:1.0:1789708664.297382:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365546240 00000100:00100000:0.0:1789708664.297384:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365546112 00000100:00100000:1.0:1789708664.297392:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365546240 00000100:00100000:2.0:1789708664.297393:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789708664.297408:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:3618:x1876645365545984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.297448:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789708664.297475:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365546112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708664.297487:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:3618:x1876645365545984:12345-0@lo:400:kworker.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.297488:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708664.297505:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789708664.297513:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365546240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.297533:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365546112:12345-0@lo:400:kworker.0 Request processed in 73us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708664.297542:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708664.297570:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365545984:0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.297604:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365546112:0@lo:400:kworker.0 00000100:00100000:1.0:1789708664.297610:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365546240:12345-0@lo:400:kworker.0 Request processed in 105us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.297621:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708664.297659:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365546240:0@lo:400:kworker.0 00000100:00080000:3.0:1789708664.297810:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bee18455800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708664.297833:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a954700 x1876645365546368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708664.297882:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708664.297886:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789708664.297889:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789708664.297892:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365546368:0@lo:8:kworker.0 00000100:00080000:3.0:1789708664.297897:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 224 00000100:00100000:2.0:1789708664.297904:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365546496:0@lo:400:kworker.0 00000100:00080000:3.0:1789708664.297905:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789708664.297914:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bee02bf6000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708664.297932:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a955880 x1876645365546752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708664.297943:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1789708664.297951:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789708664.297958:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789708664.297963:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bed0a0a4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1789708664.297963:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789708664.297972:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 224 00000100:00080000:3.0:1789708664.297976:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1789708664.297997:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365546752:0@lo:8:kworker.0 00000100:00100000:2.0:1789708664.298089:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789708664.298100:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365546624:0@lo:400:kworker.0 00000100:00100000:1.0:1789708664.298102:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708664.298152:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708664.298170:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365546368 00000100:00100000:0.0:1789708664.298178:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365546368 00000100:00100000:1.0:1789708664.298200:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365546624 00000100:00100000:1.0:1789708664.298209:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365546624 00000100:00100000:0.0:1789708664.298209:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365546752 00000100:00100000:2.0:1789708664.298217:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708664.298217:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365546752 00000100:00100000:2.0:1789708664.298228:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876645365546368:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789708664.298250:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708664.298295:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3614:x1876645365546752:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789708664.298316:0:18645:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:0.0:1789708664.298347:0:18645:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47e1a6 00000100:00100000:1.0:1789708664.298351:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00002000:00100000:0.0:1789708664.298362:0:18645:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9bee04468000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00000100:00100000:1.0:1789708664.298370:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365546624:12345-0@lo:400:kworker.0 00002000:00080000:0.0:1789708664.298373:0:18645:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1789708664.298379:0:18645:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789708664.298449:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365546624:12345-0@lo:400:kworker.0 Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.298473:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00002000:00080000:0.0:1789708664.298478:0:18645:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789708664.298512:0:18645:0:(import.c:65:import_set_state_nolock()) ffff9bee0446c000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1789708664.298521:0:18838:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:2.0:1789708664.298546:0:18838:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47e1ad 00002000:00100000:2.0:1789708664.298556:0:18838:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bed01d44800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789708664.298560:0:18838:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789708664.298563:0:18838:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789708664.298573:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365546624:0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.298582:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3614:x1876645365546752:12345-0@lo:8:kworker.0 Request processed in 320us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708664.298594:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708664.298636:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708664.298646:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789708664.298655:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789708664.298664:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789708664.298668:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789708664.298694:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789708664.298704:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365546752:0@lo:8:kworker.0 00002000:00080000:2.0:1789708664.298756:0:18838:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000004:00080000:1.0:1789708664.298759:0:17879:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:2.0:1789708664.298781:0:18838:0:(import.c:65:import_set_state_nolock()) ffff9bed01d43800 : changing import state from RECOVER to FULL 00000004:00080000:0.0:1789708664.298785:0:17880:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789708664.298815:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1876645365547008:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789708664.298842:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3614:x1876645365546368:12345-0@lo:8:kworker.0 Request processed in 612us (889us total) trans 0 rc 0/0 00000100:00080000:3.0:1789708664.298857:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bed0a0a4800 using connection 192.168.201.152@tcp/0@lo 00000004:00080000:1.0:1789708664.298864:0:17879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 235108602157ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789708664.298874:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00080000:00080000:1.0:1789708664.298879:0:17879:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789708664.298883:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708664.298885:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a957b80 x1876645365547136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789708664.298916:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365546496 00000100:00100000:2.0:1789708664.298923:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365546496 00000100:00100000:0.0:1789708664.298953:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee202a2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708664.298974:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789708664.298986:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365546496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.298989:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365546880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708664.299012:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365547520:0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.299045:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708664.299053:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365546496:12345-0@lo:400:kworker.0 Request processed in 68us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708664.299066:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708664.299067:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708664.299084:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365547648:0@lo:400:kworker.0 00000100:00100000:2.0:1789708664.299091:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365547520 00000100:00100000:2.0:1789708664.299096:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365547520 00000100:00100000:3.0:1789708664.299104:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708664.299115:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365547392:0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.299141:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708664.299142:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708664.299159:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365547520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.299172:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789708664.299184:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365547264:0@lo:400:kworker.0 00000100:00100000:2.0:1789708664.299209:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365547520:12345-0@lo:400:kworker.0 Request processed in 51us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708664.299217:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708664.299232:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365547648 00000100:00100000:2.0:1789708664.299236:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365547648 00000100:00100000:0.0:1789708664.299245:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708664.299301:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365547264 00000100:00100000:3.0:1789708664.299308:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365547264 00000100:00100000:2.0:1789708664.299311:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708664.299321:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365547648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.299328:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365547776:0@lo:400:kworker.0 00000100:00100000:3.0:1789708664.299340:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708664.299352:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365547264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.299381:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708664.299387:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365547648:12345-0@lo:400:kworker.0 Request processed in 63us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708664.299396:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708664.299420:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365547776 00000100:00100000:2.0:1789708664.299425:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365547776 00000100:00100000:3.0:1789708664.299430:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365547264:12345-0@lo:400:kworker.0 Request processed in 79us (192us total) trans 0 rc 0/0 00010000:00080000:0.0:1789708664.299433:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a957800 x1876645365547648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708664.299449:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708664.299473:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789708664.299473:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365547648:0@lo:400:kworker.0 00000100:00100000:2.0:1789708664.299487:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365547776:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789708664.299505:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708664.299513:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789708664.299516:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a956300 x1876645365547264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708664.299529:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365547264:0@lo:400:kworker.0 00000100:00100000:2.0:1789708664.299543:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365547776:12345-0@lo:400:kworker.0 Request processed in 57us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708664.299551:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708664.299552:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365547008 00000100:00100000:3.0:1789708664.299557:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365547008 00010000:00080000:0.0:1789708664.299558:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a955c00 x1876645365547776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708664.299572:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365547776:0@lo:400:kworker.0 00010000:00080000:2.0:1789708664.299614:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a954a80 x1876645365546496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708664.299615:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708664.299628:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17880:x1876645365547008:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789708664.299631:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365546496:0@lo:400:kworker.0 00000100:00100000:0.0:1789708664.299633:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365546880 00000100:00100000:0.0:1789708664.299647:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365546880 00000100:00100000:2.0:1789708664.299684:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365547136:0@lo:8:kworker.0 00000100:00100000:0.0:1789708664.299713:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708664.299733:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3615:x1876645365546880:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708664.299734:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789708664.299775:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00010000:00080000:2.0:1789708664.299799:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a954700 x1876645365546368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789708664.299813:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789708664.299822:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789708664.299829:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789708664.299833:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee18455800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789708664.299849:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3615:x1876645365546880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (804us total) trans 0 rc 0/0 00000004:00080000:2.0:1789708664.299854:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789708664.299863:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708664.299869:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365546368:0@lo:8:kworker.0 00000100:00100000:0.0:1789708664.299917:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365547136 00000100:00080000:2.0:1789708664.299919:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708664.299926:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365547136 00000100:00100000:2.0:1789708664.299944:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365547904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789708664.299965:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000040:00080000:3.0:1789708664.299980:0:17164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 6 count 3 00000100:00100000:0.0:1789708664.299980:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876645365547136:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789708664.300001:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708664.300021:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00080000:0.0:1789708664.300025:0:18646:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000040:00080000:3.0:1789708664.300030:0:17164:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000100:00100000:2.0:1789708664.300032:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365548032:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1789708664.300042:0:17164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1789708664.300070:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789708664.300070:0:18646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47e1b4 00002000:00100000:0.0:1789708664.300093:0:18646:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9bee0446b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789708664.300098:0:18646:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789708664.300103:0:18646:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000004:00080000:3.0:1789708664.300131:0:17164:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00002000:00080000:0.0:1789708664.300187:0:18646:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000004:00080000:3.0:1789708664.300208:0:17164:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 235109946602ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789708664.300220:0:17164:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:0.0:1789708664.300226:0:18646:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708664.300327:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3614:x1876645365547136:12345-0@lo:8:kworker.0 Request processed in 352us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708664.300337:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708664.300357:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365547904 00000100:00100000:0.0:1789708664.300362:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365547904 00000100:00100000:3.0:1789708664.300400:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365548032 00000100:00100000:3.0:1789708664.300408:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365548032 00000100:00100000:0.0:1789708664.300415:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708664.300429:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3617:x1876645365547904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789708664.300451:0:18646:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00000100:00100000:2.0:1789708664.300487:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708664.300511:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365546880:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1789708664.300521:0:17165:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00010000:00080000:2.0:1789708664.300531:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a954000 x1876645365547520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708664.300536:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365548160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708664.300549:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17165:1876645365548288:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789708664.300591:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708664.300607:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365547520:0@lo:400:kworker.0 00000100:00100000:1.0:1789708664.300628:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708664.300647:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9180 going to sleep for 11 seconds 00000100:00080000:0.0:1789708664.300677:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708664.300684:0:18645:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789708664.300696:0:18645:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789708664.300702:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365548160 00000100:00100000:0.0:1789708664.300709:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365548160 00000100:00100000:3.0:1789708664.300747:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365547392 00000100:00100000:3.0:1789708664.300755:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365547392 00000100:00100000:0.0:1789708664.300829:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708664.300844:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3615:x1876645365548160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789708664.300876:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:3.0:1789708664.300883:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789708664.300893:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365548288 00000100:00100000:3.0:1789708664.300898:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365547392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708664.300898:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365548288 00000100:00100000:0.0:1789708664.300960:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3615:x1876645365548160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708664.300976:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708664.300982:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365547392:12345-0@lo:400:kworker.0 Request processed in 79us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708664.300996:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789708664.301018:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2f3800 x1876645365548160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708664.301048:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365548160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708664.301057:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708664.301079:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3617:x1876645365548032:12345-0@lo:6:osp-syn-1-0.0 00010000:00080000:2.0:1789708664.301096:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a955180 x1876645365547392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1789708664.301098:0:18838:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00000100:00100000:2.0:1789708664.301115:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365547392:0@lo:400:kworker.0 00010000:00080000:1.0:1789708664.301135:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a957b80 x1876645365547136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708664.301145:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708664.301175:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789708664.301182:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789708664.301189:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789708664.301192:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0a0a4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789708664.301208:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789708664.301218:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365547136:0@lo:8:kworker.0 00000004:00080000:2.0:1789708664.301300:0:17882:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789708664.301323:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1876645365548544:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789708664.301325:0:17881:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789708664.301370:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789708664.301380:0:17881:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 235111119478ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789708664.301386:0:17881:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789708664.301398:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee30464e40 going to sleep for 11 seconds 00000004:00080000:1.0:1789708664.301411:0:17871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789708664.301424:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365548416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708664.301474:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708664.301524:0:18645:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:2.0:1789708664.301534:0:18645:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:1.0:1789708664.301561:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365548416 00000100:00100000:1.0:1789708664.301567:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365548416 00000100:00100000:1.0:1789708664.301635:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708664.301644:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876645365548416:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708664.301647:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365548544 00000100:00100000:2.0:1789708664.301653:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365548544 00002000:00000024:1.0:1789708664.301662:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:1.0:1789708664.301711:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3616:x1876645365548416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.301718:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789708664.301753:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a3a6d80 x1876645365548416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708664.301763:0:19635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708664.301768:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365548416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708664.301776:0:19635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:17165:x1876645365548288:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1789708664.301856:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789708664.301870:0:17119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789708664.301969:0:18644:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789708664.301975:0:18644:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789708664.302024:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17880:x1876645365547008:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2397us (3159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708664.302035:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708664.302067:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708664.302075:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1876645365547008:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789708664.302080:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17882:x1876645365548544:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789708664.302095:0:17880:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789708664.302168:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1876645365548672:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789708664.302231:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708664.302252:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708664.302307:0:18645:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:1.0:1789708664.302314:0:18645:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_006' 00000004:00080000:1.0:1789708664.302340:0:17871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789708664.302486:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3617:x1876645365547904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2061us (2498us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708664.302495:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:0.0:1789708664.302509:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bed0a957100, transno 0 00000004:00080000:0.0:1789708664.302519:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bed0a957100/1, rc -2, transno 0 00000100:00100000:3.0:1789708664.302523:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365548672 00000100:00100000:3.0:1789708664.302530:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365548672 00000100:00100000:0.0:1789708664.302545:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365547904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789708664.302576:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708664.302586:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17880:x1876645365548672:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789708664.302606:0:18646:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789708664.302657:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17880:x1876645365548672:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708664.302667:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708664.302716:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1876645365548672:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789708664.302729:0:17880:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789708664.302763:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1876645365548800:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789708664.302790:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708664.302814:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789708664.302816:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365548800 00000100:00100000:2.0:1789708664.302821:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365548800 00002000:00080000:3.0:1789708664.302829:0:19635:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789708664.302837:0:19635:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789708664.302842:0:19635:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:2.0:1789708664.302862:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708664.302876:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:17880:x1876645365548800:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789708664.302912:0:19636:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00002000:00080000:0.0:1789708664.305159:0:18644:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789708664.305166:0:18644:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789708664.305234:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17882:x1876645365548544:12345-0@lo:7:osp-pre-1-1.0 Request processed in 3156us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708664.305244:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789708664.305284:0:17882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a3a7800 x1876645365548544/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789708680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708664.305312:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1876645365548544:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789708664.305325:0:17882:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789708664.305341:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1876645365548032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4274us (5271us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708664.305349:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:2.0:1789708664.305352:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bed0a957480, transno 0 00000004:00080000:2.0:1789708664.305358:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bed0a957480/1, rc -2, transno 0 00000100:00100000:1.0:1789708664.305359:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1876645365548928:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789708664.305374:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365548032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789708664.305393:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708664.305419:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9300 going to sleep for 11 seconds 00000100:00100000:2.0:1789708664.305420:0:19634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365548928 00000100:00100000:2.0:1789708664.305426:0:19634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365548928 00000100:00100000:2.0:1789708664.305474:0:19634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708664.305483:0:19634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17882:x1876645365548928:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789708664.305500:0:19634:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000040:00080000:0.0:1789708664.305506:0:17164:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000040:00080000:0.0:1789708664.305528:0:17164:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1789708664.305536:0:19634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17882:x1876645365548928:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708664.305542:0:19634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789708664.305549:0:17882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2f3b80 x1876645365548928/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708664.305559:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1876645365548928:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789708664.305567:0:17882:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789708664.305589:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1876645365549056:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789708664.305614:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708664.305636:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9300 going to sleep for 11 seconds 00000100:00100000:2.0:1789708664.305640:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365549056 00000100:00100000:2.0:1789708664.305651:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365549056 00000100:00100000:2.0:1789708664.305676:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789708664.305683:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17882:x1876645365549056:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789708664.305716:0:18645:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1789708664.310919:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.310930:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e1bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.310946:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.310950:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.310956:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e1bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.310972:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e1bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.310994:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e1bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.311002:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e1bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.311030:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708664.311177:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708664.311185:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e1bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.311193:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708664.311198:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e1bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.311212:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e1bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.311231:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e1bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.311245:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e1bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.311304:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708664.311307:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708664.311309:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708664.311609:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708664.311616:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6549a28/0xf45f43947e47e1c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.311624:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=235s v=(0 0) 00010000:00010000:1.0:1789708664.311627:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708664.311656:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6549a28/0xf45f43947e47e1c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.311666:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6549a28/0xf45f43947e47e1c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.311674:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6549a28/0xf45f43947e47e1c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.311683:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6549a28/0xf45f43947e47e1c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.311705:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708664.311711:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.311720:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6549a28/0xf45f43947e47e1c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.311731:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708664.311735:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6549a28/0xf45f43947e47e1c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.311753:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6549a28/0xf45f43947e47e1c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.311768:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6549a28/0xf45f43947e47e1c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.311775:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6549a28/0xf45f43947e47e1c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.311794:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.311797:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.311799:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708664.311927:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708664.311934:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47e1c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.311943:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=235s v=(0 0) 00010000:00010000:0.0:1789708664.311947:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708664.311952:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47e1c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.311961:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47e1c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.311970:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47e1c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.311984:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47e1c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312002:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708664.312013:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.312019:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47e1c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312027:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708664.312031:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47e1c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312039:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47e1c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312051:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47e1c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312058:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47e1c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312078:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.312081:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.312083:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708664.312354:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708664.312369:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47e1d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312378:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=235s v=(0 0) 00010000:00010000:0.0:1789708664.312382:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708664.312386:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47e1d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312397:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47e1d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312406:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47e1d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312414:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47e1d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312432:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.312459:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.312478:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47e1d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.312486:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.312489:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47e1d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.312500:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47e1d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.312522:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47e1d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.312530:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bfdb1b8/0xf45f43947e47e1d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.312550:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.312553:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.312557:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708664.312793:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708664.312801:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec84eb/0xf45f43947e47e1d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312809:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=235s v=(0 0) 00010000:00010000:0.0:1789708664.312812:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708664.312817:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec84eb/0xf45f43947e47e1d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312826:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec84eb/0xf45f43947e47e1d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312842:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec84eb/0xf45f43947e47e1d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312850:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec84eb/0xf45f43947e47e1d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.312870:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.312879:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.312886:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec84eb/0xf45f43947e47e1d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.312895:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.312898:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec84eb/0xf45f43947e47e1d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.312908:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec84eb/0xf45f43947e47e1d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.312932:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec84eb/0xf45f43947e47e1d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.312940:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec84eb/0xf45f43947e47e1d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.312971:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.312974:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.312976:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708664.313089:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708664.313094:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5fa71e5/0xf45f43947e47e1de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.313100:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=235s v=(0 0) 00010000:00010000:0.0:1789708664.313102:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708664.313105:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5fa71e5/0xf45f43947e47e1de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.313111:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5fa71e5/0xf45f43947e47e1de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.313117:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5fa71e5/0xf45f43947e47e1de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.313122:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5fa71e5/0xf45f43947e47e1de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.313141:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708664.313147:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.313150:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5fa71e5/0xf45f43947e47e1de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.313155:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708664.313158:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5fa71e5/0xf45f43947e47e1de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.313163:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5fa71e5/0xf45f43947e47e1de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.313171:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5fa71e5/0xf45f43947e47e1de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.313177:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5fa71e5/0xf45f43947e47e1de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.313190:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.313192:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.313194:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.314490:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.314499:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e1e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.314510:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.314514:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.314519:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e1e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.314531:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e1e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.314542:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e1e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.314551:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e1e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.314583:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708664.314606:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708664.314618:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e1e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.314627:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708664.314631:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e1e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.314640:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e1e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.314653:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e1e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.314661:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e1e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.314680:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708664.314682:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708664.314684:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.314926:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.314932:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e1ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.314941:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.314944:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.314948:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e1ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.314957:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e1ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.314964:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e1ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.314971:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e1ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.314989:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708664.315015:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.315023:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e1ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.315033:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708664.315043:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e1ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.315075:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e1ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.315089:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e1ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.315097:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e1ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.315118:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.315120:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.315123:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789708664.315152:0:18640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789708664.315162:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789708664.315350:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:17880:x1876645365548800:12345-0@lo:5:osp-pre-0-1.0 Request processed in 12476us (12555us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789708664.315360:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708664.315372:0:17880:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789708664.315382:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1876645365548800:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789708664.315400:0:17880:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789708664.315453:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17880:1876645365549184:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789708664.315530:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708664.315555:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee202a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708664.315607:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365549184 00000100:00100000:3.0:1789708664.315614:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365549184 00002000:00010000:1.0:1789708664.315634:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708664.315642:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006720f88e/0xf45f43947e47e1f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.315653:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=235s v=(0 0) 00000100:00100000:3.0:1789708664.315657:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789708664.315659:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1789708664.315670:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17880:x1876645365549184:12345-0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1789708664.315673:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006720f88e/0xf45f43947e47e1f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.315686:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006720f88e/0xf45f43947e47e1f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.315696:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006720f88e/0xf45f43947e47e1f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.315704:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006720f88e/0xf45f43947e47e1f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.315721:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789708664.315723:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17880:x1876645365549184:12345-0@lo:900:osp-pre-0-1.0 Request processed in 56us (193us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708664.315728:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.315737:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006720f88e/0xf45f43947e47e1f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.315750:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949400 already unused, calling callback (ffffffffc0d676c0) 00000100:00100000:3.0:1789708664.315753:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789708664.315759:0:17880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086a6680 x1876645365549184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789708680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789708664.315761:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006720f88e/0xf45f43947e47e1f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708664.315780:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17880:1876645365549184:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1789708664.315781:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006720f88e/0xf45f43947e47e1f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.315798:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006720f88e/0xf45f43947e47e1f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.315806:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006720f88e/0xf45f43947e47e1f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.315823:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.315825:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.315827:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789708664.315921:0:19461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789708664.315931:0:19461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789708664.315934:0:19461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1789708664.315941:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708664.315948:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ef422a1/0xf45f43947e47e1fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.315961:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=235s v=(0 0) 00010000:00010000:1.0:1789708664.315965:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708664.315969:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ef422a1/0xf45f43947e47e1fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.315978:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ef422a1/0xf45f43947e47e1fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.315986:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ef422a1/0xf45f43947e47e1fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.316004:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ef422a1/0xf45f43947e47e1fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.316020:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.316027:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.316032:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ef422a1/0xf45f43947e47e1fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316040:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.316043:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ef422a1/0xf45f43947e47e1fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316050:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ef422a1/0xf45f43947e47e1fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708664.316054:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17882:x1876645365549056:12345-0@lo:5:osp-pre-1-1.0 Request processed in 10368us (10435us total) trans 8589934593 rc 0/0 00010000:00010000:2.0:1789708664.316061:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ef422a1/0xf45f43947e47e1fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708664.316066:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708664.316071:0:17882:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789708664.316080:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1876645365549056:0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1789708664.316082:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ef422a1/0xf45f43947e47e1fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789708664.316095:0:17882:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00010000:00010000:2.0:1789708664.316098:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.316101:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.316103:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708664.316126:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17882:1876645365549312:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789708664.316149:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708664.316168:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee202a26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708664.316173:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365549312 00000100:00100000:1.0:1789708664.316198:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365549312 00000100:00100000:1.0:1789708664.316233:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708664.316241:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17882:x1876645365549312:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789708664.316244:0:17150:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00002000:00010000:3.0:1789708664.316245:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.316255:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008236d3d5/0xf45f43947e47e201 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708664.316256:0:17150:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00010000:00010000:3.0:1789708664.316301:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.316306:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.316311:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008236d3d5/0xf45f43947e47e201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708664.316323:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17882:x1876645365549312:12345-0@lo:900:osp-pre-1-1.0 Request processed in 82us (172us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708664.316326:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008236d3d5/0xf45f43947e47e201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708664.316335:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789708664.316340:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008236d3d5/0xf45f43947e47e201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316350:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008236d3d5/0xf45f43947e47e201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316365:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.316369:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.316373:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008236d3d5/0xf45f43947e47e201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316378:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.316381:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008236d3d5/0xf45f43947e47e201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316387:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008236d3d5/0xf45f43947e47e201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316396:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008236d3d5/0xf45f43947e47e201 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316401:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008236d3d5/0xf45f43947e47e201 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316411:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.316413:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.316415:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1789708664.316456:0:17882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086a5180 x1876645365549312/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789708680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708664.316479:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17882:1876645365549312:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1789708664.316603:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.316610:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e46e330e/0xf45f43947e47e208 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316630:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.316632:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.316636:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e46e330e/0xf45f43947e47e208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316646:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e46e330e/0xf45f43947e47e208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316654:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e46e330e/0xf45f43947e47e208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316661:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e46e330e/0xf45f43947e47e208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316676:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708664.316688:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.316694:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e46e330e/0xf45f43947e47e208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.316703:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708664.316707:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e46e330e/0xf45f43947e47e208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.316716:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e46e330e/0xf45f43947e47e208 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.316728:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e46e330e/0xf45f43947e47e208 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.316735:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e46e330e/0xf45f43947e47e208 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.316749:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.316751:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.316753:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.316860:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.316866:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb08ea62/0xf45f43947e47e20f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316875:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.316878:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.316882:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb08ea62/0xf45f43947e47e20f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316891:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb08ea62/0xf45f43947e47e20f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316910:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb08ea62/0xf45f43947e47e20f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316917:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb08ea62/0xf45f43947e47e20f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.316933:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.316949:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.316953:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb08ea62/0xf45f43947e47e20f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316959:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.316962:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb08ea62/0xf45f43947e47e20f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316967:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb08ea62/0xf45f43947e47e20f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316976:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb08ea62/0xf45f43947e47e20f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316980:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb08ea62/0xf45f43947e47e20f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.316990:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.316991:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.316992:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.317129:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.317136:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e216 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317144:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.317147:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.317151:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317160:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317168:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317176:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317204:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.317221:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.317226:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.317234:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.317238:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.317254:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e216 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.317278:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e216 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.317283:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e216 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.317294:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.317296:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.317297:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.317430:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.317436:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e21d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317444:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.317446:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.317450:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e21d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317459:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e21d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317480:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e21d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317488:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e21d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317506:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708664.317527:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.317533:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e21d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.317540:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708664.317542:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e21d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.317557:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e21d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.317565:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e21d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.317570:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e21d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.317581:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.317582:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.317584:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.317686:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.317692:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004b12027/0xf45f43947e47e224 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317701:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.317709:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.317713:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004b12027/0xf45f43947e47e224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317722:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004b12027/0xf45f43947e47e224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317730:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004b12027/0xf45f43947e47e224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317737:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004b12027/0xf45f43947e47e224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317753:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.317768:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.317773:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004b12027/0xf45f43947e47e224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.317778:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.317781:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004b12027/0xf45f43947e47e224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.317786:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004b12027/0xf45f43947e47e224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.317794:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004b12027/0xf45f43947e47e224 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.317806:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004b12027/0xf45f43947e47e224 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.317817:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.317818:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.317819:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.317951:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.317957:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053a68c3a/0xf45f43947e47e22b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317965:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.317968:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.317972:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053a68c3a/0xf45f43947e47e22b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317981:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053a68c3a/0xf45f43947e47e22b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.317989:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053a68c3a/0xf45f43947e47e22b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318001:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053a68c3a/0xf45f43947e47e22b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318021:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.318041:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.318045:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053a68c3a/0xf45f43947e47e22b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318053:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.318057:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053a68c3a/0xf45f43947e47e22b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318066:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053a68c3a/0xf45f43947e47e22b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318079:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053a68c3a/0xf45f43947e47e22b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318086:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053a68c3a/0xf45f43947e47e22b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318096:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.318098:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.318099:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.318226:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.318232:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000065affb3/0xf45f43947e47e232 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318240:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.318243:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.318247:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000065affb3/0xf45f43947e47e232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318256:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000065affb3/0xf45f43947e47e232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318284:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000065affb3/0xf45f43947e47e232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318291:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000065affb3/0xf45f43947e47e232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318309:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708664.318323:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.318330:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000065affb3/0xf45f43947e47e232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.318339:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708664.318342:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000065affb3/0xf45f43947e47e232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.318352:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000065affb3/0xf45f43947e47e232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.318364:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000065affb3/0xf45f43947e47e232 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.318383:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000065affb3/0xf45f43947e47e232 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.318399:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.318401:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.318403:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.318510:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.318516:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4670081/0xf45f43947e47e239 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318529:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.318532:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.318536:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4670081/0xf45f43947e47e239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318545:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4670081/0xf45f43947e47e239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318553:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4670081/0xf45f43947e47e239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318559:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4670081/0xf45f43947e47e239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318575:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.318589:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.318593:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4670081/0xf45f43947e47e239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318599:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.318602:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4670081/0xf45f43947e47e239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318607:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4670081/0xf45f43947e47e239 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318616:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4670081/0xf45f43947e47e239 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318621:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4670081/0xf45f43947e47e239 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318631:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.318632:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.318633:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.318834:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.318840:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c178535/0xf45f43947e47e240 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318848:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.318851:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.318855:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c178535/0xf45f43947e47e240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318863:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c178535/0xf45f43947e47e240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318882:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c178535/0xf45f43947e47e240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318889:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c178535/0xf45f43947e47e240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.318904:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.318919:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.318923:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c178535/0xf45f43947e47e240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318929:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.318931:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c178535/0xf45f43947e47e240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318945:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c178535/0xf45f43947e47e240 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318954:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c178535/0xf45f43947e47e240 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318958:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c178535/0xf45f43947e47e240 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.318968:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.318969:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.318970:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.319104:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.319110:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da159d3/0xf45f43947e47e247 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319117:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.319120:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.319123:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da159d3/0xf45f43947e47e247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319131:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da159d3/0xf45f43947e47e247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319138:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da159d3/0xf45f43947e47e247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319145:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004da159d3/0xf45f43947e47e247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319168:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708664.319193:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.319199:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004da159d3/0xf45f43947e47e247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.319208:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708664.319212:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004da159d3/0xf45f43947e47e247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.319220:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004da159d3/0xf45f43947e47e247 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.319231:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004da159d3/0xf45f43947e47e247 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.319238:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da159d3/0xf45f43947e47e247 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.319252:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.319254:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.319255:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.319349:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.319355:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e24e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319362:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.319365:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.319370:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e24e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319379:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e24e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319386:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e24e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319391:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e24e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319406:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.319425:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.319431:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e24e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.319440:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.319445:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e24e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.319454:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e24e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.319477:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e24e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.319502:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e8c4d30/0xf45f43947e47e24e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.319518:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.319520:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.319522:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.319617:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.319623:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e255 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319631:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.319639:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.319643:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319653:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319661:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319668:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319683:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.319701:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.319707:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.319715:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.319718:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.319728:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.319740:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e255 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.319747:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a32da1ad/0xf45f43947e47e255 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.319764:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.319766:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.319768:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.319889:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.319895:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e25c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319903:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.319906:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.319910:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e25c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319919:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e25c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319927:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e25c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319941:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e25c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.319956:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708664.319977:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.319983:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e25c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.319996:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708664.319999:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e25c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.320009:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e25c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.320021:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e25c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.320027:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009970e73b/0xf45f43947e47e25c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.320046:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.320049:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.320051:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.320211:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.320215:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e2777b1/0xf45f43947e47e263 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320221:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.320222:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.320225:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e2777b1/0xf45f43947e47e263 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320230:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e2777b1/0xf45f43947e47e263 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320235:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e2777b1/0xf45f43947e47e263 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320239:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e2777b1/0xf45f43947e47e263 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320254:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.320301:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.320307:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e2777b1/0xf45f43947e47e263 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.320317:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.320321:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e2777b1/0xf45f43947e47e263 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.320330:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e2777b1/0xf45f43947e47e263 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.320341:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e2777b1/0xf45f43947e47e263 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.320348:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e2777b1/0xf45f43947e47e263 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.320364:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.320366:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.320367:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.320517:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.320523:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc4bf240/0xf45f43947e47e26a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320536:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.320538:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.320540:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4bf240/0xf45f43947e47e26a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320546:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc4bf240/0xf45f43947e47e26a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320551:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc4bf240/0xf45f43947e47e26a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320558:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4bf240/0xf45f43947e47e26a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320575:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.320602:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.320609:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc4bf240/0xf45f43947e47e26a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.320617:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103bc00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.320620:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc4bf240/0xf45f43947e47e26a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.320640:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc4bf240/0xf45f43947e47e26a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.320652:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc4bf240/0xf45f43947e47e26a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.320659:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc4bf240/0xf45f43947e47e26a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.320672:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.320674:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.320675:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.320830:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.320836:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47e271 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320844:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.320846:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.320848:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47e271 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320854:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47e271 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320867:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47e271 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320871:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47e271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.320882:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708664.320907:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708664.320915:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47e271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.320922:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ae00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708664.320926:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47e271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.320946:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47e271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.320958:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47e271 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.320965:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47e271 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.320978:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.320980:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708664.320982:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708664.321046:0:19635:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708664.321050:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e278 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.321055:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789708664.321057:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708664.321060:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.321065:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.321069:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.321076:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.321101:0:19635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708664.321121:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708664.321127:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789708664.321130:0:19635:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:2.0:1789708664.321139:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708664.321143:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.321151:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e278 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.321163:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e278 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.321182:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e278 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708664.321195:0:19635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:17165:x1876645365548288:12345-0@lo:5:osp-pre-1-0.0 Request processed in 19422us (20566us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708664.321197:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708664.321204:0:19635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789708664.321211:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708664.321215:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708664.321237:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17165:1876645365548288:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789708664.321253:0:17165:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789708664.321323:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17165:1876645365549440:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789708664.321355:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708664.321377:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9180 going to sleep for 11 seconds 00000100:00100000:0.0:1789708664.321389:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365549440 00000100:00100000:0.0:1789708664.321396:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365549440 00000100:00100000:0.0:1789708664.321444:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708664.321454:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17165:x1876645365549440:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789708664.321497:0:18838:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1789708664.324006:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17165:x1876645365549440:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2550us (2646us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789708664.324017:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789708664.324169:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17165:1876645365549440:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789708664.324181:0:17165:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1789708664.358401:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708664.678463:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365549568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708664.678533:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708664.678628:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365549568 00000100:00100000:2.0:1789708664.678643:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365549568 00000100:00100000:2.0:1789708664.678690:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708664.678699:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365549568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708664.678720:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789708664.678766:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365549568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708664.678773:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708664.678815:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365549568:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1789708664.998313:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708664.998321:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee0446d000 from 10 10000000:01000000:3.0:1789708664.998327:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708664.998374:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.998386:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.998397:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708664.998422:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365549696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708664.998502:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708664.998541:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee07a81240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708664.998555:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365549696 00000100:00100000:1.0:1789708664.998564:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365549696 00000100:00100000:1.0:1789708664.998607:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789708664.998615:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:17136:x1876645365549696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708664.998633:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708664.998654:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e948a00/0xf45f43947e47e286 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e27f expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.998676:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e948a00/0xf45f43947e47e286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e27f expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.998685:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e948a00/0xf45f43947e47e286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e27f expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.998691:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948a00, rc 0) 00000100:00100000:1.0:1789708664.998746:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:17136:x1876645365549696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.998758:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789708664.998781:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365549696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708664.998799:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.998810:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708664.998888:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365549824:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789708664.998924:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708664.998948:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee07a81240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708664.998977:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365549824 00000100:00100000:1.0:1789708664.998982:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365549824 00000100:00100000:1.0:1789708664.999014:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789708664.999022:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:17136:x1876645365549824:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789708664.999036:0:17134:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789708664.999054:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789708664.999058:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789708664.999127:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:17136:x1876645365549824:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.999133:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789708664.999144:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365549824:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789708664.999212:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708664.999219:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.999226:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708664.999236:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708664.999237:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bed0a28c800 from 10 10000000:01000000:3.0:1789708664.999239:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708664.999253:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.999278:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.999285:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708664.999298:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365549952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708664.999322:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708664.999346:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee07a81240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708664.999359:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365549952 00000100:00100000:1.0:1789708664.999363:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365549952 00000100:00100000:1.0:1789708664.999384:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789708664.999390:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:17136:x1876645365549952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708664.999395:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708664.999401:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e948000/0xf45f43947e47e294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e28d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.999417:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e948000/0xf45f43947e47e294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e28d expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.999422:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e948000/0xf45f43947e47e294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e28d expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.999427:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948000, rc 0) 00000100:00100000:1.0:1789708664.999463:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:17136:x1876645365549952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.999468:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789708664.999479:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365549952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708664.999498:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.999507:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708664.999544:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365550080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789708664.999576:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708664.999596:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee07a81240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708664.999616:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365550080 00000100:00100000:1.0:1789708664.999622:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365550080 00000100:00100000:1.0:1789708664.999657:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789708664.999665:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:17136:x1876645365550080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789708664.999674:0:17134:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789708664.999684:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789708664.999687:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789708664.999782:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365550080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789708664.999783:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:17136:x1876645365550080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.999794:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 10000000:01000000:3.0:1789708664.999841:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708664.999846:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.999854:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1789708665.344965:0:19819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789708665.383907:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789708665.674467:0:19871:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708665.674622:0:19871:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789708665.766742:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789708665.996673:0:19921:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789708665.996930:0:19921:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789708666.081586:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.081643:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357127552 00000100:00100000:1.0:1789708666.081657:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357127552 00000100:00100000:1.0:1789708666.081715:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:1.0:1789708666.081726:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2394:x1876645357127552:12345-192.168.201.52@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789708666.081774:0:17133:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a@192.168.201.52@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:1.0:1789708666.081809:0:17133:0:(genops.c:1384:class_connect()) connect: client 7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a, cookie 0xf45f43947e47e29b 00000100:00080000:1.0:1789708666.081999:0:17133:0:(import.c:65:import_set_state_nolock()) ffff9bed01d40800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708666.082088:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+5:2394:x1876645357127552:12345-192.168.201.52@tcp:250:mount.lustre.0 Request processed in 363us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.082102:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:0.0:1789708666.083150:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.083198:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357127680 00000100:00100000:1.0:1789708666.083205:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357127680 00000100:00100000:1.0:1789708666.083250:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:1.0:1789708666.083305:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+5:14863:x1876645357127680:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789708666.083319:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708666.083342:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e2a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e317 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.083372:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e2a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e317 expref: 6 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.083385:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e2a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e317 expref: 6 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.083397:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949a00, rc 0) 00000100:00100000:1.0:1789708666.083447:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+6:14863:x1876645357127680:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 188us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.083454:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:0.0:1789708666.084134:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.084181:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357127808 00000100:00100000:1.0:1789708666.084185:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357127808 00000100:00100000:1.0:1789708666.084219:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:1.0:1789708666.084226:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+6:14863:x1876645357127808:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789708666.084351:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+6:14863:x1876645357127808:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 124us (218us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789708666.084372:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:2.0:1789708666.085088:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.085132:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357127936 00000100:00100000:1.0:1789708666.085138:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357127936 00000100:00100000:1.0:1789708666.085166:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:1.0:1789708666.085173:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+6:14863:x1876645357127936:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789708666.085182:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708666.085195:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e2a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e31e expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.085214:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e31e expref: 7 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.085223:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e31e expref: 7 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.085231:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e949400, rc 0) 00000100:00100000:1.0:1789708666.085279:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+7:14863:x1876645357127936:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 106us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.085288:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:0.0:1789708666.085933:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.085977:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357128064 00000100:00100000:1.0:1789708666.085983:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357128064 00000100:00100000:1.0:1789708666.086011:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:1.0:1789708666.086019:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+7:14863:x1876645357128064:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789708666.086125:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:14863:x1876645357128064:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 106us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.086137:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:0.0:1789708666.086751:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.086793:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357128192 00000100:00100000:1.0:1789708666.086798:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357128192 00000100:00100000:1.0:1789708666.086822:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:1.0:1789708666.086827:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:14863:x1876645357128192:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789708666.086911:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:14863:x1876645357128192:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.086916:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:2.0:1789708666.087939:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.087988:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357128320 00000100:00100000:1.0:1789708666.087994:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357128320 00000100:00100000:1.0:1789708666.088031:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:1.0:1789708666.088040:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:14882:x1876645357128320:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708666.088143:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:14882:x1876645357128320:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 105us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.088151:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:0.0:1789708666.100517:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.100594:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357128448 00000100:00100000:1.0:1789708666.100607:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357128448 00000100:00100000:1.0:1789708666.100681:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:1.0:1789708666.100694:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:14882:x1876645357128448:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708666.100872:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:14882:x1876645357128448:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 180us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.100882:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:0.0:1789708666.101917:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.101958:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357128576 00000100:00100000:1.0:1789708666.101962:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357128576 00000100:00100000:1.0:1789708666.101987:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:1.0:1789708666.101994:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:14882:x1876645357128576:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708666.102069:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:14882:x1876645357128576:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.102074:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:2.0:1789708666.103495:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.103555:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357128704 00000100:00100000:1.0:1789708666.103561:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357128704 00000100:00100000:1.0:1789708666.103599:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:1.0:1789708666.103607:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:14863:x1876645357128704:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789708666.103619:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708666.103642:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e948800/0xf45f43947e47e2b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e34f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.103674:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e948800/0xf45f43947e47e2b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e34f expref: 9 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.103687:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e948800/0xf45f43947e47e2b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e34f expref: 9 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.103700:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948800, rc 0) 00000100:00100000:1.0:1789708666.103739:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+9:14863:x1876645357128704:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 131us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.103746:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:0.0:1789708666.105040:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.105089:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357128832 00000100:00100000:1.0:1789708666.105096:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357128832 00000100:00100000:1.0:1789708666.105132:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:1.0:1789708666.105140:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+9:14863:x1876645357128832:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789708666.105158:0:17133:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789708666.105189:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789708666.105193:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789708666.105197:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789708666.105200:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789708666.105202:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789708666.106618:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+9:14863:x1876645357128832:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 1477us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.106628:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:2.0:1789708666.108523:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.108562:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357128960 00000100:00100000:1.0:1789708666.108571:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357128960 00000100:00100000:1.0:1789708666.108602:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:1.0:1789708666.108607:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee08569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+9:14863:x1876645357128960:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789708666.108616:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708666.108628:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee3e948600/0xf45f43947e47e2b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e356 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.108647:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee3e948600/0xf45f43947e47e2b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e356 expref: 10 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.108655:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee3e948600/0xf45f43947e47e2b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e356 expref: 10 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708666.108661:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee3e948600, rc 0) 00000100:00100000:1.0:1789708666.108686:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee08569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:14863:x1876645357128960:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 79us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.108690:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:0.0:1789708666.109367:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.109409:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357129088 00000100:00100000:1.0:1789708666.109414:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357129088 00000100:00100000:1.0:1789708666.109452:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:1.0:1789708666.109470:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:14863:x1876645357129088:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789708666.109586:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:14863:x1876645357129088:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 119us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.109592:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:0.0:1789708666.110184:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.110231:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357129216 00000100:00100000:1.0:1789708666.110236:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357129216 00000100:00100000:3.0:1789708666.110293:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:3.0:1789708666.110305:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0856b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:14863:x1876645357129216:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789708666.110403:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0856b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:14863:x1876645357129216:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708666.110416:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:2.0:1789708666.111512:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.111578:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357129344 00000100:00100000:1.0:1789708666.111586:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357129344 00000100:00100000:1.0:1789708666.111649:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:1.0:1789708666.111659:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:14886:x1876645357129344:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708666.111835:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:14886:x1876645357129344:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 177us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.111842:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:0.0:1789708666.112992:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708666.113031:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357129472 00000100:00100000:3.0:1789708666.113037:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357129472 00000100:00100000:3.0:1789708666.113066:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:3.0:1789708666.113072:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:14886:x1876645357129472:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708666.113144:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:14886:x1876645357129472:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 72us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708666.113149:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:1.0:1789708666.114373:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708666.114459:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357129600 00000100:00100000:3.0:1789708666.114463:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357129600 00000100:00100000:3.0:1789708666.114488:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789708666.114492:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1876645357129600:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789708666.114513:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f84d004b-f450-4582-bbe2-71415469e27b@192.168.201.52@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:3.0:1789708666.114564:0:17140:0:(genops.c:1384:class_connect()) connect: client f84d004b-f450-4582-bbe2-71415469e27b, cookie 0xf45f43947e47e2be 00000004:00100000:3.0:1789708666.114589:0:17140:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789708666.114828:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00080000:3.0:1789708666.114859:0:17140:0:(import.c:65:import_set_state_nolock()) ffff9bee3d93d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708666.114871:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357129856 00000100:00100000:2.0:1789708666.114877:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357129856 00000100:00100000:3.0:1789708666.114904:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+6:2394:x1876645357129600:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 408us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708666.114915:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1789708666.114927:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789708666.114928:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1876645357129856:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789708666.114949:0:18837:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from f84d004b-f450-4582-bbe2-71415469e27b@192.168.201.52@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:2.0:1789708666.114994:0:18837:0:(genops.c:1384:class_connect()) connect: client f84d004b-f450-4582-bbe2-71415469e27b, cookie 0xf45f43947e47e2c5 00000004:00100000:2.0:1789708666.115009:0:18837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789708666.115161:0:18837:0:(import.c:65:import_set_state_nolock()) ffff9bee3d990000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708666.115196:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+6:2394:x1876645357129856:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 273us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708666.115204:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1789708666.115902:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708666.115921:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708666.115946:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357129728 00000100:00100000:2.0:1789708666.115951:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357129728 00000100:00100000:1.0:1789708666.115961:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357130112 00000100:00100000:1.0:1789708666.115967:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357130112 00000100:00080000:0.0:1789708666.115996:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708666.116006:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789708666.116014:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789708666.116019:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+7:0:x1876645357129728:12345-192.168.201.52@tcp:41:mount.lustre.0 00000100:00100000:1.0:1789708666.116027:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+7:14863:x1876645357130112:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789708666.116050:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000004:00000024:2.0:1789708666.116051:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1789708666.116132:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+7:14863:x1876645357130112:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 109us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708666.116139:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+7:0:x1876645357129728:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 123us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.116147:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789708666.116156:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:0.0:1789708666.116230:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708666.116296:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357129984 00000100:00100000:3.0:1789708666.116300:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357129984 00000100:00100000:3.0:1789708666.116328:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789708666.116334:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+6:0:x1876645357129984:12345-192.168.201.52@tcp:41:mount.lustre.0 00000100:00080000:0.0:1789708666.116336:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1789708666.116348:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789708666.116395:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+6:0:x1876645357129984:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 60us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708666.116401:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:0.0:1789708666.117044:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.117082:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357130240 00000100:00100000:1.0:1789708666.117088:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357130240 00000100:00100000:1.0:1789708666.117113:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:1.0:1789708666.117120:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+6:14863:x1876645357130240:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789708666.117167:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+6:14863:x1876645357130240:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 46us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.117175:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1789708666.118302:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708666.118330:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708666.118349:0:19634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357130368 00000100:00100000:2.0:1789708666.118356:0:19634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357130368 00000100:00100000:0.0:1789708666.118367:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708666.118389:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357130496 00000100:00100000:2.0:1789708666.118396:0:19634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:1.0:1789708666.118396:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357130496 00000100:00100000:0.0:1789708666.118402:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357130624 00000100:00100000:0.0:1789708666.118407:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357130624 00000100:00100000:2.0:1789708666.118408:0:19634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2394:x1876645357130368:12345-192.168.201.52@tcp:8:mount.lustre.0 00000100:00100000:3.0:1789708666.118441:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00010000:00080000:2.0:1789708666.118447:0:19634:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f84d004b-f450-4582-bbe2-71415469e27b@192.168.201.52@tcp t0 exp 0000000000000000 cur 236 last 0 00000100:00100000:3.0:1789708666.118453:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2394:x1876645357130496:12345-192.168.201.52@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789708666.118477:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00010000:00080000:3.0:1789708666.118479:0:19636:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f84d004b-f450-4582-bbe2-71415469e27b@192.168.201.52@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:2.0:1789708666.118484:0:19634:0:(genops.c:1384:class_connect()) connect: client f84d004b-f450-4582-bbe2-71415469e27b, cookie 0xf45f43947e47e2cc 00000100:00100000:0.0:1789708666.118491:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f84d004b-f450-4582-bbe2-71415469e27b+6:14863:x1876645357130624:12345-192.168.201.52@tcp:900:mount.lustre.0 00002000:00100000:2.0:1789708666.118495:0:19634:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f84d004b-f450-4582-bbe2-71415469e27b/ffff9bee3d995800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789708666.118507:0:19634:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1789708666.118513:0:19636:0:(genops.c:1384:class_connect()) connect: client f84d004b-f450-4582-bbe2-71415469e27b, cookie 0xf45f43947e47e2d3 00002000:00100000:3.0:1789708666.118523:0:19636:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f84d004b-f450-4582-bbe2-71415469e27b/ffff9bee3d93f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789708666.118532:0:19636:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789708666.118543:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f84d004b-f450-4582-bbe2-71415469e27b+6:14863:x1876645357130624:12345-192.168.201.52@tcp:900:mount.lustre.0 Request processed in 56us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708666.118552:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00002000:00080000:2.0:1789708666.118726:0:19634:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789708666.118754:0:19634:0:(import.c:65:import_set_state_nolock()) ffff9bee3d993800 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1789708666.118791:0:19636:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1789708666.118793:0:19634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f84d004b-f450-4582-bbe2-71415469e27b+6:2394:x1876645357130368:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 386us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708666.118809:0:19634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00080000:3.0:1789708666.118814:0:19636:0:(import.c:65:import_set_state_nolock()) ffff9bee3d93c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708666.118938:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+6:2394:x1876645357130496:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 419us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708666.118946:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:1.0:1789708666.119403:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708666.119464:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357130752 00000100:00100000:3.0:1789708666.119469:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357130752 00000100:00100000:3.0:1789708666.119501:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1789708666.119509:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+6:14863:x1876645357130752:12345-192.168.201.52@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789708666.120185:0:17141:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 585us 00000004:00200000:3.0:1789708666.126652:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789708666.126792:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+6:14863:x1876645357130752:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 7277us (7382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708666.126804:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:0.0:1789708666.205896:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708666.205978:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357130880 00000100:00100000:2.0:1789708666.205991:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357130880 00000100:00100000:2.0:1789708666.206064:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1789708666.206077:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+6:14909:x1876645357130880:12345-192.168.201.52@tcp:101:mkdir.0 00010000:00010000:2.0:1789708666.206103:0:18837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708666.206236:0:18837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e2da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e387 expref: -99 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708666.206347:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e2e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708666.206356:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708666.206368:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708666.206411:0:18837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789708666.206413:0:18837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708666.206467:0:18837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708666.206488:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e2da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e387 expref: 8 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708666.206500:0:18837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e387 expref: 7 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708666.206522:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769400) 00010000:00010000:2.0:1789708666.206524:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708666.206526:0:18837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5400, rc 0) 00000100:00100000:2.0:1789708666.206593:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+7:14909:x1876645357130880:12345-192.168.201.52@tcp:101:mkdir.0 Request processed in 519us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708666.206599:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00010000:00010000:2.0:1789708666.406434:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708667.430528:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708667.566713:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708667.566787:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357131008 00000100:00100000:2.0:1789708667.566797:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357131008 00000100:00100000:2.0:1789708667.566859:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1789708667.566869:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+6:14961:x1876645357131008:12345-192.168.201.52@tcp:41:lfs.0 00000004:00000024:2.0:1789708667.566911:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789708667.567011:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+6:14961:x1876645357131008:12345-192.168.201.52@tcp:41:lfs.0 Request processed in 142us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.567020:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1789708667.568531:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708667.568602:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357131136 00000100:00100000:0.0:1789708667.568610:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357131136 00000100:00080000:1.0:1789708667.568667:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708667.568680:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1789708667.568706:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f84d004b-f450-4582-bbe2-71415469e27b+6:14961:x1876645357131136:12345-192.168.201.52@tcp:13:lfs.0 00002000:00000024:0.0:1789708667.568733:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789708667.568802:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f84d004b-f450-4582-bbe2-71415469e27b+6:14961:x1876645357131136:12345-192.168.201.52@tcp:13:lfs.0 Request processed in 112us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.568809:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1789708667.569578:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708667.569630:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357131264 00000100:00100000:2.0:1789708667.569634:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357131264 00000100:00100000:2.0:1789708667.569673:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1789708667.569679:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f84d004b-f450-4582-bbe2-71415469e27b+6:14961:x1876645357131264:12345-192.168.201.52@tcp:13:lfs.0 00000100:00080000:1.0:1789708667.569691:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789708667.569699:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789708667.569783:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f84d004b-f450-4582-bbe2-71415469e27b+6:14961:x1876645357131264:12345-192.168.201.52@tcp:13:lfs.0 Request processed in 103us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.569792:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1789708667.638484:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708667.638574:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357131392 00000100:00100000:0.0:1789708667.638587:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357131392 00000100:00100000:0.0:1789708667.638677:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:0.0:1789708667.638690:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:14994:x1876645357131392:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789708667.638714:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708667.638739:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47e2e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e38e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708667.638778:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47e2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e38e expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708667.638799:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47e2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e38e expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708667.638809:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1800, rc 0) 00000100:00100000:0.0:1789708667.638908:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:14994:x1876645357131392:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 221us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.638916:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:1.0:1789708667.640715:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708667.640778:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357131520 00000100:00100000:3.0:1789708667.640786:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357131520 00000100:00100000:3.0:1789708667.640833:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:3.0:1789708667.640854:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:14994:x1876645357131520:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789708667.641021:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:14994:x1876645357131520:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 169us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708667.641030:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:1.0:1789708667.644338:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708667.644395:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357131648 00000100:00100000:2.0:1789708667.644428:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357131648 00000100:00100000:2.0:1789708667.644493:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:2.0:1789708667.644506:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:14994:x1876645357131648:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789708667.644671:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:14994:x1876645357131648:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 167us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.644680:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:1.0:1789708667.646918:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708667.646984:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357131776 00000100:00100000:3.0:1789708667.646993:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357131776 00000100:00100000:3.0:1789708667.647050:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:3.0:1789708667.647060:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:15000:x1876645357131776:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708667.647285:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:15000:x1876645357131776:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 203us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708667.647293:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:1.0:1789708667.659238:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708667.659356:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357131904 00000100:00100000:2.0:1789708667.659372:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357131904 00000100:00100000:2.0:1789708667.659448:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:2.0:1789708667.659459:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2e7cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:15000:x1876645357131904:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708667.659624:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2e7cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:15000:x1876645357131904:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 166us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.659633:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:1.0:1789708667.660705:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708667.660756:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357132032 00000100:00100000:0.0:1789708667.660761:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357132032 00000100:00100000:0.0:1789708667.660796:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:0.0:1789708667.660802:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09858850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:15000:x1876645357132032:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789708667.660863:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09858850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:15000:x1876645357132032:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.660868:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:1.0:1789708667.662253:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708667.662310:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357132160 00000100:00100000:2.0:1789708667.662317:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357132160 00000100:00100000:2.0:1789708667.662348:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:2.0:1789708667.662354:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:14994:x1876645357132160:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789708667.662362:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708667.662376:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb4e00/0xf45f43947e47e2ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e3bf expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.662396:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb4e00/0xf45f43947e47e2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3bf expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.662417:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb4e00/0xf45f43947e47e2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3bf expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.662434:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4e00, rc 0) 00000100:00100000:2.0:1789708667.662463:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:14994:x1876645357132160:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 110us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.662468:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:1.0:1789708667.663640:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708667.663697:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357132288 00000100:00100000:0.0:1789708667.663704:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357132288 00000100:00100000:0.0:1789708667.663736:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:0.0:1789708667.663742:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09858450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:14994:x1876645357132288:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789708667.663757:0:17133:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789708667.663773:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789708667.663776:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789708667.663778:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789708667.663781:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789708667.663782:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789708667.664451:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09858450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:14994:x1876645357132288:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 709us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.664458:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:1.0:1789708667.665715:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708667.665761:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357132416 00000100:00100000:2.0:1789708667.665765:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357132416 00000100:00100000:2.0:1789708667.665805:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:2.0:1789708667.665814:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:14994:x1876645357132416:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789708667.665821:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708667.665833:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb5600/0xf45f43947e47e2f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e3c6 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.665851:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb5600/0xf45f43947e47e2f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3c6 expref: 13 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.665859:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb5600/0xf45f43947e47e2f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3c6 expref: 13 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.665865:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5600, rc 0) 00000100:00100000:2.0:1789708667.665892:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:14994:x1876645357132416:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.665896:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:1.0:1789708667.666621:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708667.666664:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357132544 00000100:00100000:0.0:1789708667.666668:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357132544 00000100:00100000:0.0:1789708667.666696:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:0.0:1789708667.666703:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:14994:x1876645357132544:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789708667.666807:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:14994:x1876645357132544:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 104us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.666814:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:1.0:1789708667.669927:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708667.669982:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357132672 00000100:00100000:2.0:1789708667.669987:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357132672 00000100:00100000:2.0:1789708667.670018:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:2.0:1789708667.670024:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:14994:x1876645357132672:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789708667.670132:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:14994:x1876645357132672:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 107us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.670138:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:1.0:1789708667.671181:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708667.671245:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357132800 00000100:00100000:0.0:1789708667.671251:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357132800 00000100:00100000:0.0:1789708667.671325:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:0.0:1789708667.671339:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:15004:x1876645357132800:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789708667.671446:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:15004:x1876645357132800:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 112us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.671454:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:1.0:1789708667.672337:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708667.672393:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357132928 00000100:00100000:2.0:1789708667.672411:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357132928 00000100:00100000:2.0:1789708667.672444:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:2.0:1789708667.672455:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:15004:x1876645357132928:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708667.672547:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:15004:x1876645357132928:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.672555:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:1.0:1789708667.673734:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708667.673821:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357133056 00000100:00100000:3.0:1789708667.673829:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357133056 00000100:00100000:1.0:1789708667.673840:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708667.673874:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357133312 00000100:00100000:3.0:1789708667.673878:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357133312 00000100:00100000:2.0:1789708667.673882:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789708667.673889:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1876645357133056:12345-192.168.201.52@tcp:38:mount.lustre.0 00000100:00100000:1.0:1789708667.673898:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708667.673914:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357133440 00010000:00080000:2.0:1789708667.673914:0:18837:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fe38e29e-f16b-40a3-8fce-73b38f0cc7ba@192.168.201.52@tcp t0 exp 0000000000000000 cur 238 last 0 00000100:00100000:3.0:1789708667.673919:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357133440 00000100:00100000:0.0:1789708667.673922:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:3.0:1789708667.673935:0:17140:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789708667.673942:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357133312:12345-192.168.201.52@tcp:400:kworker.0 00000020:00000080:2.0:1789708667.673961:0:18837:0:(genops.c:1384:class_connect()) connect: client fe38e29e-f16b-40a3-8fce-73b38f0cc7ba, cookie 0xf45f43947e47e2fd 00000100:00100000:3.0:1789708667.673980:0:17140:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000004:00100000:2.0:1789708667.673987:0:18837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789708667.673994:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357133312:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 62us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.674003:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:0.0:1789708667.674024:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:0.0:1789708667.674030:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1876645357133440:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789708667.674050:0:17139:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from fe38e29e-f16b-40a3-8fce-73b38f0cc7ba@192.168.201.52@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1789708667.674078:0:17139:0:(genops.c:1384:class_connect()) connect: client fe38e29e-f16b-40a3-8fce-73b38f0cc7ba, cookie 0xf45f43947e47e304 00000100:00080000:2.0:1789708667.674083:0:18837:0:(import.c:65:import_set_state_nolock()) ffff9bee3d997000 : changing import state from RECOVER to FULL 00000004:00100000:0.0:1789708667.674097:0:17139:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789708667.674134:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:2394:x1876645357133056:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 243us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.674149:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00080000:0.0:1789708667.674158:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9bee3d935000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708667.674192:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:2394:x1876645357133440:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 160us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.674200:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1789708667.675248:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708667.675336:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708667.675339:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357133568 00000100:00100000:3.0:1789708667.675345:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357133568 00000100:00100000:1.0:1789708667.675382:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708667.675414:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357133184 00000100:00100000:2.0:1789708667.675420:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357133184 00000100:00100000:3.0:1789708667.675451:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357133696 00000100:00100000:3.0:1789708667.675456:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357133696 00000100:00100000:2.0:1789708667.675465:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1789708667.675473:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:2.0:1789708667.675480:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:0:x1876645357133568:12345-192.168.201.52@tcp:41:mount.lustre.0 00000100:00100000:1.0:1789708667.675491:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+7:0:x1876645357133184:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789708667.675510:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1789708667.675513:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789708667.675515:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00080000:0.0:1789708667.675518:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789708667.675562:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+7:0:x1876645357133184:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.675636:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:0:x1876645357133568:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 161us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708667.675667:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:2.0:1789708667.675681:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789708667.675691:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:3.0:1789708667.675703:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:14994:x1876645357133696:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789708667.675718:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1789708667.675755:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:14994:x1876645357133696:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 56us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708667.675773:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:1.0:1789708667.676800:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708667.676846:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357133824 00000100:00100000:0.0:1789708667.676852:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357133824 00000100:00100000:0.0:1789708667.676889:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:0.0:1789708667.676899:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:14994:x1876645357133824:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789708667.676949:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:14994:x1876645357133824:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.676956:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:1.0:1789708667.677763:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708667.677797:0:19635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357133952 00000100:00100000:1.0:1789708667.677801:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708667.677805:0:19635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357133952 00000100:00100000:0.0:1789708667.677865:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357134080 00000100:00100000:0.0:1789708667.677870:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357134080 00000100:00100000:2.0:1789708667.677887:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1789708667.677898:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:2.0:1789708667.677900:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876645357133952:12345-192.168.201.52@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789708667.677907:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2394:x1876645357134080:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789708667.677934:0:18646:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fe38e29e-f16b-40a3-8fce-73b38f0cc7ba@192.168.201.52@tcp t0 exp 0000000000000000 cur 238 last 0 00010000:00080000:2.0:1789708667.677936:0:18838:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fe38e29e-f16b-40a3-8fce-73b38f0cc7ba@192.168.201.52@tcp t0 exp 0000000000000000 cur 238 last 0 00000100:00100000:3.0:1789708667.677970:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000020:00000080:2.0:1789708667.677971:0:18838:0:(genops.c:1384:class_connect()) connect: client fe38e29e-f16b-40a3-8fce-73b38f0cc7ba, cookie 0xf45f43947e47e312 00000020:00000080:0.0:1789708667.677971:0:18646:0:(genops.c:1384:class_connect()) connect: client fe38e29e-f16b-40a3-8fce-73b38f0cc7ba, cookie 0xf45f43947e47e30b 00002000:00100000:2.0:1789708667.677986:0:18838:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fe38e29e-f16b-40a3-8fce-73b38f0cc7ba/ffff9bee3d9d5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789708667.677989:0:18646:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fe38e29e-f16b-40a3-8fce-73b38f0cc7ba/ffff9bee3d936000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789708667.677998:0:18838:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1789708667.677999:0:18646:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789708667.678012:0:19637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357134208 00000100:00100000:1.0:1789708667.678018:0:19637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357134208 00002000:00080000:0.0:1789708667.678057:0:18646:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:2.0:1789708667.678070:0:18838:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789708667.678070:0:19637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00080000:0.0:1789708667.678078:0:18646:0:(import.c:65:import_set_state_nolock()) ffff9bee3d932000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708667.678086:0:19637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:14994:x1876645357134208:12345-192.168.201.52@tcp:900:mount.lustre.0 00000100:00080000:2.0:1789708667.678099:0:18838:0:(import.c:65:import_set_state_nolock()) ffff9bee3d9d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708667.678117:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:2394:x1876645357134080:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 212us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.678123:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:1.0:1789708667.678133:0:19637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:14994:x1876645357134208:12345-192.168.201.52@tcp:900:mount.lustre.0 Request processed in 50us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.678145:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:2394:x1876645357133952:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 248us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708667.678153:0:19637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:2.0:1789708667.678159:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1789708667.678855:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708667.678924:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357134336 00000100:00100000:0.0:1789708667.678930:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357134336 00000100:00100000:0.0:1789708667.678978:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:0.0:1789708667.678988:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:14994:x1876645357134336:12345-192.168.201.52@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789708667.679066:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789708667.679117:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:14994:x1876645357134336:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 132us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.679125:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:3.0:1789708667.746908:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708667.746969:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357134464 00000100:00100000:1.0:1789708667.746980:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357134464 00000100:00100000:1.0:1789708667.747031:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1789708667.747041:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:15027:x1876645357134464:12345-192.168.201.52@tcp:101:mkdir.0 00010000:00010000:1.0:1789708667.747062:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708667.747085:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e319 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e3f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708667.747167:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708667.747181:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708667.747193:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708667.747240:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789708667.747243:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708667.747296:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708667.747320:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e319 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3f7 expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708667.747335:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3f7 expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708667.747343:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769400) 00010000:00010000:1.0:1789708667.747346:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708667.747350:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9600, rc 0) 00000100:00100000:1.0:1789708667.747426:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+7:15027:x1876645357134464:12345-192.168.201.52@tcp:101:mkdir.0 Request processed in 386us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708667.747433:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00010000:00010000:3.0:1789708668.454513:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789708668.734867:0:20020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789708668.774369:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365550208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708668.774374:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708668.774406:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365550336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789708668.774453:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708668.774489:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365550208 00000100:00100000:1.0:1789708668.774497:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365550208 00000100:00100000:1.0:1789708668.774538:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708668.774545:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708668.774549:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365550208:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789708668.774568:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365550336 00000100:00100000:3.0:1789708668.774582:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365550336 00000004:00000024:1.0:1789708668.774593:0:18670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789708668.774611:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708668.774618:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365550336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789708668.774634:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1789708668.774647:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365550208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708668.774653:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789708668.774676:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365550336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708668.774679:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365550208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789708668.774684:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789708668.774713:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365550336:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789708669.478358:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708669.798434:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365550464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708669.798474:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708669.798489:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365550592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708669.798505:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708669.798585:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708669.798626:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365550464 00000100:00100000:0.0:1789708669.798631:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365550592 00000100:00100000:3.0:1789708669.798634:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708669.798634:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365550464 00000100:00100000:0.0:1789708669.798638:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365550592 00000100:00100000:3.0:1789708669.798645:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365550720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708669.798681:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708669.798685:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365550720 00000100:00100000:0.0:1789708669.798690:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365550720 00000100:00100000:0.0:1789708669.798728:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708669.798742:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365550592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789708669.798774:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789708669.798818:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365550592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708669.798826:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708669.798845:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365550848:0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.798847:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708669.798861:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876645365550720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789708669.798872:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789708669.798887:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708669.798908:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876645365550720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708669.798916:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708669.798920:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365551360:0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.798937:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365550848 00000100:00100000:0.0:1789708669.798942:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365550848 00000100:00100000:3.0:1789708669.798950:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708669.798975:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365551872:0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.798976:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789708669.798988:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3615:x1876645365550848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708669.799024:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708669.799040:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3615:x1876645365550848:12345-0@lo:400:kworker.0 Request processed in 53us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708669.799048:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789708669.799071:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365550848:0@lo:400:kworker.0 00000100:00100000:3.0:1789708669.799086:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789708669.799092:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365550976:0@lo:400:kworker.0 00000100:00080000:0.0:1789708669.799117:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708669.799123:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789708669.799124:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708669.799146:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365551488:0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.799150:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365551360 00000100:00100000:0.0:1789708669.799155:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365551360 00000100:00100000:3.0:1789708669.799171:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708669.799193:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365552000:0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.799198:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708669.799210:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365551360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708669.799233:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708669.799254:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365551360:12345-0@lo:400:kworker.0 Request processed in 48us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708669.799286:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708669.799291:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365551360:0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.799313:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365551872 00000100:00100000:0.0:1789708669.799318:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365551872 00000100:00100000:3.0:1789708669.799323:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365551488 00000100:00100000:3.0:1789708669.799329:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365551488 00000100:00100000:0.0:1789708669.799351:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365552000 00000100:00100000:0.0:1789708669.799356:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365552000 00000100:00100000:3.0:1789708669.799378:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789708669.799389:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365551872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.799399:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708669.799411:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365551488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708669.799432:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365551872:12345-0@lo:400:kworker.0 Request processed in 45us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708669.799440:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708669.799456:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365551488:12345-0@lo:400:kworker.0 Request processed in 48us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708669.799461:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708669.799468:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708669.799473:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365552000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.799495:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365551232:0@lo:400:kworker.0 00000100:00100000:3.0:1789708669.799512:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365552000:12345-0@lo:400:kworker.0 Request processed in 42us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708669.799518:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708669.799538:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708669.799559:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365551744:0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.799582:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708669.799614:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365550592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708669.799635:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789708669.799642:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365551104:0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.799670:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708669.799690:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365551616:0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.799714:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708669.799725:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365552128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708669.799744:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789708669.799765:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789708669.799768:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789708669.799770:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708669.799789:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365550720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708669.799806:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365551744 00000100:00100000:0.0:1789708669.799809:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365551744 00000100:00100000:0.0:1789708669.799841:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365551104 00000100:00100000:0.0:1789708669.799845:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365551104 00000100:00100000:0.0:1789708669.799862:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365551616 00000100:00100000:0.0:1789708669.799865:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365551616 00000100:00100000:0.0:1789708669.799889:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789708669.799898:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365551744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.799954:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365551744:12345-0@lo:400:kworker.0 Request processed in 58us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708669.799964:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789708669.799984:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708669.799993:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365551104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.800036:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365551104:12345-0@lo:400:kworker.0 Request processed in 47us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708669.800054:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708669.800070:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708669.800080:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365551616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708669.800113:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365552128 00000100:00100000:0.0:1789708669.800118:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365551616:12345-0@lo:400:kworker.0 Request processed in 41us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708669.800120:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365552128 00000100:00100000:0.0:1789708669.800129:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789708669.800143:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789708669.800151:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708669.800152:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365550464:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789708669.800156:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:1.0:1789708669.800173:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789708669.800190:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365551104:0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.800205:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365551616:0@lo:400:kworker.0 00000100:00100000:1.0:1789708669.800218:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365550464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (1714us total) trans 0 rc 0/0 00010000:00080000:0.0:1789708669.800225:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2cdc00 x1876645365551744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708669.800229:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708669.800242:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365551744:0@lo:400:kworker.0 00000100:00100000:1.0:1789708669.800250:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708669.800435:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365552128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789708669.800449:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789708669.800486:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365552128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 229us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708669.800492:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708669.800534:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365550464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708669.800559:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365552128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708669.801343:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365550976 00000100:00100000:0.0:1789708669.801344:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365551232 00000100:00100000:3.0:1789708669.801349:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365550976 00000100:00100000:0.0:1789708669.801351:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365551232 00000100:00100000:0.0:1789708669.801410:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789708669.801420:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365550976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708669.801460:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365550976:12345-0@lo:400:kworker.0 Request processed in 43us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708669.801467:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789708669.801480:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708669.801485:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365551232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708669.801539:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365551232:12345-0@lo:400:kworker.0 Request processed in 59us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708669.801547:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789708669.801571:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365551232:0@lo:400:kworker.0 00000100:00100000:3.0:1789708669.801596:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365550976:0@lo:400:kworker.0 00000100:00100000:3.0:1789708669.801608:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365551488:0@lo:400:kworker.0 00010000:00080000:3.0:1789708669.801618:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee107e7100 x1876645365552000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708669.801627:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365552000:0@lo:400:kworker.0 00000100:00100000:3.0:1789708669.801637:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365551872:0@lo:400:kworker.0 00000020:00000080:1.0:1789708670.158455:0:20167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff28bb02b0 20000000:00000080:1.0:1789708670.158467:0:20167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bee304d9800 uarg=0000000000000000 20000000:01000000:1.0:1789708670.158498:0:20167:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789708670.158502:0:20167:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789708670.158505:0:20167:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789708670.158806:0:20168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789708670.158882:0:20167:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789708670.161776:0:20167:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789708670.161804:0:20167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.161822:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01509400/0xf45f43947e47dfb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47dfae expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.161830:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bed09bb5e00/0xf45f43947e47dfc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47dfbc expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.161851:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01508e00/0xf45f43947e47e002 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47dffb expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.161859:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47e160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e159 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.161869:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee3e948600/0xf45f43947e47e2b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e356 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.161876:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bed09bb5600/0xf45f43947e47e2f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3c6 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.161884:0:20167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.161924:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bed09bb5600/0xf45f43947e47e2f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3c6 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.161939:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bed09bb5600/0xf45f43947e47e2f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3c6 expref: 12 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708670.161954:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552256:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708670.162047:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee3e948600/0xf45f43947e47e2b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e356 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.162057:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee3e948600/0xf45f43947e47e2b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e356 expref: 12 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708670.162066:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552384:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708670.162103:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47e160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47e159 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.162111:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47e160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47e159 expref: 23 pid: 17132 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708670.162120:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552512:0@lo:104: 00000100:00100000:2.0:1789708670.162161:0:20167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708670.162188:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365552512 00010000:00010000:2.0:1789708670.162189:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01508e00/0xf45f43947e47e002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47dffb expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708670.162197:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365552512 00010000:00010000:2.0:1789708670.162202:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee01508e00/0xf45f43947e47e002 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47dffb expref: 23 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708670.162212:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552640:0@lo:104: 00000100:00100000:2.0:1789708670.162232:0:20167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708670.162286:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bed09bb5e00/0xf45f43947e47dfc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47dfbc expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708670.162291:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365552640 00010000:00010000:2.0:1789708670.162293:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bed09bb5e00/0xf45f43947e47dfc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47dfbc expref: 23 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708670.162297:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365552640 00000100:00100000:2.0:1789708670.162307:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18003100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552768:0@lo:104: 00000100:00100000:2.0:1789708670.162335:0:20167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708670.162380:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365552768 00000100:00100000:3.0:1789708670.162387:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708670.162391:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365552768 00010000:00010000:2.0:1789708670.162396:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01509400/0xf45f43947e47dfb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47dfae expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708670.162399:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+5:20167:x1876645365552512:12345-0@lo:104: 00000100:00100000:0.0:1789708670.162409:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789708670.162415:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee01509400/0xf45f43947e47dfb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47dfae expref: 23 pid: 17133 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.162417:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708670.162419:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+5:20167:x1876645365552640:12345-0@lo:104: 00010000:00010000:0.0:1789708670.162428:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708670.162453:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18000700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552896:0@lo:104: 00010000:00010000:0.0:1789708670.162483:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789708670.162489:0:20167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708670.162490:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708670.162494:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+5:20167:x1876645365552640:12345-0@lo:104: Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708670.162496:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365552896 00000100:00100000:3.0:1789708670.162497:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+5:20167:x1876645365552512:12345-0@lo:104: Request processed in 102us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708670.162503:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365552896 00000100:00100000:2.0:1789708670.162507:0:20167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857480 going to sleep for 11 seconds 00000100:00100000:3.0:1789708670.162508:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708670.162515:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708670.162533:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708670.162537:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552512:0@lo:104: 00000100:00100000:3.0:1789708670.162540:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708670.162544:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:20167:x1876645365552768:12345-0@lo:104: 00000100:00100000:3.0:1789708670.162551:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:20167:x1876645365552896:12345-0@lo:104: 00010000:00010000:0.0:1789708670.162553:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708670.162558:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552640:0@lo:104: 00010000:00010000:3.0:1789708670.162559:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708670.162570:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708670.162579:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708670.162589:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949000 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:1.0:1789708670.162593:0:18292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.162599:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789708670.162599:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789708670.162603:0:18292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708670.162608:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:20167:x1876645365552896:12345-0@lo:104: Request processed in 57us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708670.162608:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+4:20167:x1876645365552768:12345-0@lo:104: Request processed in 66us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708670.162613:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18003100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552768:0@lo:104: 10000000:00010000:1.0:1789708670.162617:0:18292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708670.162625:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708670.162631:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18000700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552896:0@lo:104: 10000000:01000000:1.0:1789708670.162632:0:18292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789708670.162636:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789708670.162647:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789708670.162653:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.162661:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4200 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708670.162664:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.162666:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789708670.162676:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708670.162682:0:18292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708670.162684:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708670.162693:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789708670.162702:0:18292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708670.162722:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708670.162727:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708670.162734:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365553024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708670.162738:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee3e949000/0xf45f43947e47dffb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e002 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708670.162753:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708670.162756:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708670.162763:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509e00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:1.0:1789708670.162767:0:18292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708670.162776:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708670.162780:0:18292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708670.162788:0:18292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708670.162795:0:18292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789708670.162815:0:18292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708670.162822:0:18292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789708670.162829:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365553024 00000100:00100000:0.0:1789708670.162834:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365553024 00010000:00010000:1.0:1789708670.162841:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708670.162849:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01509e00/0xf45f43947e47dfbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47dfc3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.162856:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708670.162860:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01508e00/0xf45f43947e47e002 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47dffb expref: 24 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.162862:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708670.162875:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708670.162879:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708670.162881:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5000 already unused, calling callback (ffffffffc13d2d20) 00010000:00010000:1.0:1789708670.162883:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789708670.162885:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.162891:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708670.162894:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 10000000:00010000:2.0:1789708670.162896:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708670.162901:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789708670.162908:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3e928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365553280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708670.162917:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708670.162918:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789708670.162925:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789708670.162934:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3618:x1876645365553024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708670.162938:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708670.162947:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708670.162955:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5000/0xf45f43947e47dfae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47dfb5 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708670.162960:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708670.162968:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01508e00/0xf45f43947e47e002 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47dffb expref: 24 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.162972:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708670.162977:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708670.162981:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365553408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708670.162982:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708670.162982:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01508e00/0xf45f43947e47e002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47dffb expref: 24 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.162991:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708670.162997:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708670.163004:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01508e00/0xf45f43947e47e002 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47dffb expref: 24 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.163012:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789708670.163016:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708670.163018:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708670.163040:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365553280 00000100:00100000:2.0:1789708670.163046:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365553280 00000100:00100000:1.0:1789708670.163060:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365553408 00000100:00100000:0.0:1789708670.163060:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3618:x1876645365553024:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (286us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708670.163065:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bed09bb5e00/0xf45f43947e47dfc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47dfbc expref: 24 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708670.163067:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365553408 00000100:00100000:0.0:1789708670.163074:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789708670.163077:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.163086:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4200/0xf45f43947e47e159 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47e160 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708670.163089:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01509400/0xf45f43947e47dfb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47dfae expref: 24 pid: 17133 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708670.163096:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789708670.163112:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3616:x1876645365553280:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708670.163115:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789708670.163125:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789708670.163131:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3616:x1876645365553408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708670.163134:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bed09bb5e00/0xf45f43947e47dfc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47dfbc expref: 24 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708670.163142:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708670.163148:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bed09bb5e00/0xf45f43947e47dfc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47dfbc expref: 24 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708670.163157:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01509400/0xf45f43947e47dfb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47dfae expref: 24 pid: 17133 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.163164:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bed09bb5e00/0xf45f43947e47dfc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47dfbc expref: 24 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708670.163171:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01509400/0xf45f43947e47dfb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47dfae expref: 24 pid: 17133 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708670.163179:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365553024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708670.163184:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708670.163187:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708670.163190:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708670.163192:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708670.163196:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509400/0xf45f43947e47dfb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47dfae expref: 23 pid: 17133 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708670.163200:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789708670.163207:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708670.163211:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365553152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708670.163233:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:3616:x1876645365553280:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708670.163247:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:3616:x1876645365553408:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708670.163253:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708670.163294:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708670.163305:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789708670.163310:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552256:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708670.163320:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365553152 00000100:00100000:2.0:1789708670.163326:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365553152 00010000:00010000:2.0:1789708670.163343:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47e160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47e159 expref: 21 pid: 17132 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708670.163365:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365553408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708670.163381:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708670.163382:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3e928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365553280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708670.163390:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:3618:x1876645365553152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708670.163396:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708670.163400:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47e160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47e159 expref: 21 pid: 17132 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.163405:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47e160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47e159 expref: 21 pid: 17132 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.163412:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47e160 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47e159 expref: 21 pid: 17132 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708670.163419:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708670.163443:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:3618:x1876645365553152:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708670.163447:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708670.163486:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365553152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789708670.163800:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a3a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876645365552384:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708670.163826:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:3.0:1789708670.163827:0:20167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708670.163859:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708670.163878:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357134592 00000100:00100000:0.0:1789708670.163884:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357134592 00000100:00100000:2.0:1789708670.163903:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357134720 00010000:00010000:0.0:1789708670.163903:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bed09bb5600/0xf45f43947e47e2f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3c6 expref: 13 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708670.163910:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357134720 00010000:00010000:2.0:1789708670.163928:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee3e948600/0xf45f43947e47e2b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e356 expref: 14 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708670.163935:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:0.0:1789708670.163947:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36242050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+14:2395:x1876645357134592:12345-192.168.201.52@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789708670.163953:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00010000:00010000:0.0:1789708670.163957:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708670.163963:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bed09bb5600/0xf45f43947e47e2f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3c6 expref: 14 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708670.163968:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+14:2395:x1876645357134720:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708670.163975:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bed09bb5600/0xf45f43947e47e2f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3c6 expref: 14 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.163980:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708670.163985:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bed09bb5600/0xf45f43947e47e2f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3c6 expref: 14 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.163989:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee3e948600/0xf45f43947e47e2b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e356 expref: 14 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708670.163997:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708670.164002:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee3e948600/0xf45f43947e47e2b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e356 expref: 13 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.164012:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e948600/0xf45f43947e47e2b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e356 expref: 13 pid: 17134 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.164021:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.164027:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708670.164029:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36242050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:2395:x1876645357134592:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 85us (205us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708670.164042:0:17124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708670.164057:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00010000:00010000:3.0:1789708670.164062:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.164071:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.164077:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.164083:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708670.164087:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.164094:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.164110:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708670.164119:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708670.164120:0:20167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708670.164127:0:20167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708670.164131:0:20167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47e327 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708670.164182:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:2395:x1876645357134720:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 220us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708670.164187:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000001:00100000:3.0:1789708670.311337:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000001:00100000:3.0:1789708670.311370:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f84d004b-f450-4582-bbe2-71415469e27b 00000001:00100000:2.0:1789708670.311651:0:19461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000001:00100000:2.0:1789708670.311658:0:19461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f84d004b-f450-4582-bbe2-71415469e27b 00000001:00080000:2.0:1789708670.311674:0:19461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1789708670.502422:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708671.449117:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708671.449297:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357134848 00000100:00100000:0.0:1789708671.449320:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357134848 00000100:00100000:0.0:1789708671.449550:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:0.0:1789708671.449561:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+6:15540:x1876645357134848:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708671.449580:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708671.449604:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47e32e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e3fe expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449665:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47e335 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449679:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47e335 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449692:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47e335 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449706:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e33c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449713:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449720:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449796:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47e343 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449804:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47e343 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449819:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47e343 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708671.449849:0:19935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789708671.449853:0:19935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708671.449888:0:19935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47e343 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449899:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47e335 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449906:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47e335 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449912:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47e335 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449918:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708671.449923:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47e335 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449929:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47e335 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449941:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769400) 00010000:00010000:0.0:1789708671.449944:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708671.449948:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47e335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449954:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1a00/0xf45f43947e47e335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449978:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449983:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e33c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449989:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e33c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.449994:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708671.449997:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e33c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.450003:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e33c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.450010:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bee08f48f00) 00010000:00010000:0.0:1789708671.450012:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708671.450015:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e33c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.450020:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e33c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.450050:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47e32e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3fe expref: 8 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.450061:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47e343 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3fe expref: 7 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.450079:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bee08f48c00) 00010000:00010000:0.0:1789708671.450081:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708671.450083:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0e00, rc 0) 00000100:00100000:0.0:1789708671.450148:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+7:15540:x1876645357134848:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 589us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708671.450155:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00080000:2.0:1789708671.450408:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708671.455681:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708671.455756:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357134976 00000100:00100000:0.0:1789708671.455765:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357134976 00000100:00100000:0.0:1789708671.455817:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1789708671.455826:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f84d004b-f450-4582-bbe2-71415469e27b+7:15540:x1876645357134976:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789708671.455900:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f84d004b-f450-4582-bbe2-71415469e27b+7:15540:x1876645357134976:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708671.455907:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789708671.461523:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708671.461728:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357135232 00000100:00100000:2.0:1789708671.461739:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357135232 00000100:00100000:2.0:1789708671.461841:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789708671.461852:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+7:15540:x1876645357135232:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708671.461872:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708671.461894:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e34a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e405 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.461962:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e351 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.461975:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.461985:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462038:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e358 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462045:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462051:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462166:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47e35f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462174:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47e35f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462194:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47e35f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708671.462204:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789708671.462507:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462515:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e351 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462521:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e351 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462527:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708671.462531:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e351 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462539:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e351 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462550:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bee08f48c00) 00010000:00010000:2.0:1789708671.462552:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708671.462557:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e351 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462563:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e351 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462575:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462581:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e358 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462592:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462597:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708671.462600:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462606:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e358 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462613:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bee2c76a700) 00010000:00010000:2.0:1789708671.462615:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708671.462618:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e358 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.462624:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e358 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.463552:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e34a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e405 expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.463570:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47e35f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e405 expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.463578:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee2c76a300) 00010000:00010000:2.0:1789708671.463581:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708671.463583:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5a00, rc 0) 00000100:00100000:2.0:1789708671.463703:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+9:15540:x1876645357135232:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1853us (2189us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789708671.463722:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:1.0:1789708671.479289:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.483242:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357135360 00000100:00100000:3.0:1789708671.483256:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357135360 00000100:00100000:3.0:1789708671.483712:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:3.0:1789708671.483737:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+9:15540:x1876645357135360:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789708671.483848:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+9:15540:x1876645357135360:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 113us (4590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708671.483855:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1789708671.497188:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708671.497233:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.497512:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357135488 00000100:00100000:3.0:1789708671.497523:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357135488 00000100:00100000:3.0:1789708671.497642:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357135616 00000100:00100000:3.0:1789708671.497646:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357135616 00000100:00100000:3.0:1789708671.497686:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:3.0:1789708671.497696:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+6:15540:x1876645357135488:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789708671.497825:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:1.0:1789708671.497837:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+9:15546:x1876645357135616:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708671.497847:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708671.497865:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47e36d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e40c expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.497915:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e374 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.497927:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e374 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.497938:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e374 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.497952:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e37b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.497959:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e37b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498054:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e37b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498098:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e374 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498105:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e374 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498120:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e374 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498127:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708671.498132:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e374 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498139:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e374 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498151:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769400) 00010000:00010000:1.0:1789708671.498155:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708671.498159:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e374 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498165:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498175:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e37b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498181:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e37b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708671.498183:0:17138:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 450us 00010000:00010000:1.0:1789708671.498187:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e37b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498192:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708671.498195:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e37b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498209:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e37b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498217:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bed08847c00) 00010000:00010000:1.0:1789708671.498220:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708671.498223:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e37b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498229:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e37b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498286:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47e36d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e40c expref: 10 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498298:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769400) 00010000:00010000:1.0:1789708671.498300:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708671.498304:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47e36d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e40c expref: 10 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.498314:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8600, rc 0) 00000100:00100000:1.0:1789708671.498374:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+9:15546:x1876645357135616:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 540us (1140us total) trans 0 rc 301/301 00000100:00100000:1.0:1789708671.498381:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00080000:2.0:1789708671.499770:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708671.501379:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.501822:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357135744 00000100:00100000:1.0:1789708671.501831:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357135744 00000100:00100000:2.0:1789708671.501953:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:2.0:1789708671.501961:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f84d004b-f450-4582-bbe2-71415469e27b+9:15546:x1876645357135744:12345-192.168.201.52@tcp:700:lfs.0 00000100:00100000:2.0:1789708671.502023:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f84d004b-f450-4582-bbe2-71415469e27b+9:15546:x1876645357135744:12345-192.168.201.52@tcp:700:lfs.0 Request processed in 63us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708671.502028:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789708671.504066:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.504141:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357136000 00000100:00100000:3.0:1789708671.504148:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357136000 00000100:00100000:3.0:1789708671.504201:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:3.0:1789708671.504207:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+9:15546:x1876645357136000:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:3.0:1789708671.504243:0:18837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708671.504363:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e2e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e387 expref: 9 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.504385:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769400) 00010000:00010000:3.0:1789708671.504436:0:18837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708671.504489:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.504498:0:18837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3f7 expref: 5 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.504512:0:18837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.504583:0:18837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3f7 expref: 5 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.504594:0:18837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3f7 expref: 5 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708671.504605:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365553536:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708671.504674:0:18837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed04215240 going to sleep for 11 seconds 00000100:00100000:0.0:1789708671.506177:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.506180:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365553536:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708671.506199:0:18837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708671.506225:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357136128 00000100:00100000:1.0:1789708671.506232:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357136128 00000100:00080000:0.0:1789708671.506290:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789708671.506317:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3f7 expref: 6 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708671.506375:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1789708671.506385:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:2396:x1876645357136128:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708671.506398:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708671.506404:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3f7 expref: 6 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.506415:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3f7 expref: 6 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.506431:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e320 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3f7 expref: 6 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.506445:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769400) 00010000:00010000:1.0:1789708671.506449:0:17126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.506457:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.506464:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.506491:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708671.506531:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2396:x1876645357136128:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 148us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.506538:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00010000:00010000:3.0:1789708671.506606:0:18837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.506615:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.506636:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.506645:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.506653:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508767:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508795:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508807:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708671.508826:0:18837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd1ed0d8 reply state 000000000c54b1ba transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508837:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508845:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:3.0:1789708671.508848:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708671.508852:0:18837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789708671.508858:0:18837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789708671.508866:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508874:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508881:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508888:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708671.508893:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508912:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508924:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769400) 00010000:00010000:3.0:1789708671.508926:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708671.508931:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508937:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e382 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708671.508954:0:18837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd1ed0d8 reply state 000000000c54b1ba transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508964:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.508971:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bee18087b00) 00010000:00010000:3.0:1789708671.508973:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708671.508976:0:18837:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789708671.509197:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+10:15546:x1876645357136000:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 4985us (5131us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789708671.509205:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:3.0:1789708671.512218:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+6:15540:x1876645357135488:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 14511us (15026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708671.512232:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00010000:00010000:2.0:1789708671.528537:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708671.558657:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.558943:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357136256 00000100:00100000:1.0:1789708671.558953:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357136256 00000100:00100000:1.0:1789708671.559015:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1789708671.559026:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+10:15554:x1876645357136256:12345-192.168.201.52@tcp:101:lctl.0 00010000:00010000:1.0:1789708671.559049:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708671.559070:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e397 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e413 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.559127:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47e39e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.559139:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47e39e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.559149:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47e39e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708671.559190:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789708671.559193:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708671.559229:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47e39e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.559251:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e397 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e413 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.559316:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47e39e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e413 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.559335:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:1.0:1789708671.559338:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708671.559355:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8600, rc 0) 00000100:00100000:1.0:1789708671.559403:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+11:15554:x1876645357136256:12345-192.168.201.52@tcp:101:lctl.0 Request processed in 379us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.559409:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:0.0:1789708671.584233:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.584321:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357136384 00000100:00100000:1.0:1789708671.584350:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357136384 00000100:00100000:1.0:1789708671.584417:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:1.0:1789708671.584428:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:15555:x1876645357136384:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708671.584448:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708671.584468:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e3a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e41a expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.584543:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e3ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.584561:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.584572:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708671.584614:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789708671.584618:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708671.584639:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.584662:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e3a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e41a expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.584679:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e3ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e41a expref: 6 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.584700:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:1.0:1789708671.584703:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708671.584706:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8e00, rc 0) 00000100:00100000:1.0:1789708671.584769:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:15555:x1876645357136384:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 344us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.584777:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:2.0:1789708671.586875:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.586972:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357136512 00000100:00100000:3.0:1789708671.586980:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357136512 00000100:00100000:3.0:1789708671.587061:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:3.0:1789708671.587080:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:15555:x1876645357136512:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708671.587097:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708671.587112:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e3b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e421 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.587162:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e3ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.587175:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e3ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.587185:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e3ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.587196:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e3c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.587203:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.587210:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587428:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e3c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587438:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587446:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708671.587483:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789708671.587487:0:17138:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708671.587515:0:17138:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587526:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e3ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587532:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e3ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587544:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e3ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587549:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ba00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708671.587553:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e3ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587560:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e3ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587570:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708671.587573:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708671.587577:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e3ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587583:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e3ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587594:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587600:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e3c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587605:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587609:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ac00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708671.587612:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587630:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e3c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587637:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bee18087b00) 00010000:00010000:2.0:1789708671.587639:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708671.587642:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e3c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587648:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e3c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587669:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e3b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e421 expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587680:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e421 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.587686:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708671.587689:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708671.587691:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5c00, rc 0) 00000100:00100000:2.0:1789708671.587739:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+7:15555:x1876645357136512:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 661us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708671.587745:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:0.0:1789708671.588994:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.589036:0:19637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357136640 00000100:00100000:1.0:1789708671.589042:0:19637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357136640 00000100:00080000:0.0:1789708671.589083:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789708671.589098:0:19637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1789708671.589108:0:19637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:15555:x1876645357136640:12345-192.168.201.52@tcp:900:lfs.0 00000100:00100000:1.0:1789708671.589156:0:19637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:15555:x1876645357136640:12345-192.168.201.52@tcp:900:lfs.0 Request processed in 49us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.589164:0:19637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789708671.590558:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708671.590674:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357136896 00000100:00100000:2.0:1789708671.590681:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357136896 00000100:00100000:2.0:1789708671.590726:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:2.0:1789708671.590737:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+7:15555:x1876645357136896:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708671.590763:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708671.590952:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e3cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e428 expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708671.591033:0:19935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789708671.591136:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e3cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e428 expref: 9 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.591149:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708671.591153:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708671.591158:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e3cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e428 expref: 9 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.591172:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5000, rc 0) 00000100:00100000:2.0:1789708671.591221:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+8:15555:x1876645357136896:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 481us (657us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789708671.591229:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:2.0:1789708671.592417:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.592463:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357137152 00000100:00100000:3.0:1789708671.592471:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357137152 00000100:00100000:3.0:1789708671.592593:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:3.0:1789708671.592599:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+8:15555:x1876645357137152:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:3.0:1789708671.592637:0:18837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708671.592655:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e3c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e421 expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.592696:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:3.0:1789708671.592701:0:18837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708671.592717:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.592726:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.592733:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708671.592866:0:18837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bebb95f reply state 00000000b1e4344c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.592875:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.592879:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:3.0:1789708671.592880:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789708671.592882:0:18837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789708671.592886:0:18837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789708671.592940:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+9:15555:x1876645357137152:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 339us (524us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789708671.592947:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:0.0:1789708671.594070:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.594112:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357137408 00000100:00100000:3.0:1789708671.594118:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357137408 00000100:00100000:3.0:1789708671.594149:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:3.0:1789708671.594157:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+9:15555:x1876645357137408:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708671.594301:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+10:15555:x1876645357137408:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 144us (233us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789708671.594317:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789708671.598661:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708671.599228:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357137664 00000100:00100000:2.0:1789708671.599238:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357137664 00000100:00100000:2.0:1789708671.599357:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708671.599370:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+10:15555:x1876645357137664:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708671.599394:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708671.599422:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e3e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e42f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599486:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e3eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599507:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e3eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599518:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e3eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599530:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e3f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599537:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599543:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708671.599633:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789708671.599691:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e3eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599696:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e3eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599702:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e3eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599708:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708671.599712:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e3eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599720:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e3eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599743:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708671.599746:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708671.599751:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e3eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599756:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e3eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599769:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599774:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e3f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599779:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e3f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599791:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708671.599794:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e3f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599800:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e3f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599806:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bee18087b00) 00010000:00010000:2.0:1789708671.599808:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708671.599811:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e3f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599816:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e3f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599856:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e3e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e42f expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599867:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708671.599870:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708671.599873:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e3e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e42f expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.599881:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5600, rc 0) 00000100:00100000:2.0:1789708671.599943:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+11:15555:x1876645357137664:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 576us (1290us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789708671.599952:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708671.602869:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708671.603106:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357137792 00000100:00100000:0.0:1789708671.603116:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357137792 00000100:00100000:0.0:1789708671.603187:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:0.0:1789708671.603197:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+11:15555:x1876645357137792:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708671.603220:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708671.603239:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47e400 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e436 expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.603869:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.603886:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.603897:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708671.603924:0:19935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789708671.603927:0:19935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708671.603947:0:19935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.603973:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47e400 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e436 expref: 13 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.603991:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e436 expref: 12 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708671.604001:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:0.0:1789708671.604004:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708671.604007:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0800, rc 0) 00000100:00100000:0.0:1789708671.604068:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+12:15555:x1876645357137792:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 872us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708671.604084:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:0.0:1789708671.607069:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.607185:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357137920 00000100:00100000:3.0:1789708671.607196:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357137920 00000100:00100000:3.0:1789708671.607257:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1789708671.607293:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+12:15555:x1876645357137920:12345-192.168.201.52@tcp:37:lfs.0 00000100:00100000:3.0:1789708671.610817:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+12:15555:x1876645357137920:12345-192.168.201.52@tcp:37:lfs.0 Request processed in 3519us (3745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708671.610831:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:2.0:1789708671.616925:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708671.617028:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357138176 00000100:00100000:0.0:1789708671.617037:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357138176 00000100:00100000:0.0:1789708671.617138:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:0.0:1789708671.617147:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2d984c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+12:15555:x1876645357138176:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789708671.617398:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2d984c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+13:15555:x1876645357138176:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 252us (482us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789708671.617405:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:0.0:1789708671.648858:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.651467:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357138304 00000100:00100000:1.0:1789708671.651479:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357138304 00000100:00100000:1.0:1789708671.651611:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:1.0:1789708671.651624:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+11:15561:x1876645357138304:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708671.651643:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708671.651662:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e40e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e43d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.651731:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e415 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.651743:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e415 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.651767:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e415 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.651777:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e41c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.651783:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e41c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.651789:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e41c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.651862:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47e423 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.651870:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47e423 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.651876:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47e423 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708671.652007:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789708671.652011:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708671.652050:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47e423 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652062:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e415 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652078:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e415 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652094:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e415 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652100:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708671.652104:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e415 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652111:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e415 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652121:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:1.0:1789708671.652124:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708671.652128:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e415 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652133:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e415 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652146:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e41c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652152:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e41c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652158:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e41c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652163:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708671.652166:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e41c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652181:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e41c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652189:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bee18087b00) 00010000:00010000:1.0:1789708671.652191:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708671.652195:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e41c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652200:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e41c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652228:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e40e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e43d expref: 13 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652239:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47e423 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e43d expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.652245:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:1.0:1789708671.652247:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789708671.652249:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9200, rc 0) 00000100:00100000:1.0:1789708671.652536:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+12:15561:x1876645357138304:12345-192.168.201.52@tcp:101:bash.0 Request processed in 915us (3685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.652544:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:2.0:1789708671.658186:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.658380:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357138432 00000100:00100000:3.0:1789708671.658390:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357138432 00000100:00100000:3.0:1789708671.658564:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789708671.658575:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f84d004b-f450-4582-bbe2-71415469e27b+6:15561:x1876645357138432:12345-192.168.201.52@tcp:900:bash.0 00000100:00100000:3.0:1789708671.658658:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f84d004b-f450-4582-bbe2-71415469e27b+6:15561:x1876645357138432:12345-192.168.201.52@tcp:900:bash.0 Request processed in 85us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708671.658665:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789708671.662439:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708671.662749:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357138688 00000100:00100000:2.0:1789708671.662759:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357138688 00000100:00100000:2.0:1789708671.662849:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1789708671.662860:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+12:15561:x1876645357138688:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708671.662880:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708671.662908:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e42a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e444 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.663007:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.663020:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e436 expref: 12 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.663039:0:17138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.663070:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e436 expref: 12 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.663082:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e436 expref: 12 pid: 19935 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708671.663095:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18003b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17138:1876645365553664:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708671.663169:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857000 going to sleep for 11 seconds 00000100:00100000:0.0:1789708671.667256:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.667410:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357138816 00000100:00100000:1.0:1789708671.667420:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357138816 00010000:00010000:1.0:1789708671.667457:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e436 expref: 13 pid: 19935 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708671.667524:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1789708671.667534:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+13:2396:x1876645357138816:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708671.667550:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708671.667557:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e436 expref: 13 pid: 19935 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.667570:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e436 expref: 13 pid: 19935 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.667591:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:1.0:1789708671.667597:0:17125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.667606:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.667613:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.667632:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708671.667685:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+13:2396:x1876645357138816:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 150us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.667692:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00010000:00010000:2.0:1789708671.667881:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e407 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e436 expref: 12 pid: 19935 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708671.667907:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18003b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17138:1876645365553664:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708671.667924:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.667932:0:17138:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.667938:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.667993:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668002:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668015:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668480:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668489:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668496:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708671.668504:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789708671.668526:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668533:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668539:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668546:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708671.668549:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668556:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668564:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708671.668567:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708671.668577:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668583:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e431 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708671.668593:0:17138:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090973a41 reply state 000000008069c49b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668602:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668607:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee2c76a700) 00010000:00010000:2.0:1789708671.668609:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789708671.668611:0:17138:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789708671.668640:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e42a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e444 expref: 15 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668652:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e444 expref: 14 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.668658:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708671.668660:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789708671.668662:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5000, rc 0) 00000100:00100000:2.0:1789708671.668908:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+15:15561:x1876645357138688:12345-192.168.201.52@tcp:101:bash.0 Request processed in 6049us (6476us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789708671.668916:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:1.0:1789708671.675161:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708671.675221:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357138944 00000100:00100000:0.0:1789708671.675231:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357138944 00000100:00100000:2.0:1789708671.675362:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:2.0:1789708671.675375:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+15:15561:x1876645357138944:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708671.675409:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708671.675438:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e44d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e44b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.675499:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.675510:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.675517:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708671.675556:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789708671.675559:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708671.675573:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.675580:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.675596:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e44d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e44b expref: 17 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.675609:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e44b expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.675615:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708671.675617:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708671.675619:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5e00, rc 0) 00000100:00100000:2.0:1789708671.675663:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+16:15561:x1876645357138944:12345-192.168.201.52@tcp:101:bash.0 Request processed in 294us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708671.675675:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:0.0:1789708671.676986:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.677031:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357139200 00000100:00100000:3.0:1789708671.677038:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357139200 00000100:00100000:3.0:1789708671.677073:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789708671.677083:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+16:15561:x1876645357139200:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:3.0:1789708671.677337:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+17:15561:x1876645357139200:12345-192.168.201.52@tcp:35:bash.0 Request processed in 255us (354us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789708671.677345:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1789708671.710602:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.710663:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357139456 00000100:00100000:1.0:1789708671.710672:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357139456 00000100:00100000:1.0:1789708671.710722:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1789708671.710748:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+17:15571:x1876645357139456:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708671.710773:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708671.710791:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e45b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e452 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708671.710879:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789708671.710962:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e45b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e452 expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.710973:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:1.0:1789708671.710975:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708671.710979:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e45b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e452 expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.710989:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8200, rc 0) 00000100:00100000:1.0:1789708671.711045:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+18:15571:x1876645357139456:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 299us (449us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789708671.711052:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1789708671.712746:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708671.712896:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357139712 00000100:00100000:0.0:1789708671.712909:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357139712 00000100:00100000:0.0:1789708671.712942:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789708671.712951:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+18:15571:x1876645357139712:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789708671.713161:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+19:15571:x1876645357139712:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 209us (418us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789708671.713170:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000040:00080000:1.0:1789708671.718494:0:17175:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708671.718503:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708671.718636:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789708671.718682:0:17175:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708671.718823:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:0.0:1789708671.741645:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708671.741718:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357139968 00000100:00100000:2.0:1789708671.741728:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357139968 00000100:00100000:2.0:1789708671.741790:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:2.0:1789708671.741802:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+19:15574:x1876645357139968:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708671.741826:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708671.741847:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e469 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e459 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.741954:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e470 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.741968:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.741980:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708671.741991:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789708671.742093:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e469 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e459 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.742111:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e470 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e459 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.742120:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708671.742123:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789708671.742127:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4200, rc 0) 00000100:00100000:2.0:1789708671.742197:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+21:15574:x1876645357139968:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 398us (561us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789708671.742217:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:2.0:1789708671.744126:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.744177:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357140096 00000100:00100000:1.0:1789708671.744185:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357140096 00000100:00100000:1.0:1789708671.744238:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:1.0:1789708671.744249:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+21:15574:x1876645357140096:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1789708671.744349:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e47e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.744364:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e47e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.744373:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e47e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.744404:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e47e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.744757:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e47e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.744764:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e47e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.744770:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708671.744774:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e47e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.744781:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e47e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.744793:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:1.0:1789708671.744797:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708671.744802:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e47e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.744808:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e47e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708671.744877:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+21:15574:x1876645357140096:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 630us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.744884:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:1.0:1789708671.879012:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708671.879079:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357140352 00000100:00100000:2.0:1789708671.879090:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357140352 00000100:00100000:2.0:1789708671.879159:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:2.0:1789708671.879170:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+21:15611:x1876645357140352:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:2.0:1789708671.879190:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708671.879216:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e485 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e460 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.879382:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.879398:0:17140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e444 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.879407:0:17140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e44b expref: 22 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.879415:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.879446:0:17140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e44b expref: 22 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.879458:0:17140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e44b expref: 22 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708671.879487:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876645365553792:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708671.879575:0:17140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e444 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.879584:0:17140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e444 expref: 22 pid: 17138 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708671.879593:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876645365553920:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708671.879624:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708671.880434:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876645365553920:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708671.880652:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876645365553792:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708671.880669:0:17140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708671.880782:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.880820:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357140480 00000100:00100000:3.0:1789708671.880825:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357140480 00010000:00010000:3.0:1789708671.880846:0:17891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e444 expref: 23 pid: 17138 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708671.880942:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:0.0:1789708671.880981:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708671.880984:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+23:2395:x1876645357140480:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708671.880996:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708671.881003:0:17891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e444 expref: 23 pid: 17138 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.881018:0:17891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e444 expref: 23 pid: 17138 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708671.881036:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357140608 00010000:00010000:3.0:1789708671.881037:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47e43f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e444 expref: 23 pid: 17138 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708671.881040:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357140608 00010000:00010000:3.0:1789708671.881057:0:17891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708671.881059:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e44b expref: 23 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.881063:0:17891:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.881079:0:17891:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708671.881085:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708671.881097:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:2.0:1789708671.881107:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+23:2396:x1876645357140608:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708671.881115:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708671.881122:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e44b expref: 23 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708671.881123:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+23:2395:x1876645357140480:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 172us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708671.881138:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00010000:00010000:2.0:1789708671.881151:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e44b expref: 23 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.881163:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47e454 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e44b expref: 22 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.881171:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708671.881175:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.881183:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.881191:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.881221:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708671.881242:0:17140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.881250:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708671.881253:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+21:2396:x1876645357140608:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 146us (272us total) trans 0 rc 0/0 00000004:00200000:1.0:1789708671.881296:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:2.0:1789708671.881301:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00010000:00010000:1.0:1789708671.881433:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5400/0xf45f43947e47e485 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e460 expref: 22 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.881448:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e460 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.881455:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:1.0:1789708671.881457:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708671.881460:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5c00, rc 0) 00000100:00100000:1.0:1789708671.881503:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+21:15611:x1876645357140352:12345-192.168.201.52@tcp:101:dd.0 Request processed in 2335us (2499us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789708671.881511:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:0.0:1789708671.882329:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708671.882362:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357140736 00000100:00100000:2.0:1789708671.882368:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357140736 00000100:00100000:2.0:1789708671.882399:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:2.0:1789708671.882406:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+21:15611:x1876645357140736:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:2.0:1789708671.882421:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708671.882431:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e49a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e467 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.882465:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.882474:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.882482:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.882567:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e49a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e467 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.882577:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e467 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.882582:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708671.882583:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789708671.882585:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd000, rc 0) 00000100:00100000:2.0:1789708671.882607:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+22:15611:x1876645357140736:12345-192.168.201.52@tcp:101:dd.0 Request processed in 203us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708671.882611:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:0.0:1789708671.883417:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.883456:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357140992 00000100:00100000:1.0:1789708671.883461:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357140992 00000100:00100000:1.0:1789708671.883497:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1789708671.883507:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+22:15611:x1876645357140992:12345-192.168.201.52@tcp:36:dd.0 00010000:00010000:1.0:1789708671.883643:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.883654:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.883671:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708671.883721:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:1.0:1789708671.883741:0:17139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cda52dc9 reply state 000000005376c977 transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.883752:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.883759:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:1.0:1789708671.883761:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708671.883764:0:17139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708671.883828:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+25:15611:x1876645357140992:12345-192.168.201.52@tcp:36:dd.0 Request processed in 323us (412us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789708671.883835:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000020:00080000:1.0:1789708671.883839:0:17139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789708671.910977:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789708671.983950:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.984025:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357141120 00000100:00100000:1.0:1789708671.984035:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357141120 00000100:00100000:1.0:1789708671.984090:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:1.0:1789708671.984101:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+25:15626:x1876645357141120:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:1.0:1789708671.984126:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708671.984145:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e4af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e46e expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984217:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e4b6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984231:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984241:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984253:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e4bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984309:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e4bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984342:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e4bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984438:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984449:0:17140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e460 expref: 26 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984458:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984489:0:17140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e460 expref: 26 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.984513:0:17140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e460 expref: 26 pid: 17140 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708671.984526:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876645365554048:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708671.984605:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee07a81f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708671.985784:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.985807:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876645365554048:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708671.985831:0:17140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708671.985836:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357141376 00000100:00100000:3.0:1789708671.985844:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357141376 00000100:00100000:3.0:1789708671.985882:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789708671.985889:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+27:14875:x1876645357141376:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789708671.986078:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+28:14875:x1876645357141376:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 188us (297us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789708671.986087:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789708671.986752:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708671.986795:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357141504 00000100:00100000:1.0:1789708671.986799:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357141504 00010000:00010000:1.0:1789708671.986818:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e460 expref: 28 pid: 17140 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708671.986850:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:1.0:1789708671.986858:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+28:2395:x1876645357141504:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708671.986870:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708671.986876:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e460 expref: 28 pid: 17140 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.986887:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e460 expref: 28 pid: 17140 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.986902:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5c00/0xf45f43947e47e48c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e460 expref: 28 pid: 17140 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.986921:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:1.0:1789708671.986925:0:17126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.986931:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.986936:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708671.986953:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708671.986976:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+27:2395:x1876645357141504:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 121us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.986981:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00010000:00010000:2.0:1789708671.986994:0:17140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987004:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708671.987040:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789708671.987049:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708671.987079:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987089:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987099:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987104:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e4b6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987110:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987116:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708671.987120:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987127:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e4b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987136:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708671.987139:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708671.987143:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e4b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987149:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47e4b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987160:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e4bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987177:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e4bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987183:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e4bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987188:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708671.987191:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e4bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987197:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e4bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987206:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee2c76a700) 00010000:00010000:2.0:1789708671.987217:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708671.987220:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e4bd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987226:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e4bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987255:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e4af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e46e expref: 27 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987313:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e46e expref: 26 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708671.987336:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708671.987339:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708671.987347:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9000, rc 0) 00000100:00100000:2.0:1789708671.987379:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+26:15626:x1876645357141120:12345-192.168.201.52@tcp:101:stat.0 Request processed in 3280us (3438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708671.987386:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:0.0:1789708672.010782:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.010855:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357141760 00000100:00100000:2.0:1789708672.010864:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357141760 00000100:00100000:2.0:1789708672.010921:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:2.0:1789708672.010932:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+26:15632:x1876645357141760:12345-192.168.201.52@tcp:36:truncate.0 00010000:00010000:2.0:1789708672.010986:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708672.011011:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e46e expref: 26 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.011031:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.011036:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708672.011189:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.011202:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.011212:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708672.011255:0:17138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789708672.011314:0:17138:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011a40afc reply state 00000000cab57891 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.011345:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.011368:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.011370:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789708672.011373:0:17138:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708672.011484:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+28:15632:x1876645357141760:12345-192.168.201.52@tcp:36:truncate.0 Request processed in 553us (709us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789708672.011492:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000020:00080000:2.0:1789708672.011497:0:17138:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789708672.031980:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.032060:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357141888 00000100:00100000:2.0:1789708672.032069:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357141888 00000100:00100000:2.0:1789708672.032129:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:2.0:1789708672.032140:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:14877:x1876645357141888:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708672.032157:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.032174:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebce00/0xf45f43947e47e4d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e475 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.032195:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebce00/0xf45f43947e47e4d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e475 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.032203:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebce00/0xf45f43947e47e4d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e475 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.032209:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebce00, rc 0) 00000100:00100000:2.0:1789708672.032251:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:14877:x1876645357141888:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 114us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.032255:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:0.0:1789708672.033034:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.033078:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357142016 00000100:00100000:3.0:1789708672.033084:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357142016 00000100:00100000:3.0:1789708672.033117:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:3.0:1789708672.033126:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:14877:x1876645357142016:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.033228:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:14877:x1876645357142016:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 104us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708672.033234:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:0.0:1789708672.033867:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.033914:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357142144 00000100:00100000:2.0:1789708672.033919:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357142144 00000100:00100000:2.0:1789708672.033955:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:2.0:1789708672.033961:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0985a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:14877:x1876645357142144:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708672.034053:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0985a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:14877:x1876645357142144:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 92us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.034069:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:0.0:1789708672.035640:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.035701:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357142272 00000100:00100000:3.0:1789708672.035707:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357142272 00000100:00100000:3.0:1789708672.035741:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:3.0:1789708672.035750:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:14877:x1876645357142272:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708672.035759:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708672.035773:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee1103b800/0xf45f43947e47e4d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e47c expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.035795:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee1103b800/0xf45f43947e47e4d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e47c expref: 13 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.035804:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee1103b800/0xf45f43947e47e4d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e47c expref: 13 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.035812:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103b800, rc 0) 00000100:00100000:3.0:1789708672.035846:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:14877:x1876645357142272:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708672.035862:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:0.0:1789708672.036499:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.036553:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357142400 00000100:00100000:2.0:1789708672.036559:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357142400 00000100:00100000:2.0:1789708672.036588:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:2.0:1789708672.036595:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:14877:x1876645357142400:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708672.036677:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:14877:x1876645357142400:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 82us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.036685:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:0.0:1789708672.037289:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.037341:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357142528 00000100:00100000:3.0:1789708672.037346:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357142528 00000100:00100000:3.0:1789708672.037373:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:3.0:1789708672.037380:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:14877:x1876645357142528:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.037466:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:14877:x1876645357142528:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 85us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708672.037474:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:0.0:1789708672.065420:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708672.065487:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357142656 00000100:00100000:1.0:1789708672.065496:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357142656 00000100:00100000:1.0:1789708672.065556:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:1.0:1789708672.065573:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+28:15648:x1876645357142656:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:1.0:1789708672.065593:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708672.065609:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47e4e0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e483 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065663:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e4e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065674:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065696:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065703:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e4ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065709:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e4ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065715:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e4ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065781:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065788:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065792:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708672.065824:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1789708672.065827:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708672.065843:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065850:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065856:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065866:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e4e7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065871:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065874:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708672.065877:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065882:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e4e7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065890:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:1.0:1789708672.065892:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708672.065895:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e4e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065899:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e4e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065909:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e4ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065912:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e4ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065916:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e4ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065918:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708672.065923:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e4ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065927:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e4ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065931:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee2c76a700) 00010000:00010000:1.0:1789708672.065932:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708672.065934:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e4ee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065937:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e4ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065955:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8800/0xf45f43947e47e4e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e483 expref: 30 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065963:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e483 expref: 29 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.065967:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:1.0:1789708672.065968:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708672.065969:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9000, rc 0) 00000100:00100000:1.0:1789708672.066012:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+29:15648:x1876645357142656:12345-192.168.201.52@tcp:101:stat.0 Request processed in 441us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708672.066017:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:0.0:1789708672.099146:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.099214:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357142912 00000100:00100000:2.0:1789708672.099225:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357142912 00000100:00100000:2.0:1789708672.099347:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:2.0:1789708672.099359:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+29:15658:x1876645357142912:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708672.099381:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.099401:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc800/0xf45f43947e47e4fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e48a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708672.099496:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789708672.099589:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc800/0xf45f43947e47e4fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e48a expref: 31 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.099602:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708672.099606:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708672.099622:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc800/0xf45f43947e47e4fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e48a expref: 31 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.099635:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc800, rc 0) 00000100:00100000:2.0:1789708672.099688:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+30:15658:x1876645357142912:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 333us (554us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789708672.099696:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:3.0:1789708672.100906:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708672.100948:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357143168 00000100:00100000:0.0:1789708672.100955:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357143168 00000100:00100000:0.0:1789708672.100991:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1789708672.100999:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+30:15658:x1876645357143168:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789708672.101112:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+31:15658:x1876645357143168:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 114us (207us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789708672.101117:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1789708672.126415:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.126487:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357143424 00000100:00100000:2.0:1789708672.126498:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357143424 00000100:00100000:2.0:1789708672.126563:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:2.0:1789708672.126575:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+31:15664:x1876645357143424:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708672.126601:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.126622:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc800/0xf45f43947e47e50a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e491 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.126743:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.126758:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e483 expref: 32 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.126768:0:17138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.126801:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e483 expref: 32 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.126815:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e483 expref: 32 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.126847:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17138:1876645365554176:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708672.126923:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.127692:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17138:1876645365554176:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708672.127709:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708672.127959:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.128036:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357143552 00000100:00100000:3.0:1789708672.128042:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357143552 00010000:00010000:3.0:1789708672.128067:0:17891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e483 expref: 33 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.128101:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1789708672.128111:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36240050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+33:2396:x1876645357143552:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708672.128121:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708672.128127:0:17891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e483 expref: 33 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.128138:0:17891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e483 expref: 33 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.128156:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e4f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e483 expref: 33 pid: 17139 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.128179:0:17891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:3.0:1789708672.128184:0:17891:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.128192:0:17891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.128199:0:17891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.128221:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708672.128236:0:17138:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.128244:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708672.128255:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000100:00100000:3.0:1789708672.128284:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36240050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+32:2396:x1876645357143552:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 172us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708672.128293:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00010000:00010000:2.0:1789708672.128527:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc800/0xf45f43947e47e50a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e491 expref: 33 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.128541:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e491 expref: 32 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.128549:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.128551:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708672.128553:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebca00, rc 0) 00000100:00100000:2.0:1789708672.128578:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+32:15664:x1876645357143424:12345-192.168.201.52@tcp:101:bash.0 Request processed in 2008us (2174us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789708672.128583:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:0.0:1789708672.129357:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708672.129391:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357143808 00000100:00100000:1.0:1789708672.129396:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357143808 00000100:00100000:1.0:1789708672.129423:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:1.0:1789708672.129429:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+32:15664:x1876645357143808:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:1.0:1789708672.129584:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.129592:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.129598:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708672.129627:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:1.0:1789708672.129640:0:17139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1fcaa49 reply state 00000000ee521644 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.129647:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.129652:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:1.0:1789708672.129653:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708672.129655:0:17139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708672.129695:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+35:15664:x1876645357143808:12345-192.168.201.52@tcp:36:bash.0 Request processed in 267us (339us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789708672.129700:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000020:00080000:1.0:1789708672.129702:0:17139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789708672.131604:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.131647:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357143936 00000100:00100000:2.0:1789708672.131668:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357143936 00000100:00100000:2.0:1789708672.131709:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:2.0:1789708672.131718:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+35:15664:x1876645357143936:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708672.131730:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.131740:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47e526 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e498 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.131790:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.131801:0:17140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e491 expref: 36 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.131809:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.131833:0:17140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e491 expref: 36 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.131845:0:17140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e491 expref: 36 pid: 17138 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.131856:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876645365554304:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708672.131904:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.132492:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876645365554304:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708672.132502:0:17140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.132704:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708672.132751:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357144064 00000100:00100000:0.0:1789708672.132756:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357144064 00010000:00010000:0.0:1789708672.132776:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e491 expref: 37 pid: 17138 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708672.132816:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1789708672.132825:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+37:2395:x1876645357144064:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708672.132834:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708672.132840:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e491 expref: 37 pid: 17138 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.132852:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e491 expref: 37 pid: 17138 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.132866:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e511 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e491 expref: 37 pid: 17138 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.132877:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:0.0:1789708672.132882:0:17125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.132889:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.132896:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.132914:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708672.132944:0:17140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708672.132946:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+36:2395:x1876645357144064:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 124us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708672.132953:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00010000:00010000:2.0:1789708672.132963:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708672.132990:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789708672.132995:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708672.133009:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.133031:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47e526 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e498 expref: 36 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.133044:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e498 expref: 35 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.133058:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.133061:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708672.133063:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc400, rc 0) 00000100:00100000:2.0:1789708672.133095:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+35:15664:x1876645357143936:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1379us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.133102:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:1.0:1789708672.133905:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.133939:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357144320 00000100:00100000:3.0:1789708672.133945:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357144320 00000100:00100000:3.0:1789708672.133976:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1789708672.133984:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+35:15664:x1876645357144320:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:3.0:1789708672.134090:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+36:15664:x1876645357144320:12345-192.168.201.52@tcp:35:bash.0 Request processed in 107us (184us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1789708672.134098:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:0.0:1789708672.159251:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.159347:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357144576 00000100:00100000:2.0:1789708672.159356:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357144576 00000100:00100000:2.0:1789708672.159415:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1789708672.159426:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+36:15674:x1876645357144576:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708672.159449:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.159465:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47e534 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e49f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.159558:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc800/0xf45f43947e47e53b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.159571:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc800/0xf45f43947e47e53b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.159581:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc800/0xf45f43947e47e53b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708672.159592:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789708672.159673:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47e534 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e49f expref: 39 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.159684:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc800/0xf45f43947e47e53b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e49f expref: 38 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.159691:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708672.159694:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708672.159697:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc800, rc 0) 00000100:00100000:2.0:1789708672.159753:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+38:15674:x1876645357144576:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 329us (508us total) trans 8589934617 rc 0/0 00000100:00100000:2.0:1789708672.159760:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:1.0:1789708672.160731:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.160761:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357144704 00000100:00100000:2.0:1789708672.160765:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357144704 00000100:00100000:2.0:1789708672.160788:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:2.0:1789708672.160792:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+38:15674:x1876645357144704:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:2.0:1789708672.160818:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e549 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160829:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e549 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160834:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e549 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160840:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e550 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160845:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e550 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160849:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e550 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160893:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160898:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160902:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708672.160923:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160930:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e549 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160933:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e549 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160944:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e549 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160948:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.160951:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e549 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160955:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e549 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160961:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708672.160963:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708672.160965:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e549 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160969:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e549 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160975:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e550 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160978:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e550 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160982:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e550 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160985:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.160986:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e550 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160995:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e550 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.160999:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee2c76a700) 00010000:00010000:2.0:1789708672.161001:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708672.161002:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e550 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.161005:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e550 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.161011:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.161014:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.161017:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.161019:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.161021:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.161024:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.161028:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.161029:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708672.161031:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.161039:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e557 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.161067:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+38:15674:x1876645357144704:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 275us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.161072:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 10000000:01000000:1.0:1789708672.166339:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789708672.166345:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee30700000 from 13 10000000:01000000:1.0:1789708672.166349:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708672.166382:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.166398:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.166412:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.166431:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365554432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789708672.166476:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708672.166511:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365554432 00000100:00100000:1.0:1789708672.166513:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee07a81f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.166517:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365554432 00000100:00100000:2.0:1789708672.166556:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789708672.166564:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:17136:x1876645365554432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708672.166576:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.166588:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47e565 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e55e expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.166607:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47e565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e55e expref: 21 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.166614:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47e565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e55e expref: 21 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.166620:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebde00, rc 0) 00000100:00100000:2.0:1789708672.166658:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:17136:x1876645365554432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.166665:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789708672.166690:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365554432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708672.166704:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.166712:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.166757:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365554560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708672.166775:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708672.166788:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee07a81f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708672.166822:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365554560 00000100:00100000:3.0:1789708672.166828:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365554560 00000100:00100000:3.0:1789708672.166859:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789708672.166868:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:17136:x1876645365554560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.166968:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:17136:x1876645365554560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708672.166982:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789708672.166985:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365554560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708672.167019:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365554688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708672.167047:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708672.167059:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee07a81f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.167077:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365554688 00000100:00100000:2.0:1789708672.167081:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365554688 00000100:00100000:2.0:1789708672.167103:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789708672.167109:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee182a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:17136:x1876645365554688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708672.167193:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee182a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:17136:x1876645365554688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.167199:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789708672.167214:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365554688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789708672.167948:0:20278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789708672.168034:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789708672.168068:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708672.168075:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.168085:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708672.168093:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708672.168095:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed0a047000 from 13 10000000:01000000:3.0:1789708672.168097:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708672.168112:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.168119:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.168126:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.168138:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365554816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.168165:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708672.168192:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed042159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708672.168215:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365554816 00000100:00100000:0.0:1789708672.168220:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365554816 00000100:00100000:0.0:1789708672.168249:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789708672.168255:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0a8a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:17136:x1876645365554816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708672.168298:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708672.168306:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d1a00/0xf45f43947e47e573 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e56c expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.168334:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d1a00/0xf45f43947e47e573 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e56c expref: 22 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.168343:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d1a00/0xf45f43947e47e573 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e56c expref: 22 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.168349:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708672.168386:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0a8a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:17136:x1876645365554816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708672.168393:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789708672.168428:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365554816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708672.168440:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.168449:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.168503:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365554944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.168531:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708672.168556:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed042159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.168563:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365554944 00000100:00100000:2.0:1789708672.168568:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365554944 00000100:00100000:2.0:1789708672.168590:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789708672.168594:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0a8a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:17136:x1876645365554944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708672.168641:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0a8a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:17136:x1876645365554944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 47us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.168646:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789708672.168678:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365554944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.168712:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.168753:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708672.168773:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed042159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708672.168782:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365555072 00000100:00100000:0.0:1789708672.168786:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365555072 00000100:00100000:0.0:1789708672.168807:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789708672.168811:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:17136:x1876645365555072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708672.168872:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:17136:x1876645365555072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708672.168877:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789708672.168906:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789708672.169511:0:20279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789708672.169593:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789708672.169615:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708672.169621:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.169629:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708672.169637:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708672.169639:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee0446d000 from 13 10000000:01000000:3.0:1789708672.169641:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708672.169654:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.169661:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.169669:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.169687:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.169711:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708672.169735:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed042159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.169742:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365555200 00000100:00100000:2.0:1789708672.169746:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365555200 00000100:00100000:2.0:1789708672.169767:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789708672.169771:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:17136:x1876645365555200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708672.169776:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.169781:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc600/0xf45f43947e47e581 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e57a expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.169792:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc600/0xf45f43947e47e581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e57a expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.169797:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc600/0xf45f43947e47e581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e57a expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.169802:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc600, rc 0) 00000100:00100000:2.0:1789708672.169823:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:17136:x1876645365555200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.169833:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789708672.169862:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708672.169872:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.169880:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.169915:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.169940:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708672.169957:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed042159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708672.169975:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365555328 00000100:00100000:0.0:1789708672.169981:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365555328 00000100:00100000:0.0:1789708672.170017:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789708672.170025:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:17136:x1876645365555328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708672.170097:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:17136:x1876645365555328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708672.170105:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789708672.170126:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.170156:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.170187:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708672.170204:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed042159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.170211:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365555456 00000100:00100000:2.0:1789708672.170214:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365555456 00000100:00100000:2.0:1789708672.170233:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789708672.170237:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:17136:x1876645365555456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708672.170322:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:17136:x1876645365555456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.170328:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789708672.170349:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789708672.170866:0:20280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789708672.170917:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789708672.170940:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708672.170946:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.170953:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708672.170966:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708672.170967:0:17136:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed0a28c800 from 13 10000000:01000000:3.0:1789708672.170969:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708672.170982:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.170989:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.170997:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.171008:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.171032:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708672.171052:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365555584 00000100:00100000:0.0:1789708672.171056:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365555584 00000100:00100000:3.0:1789708672.171058:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed042159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708672.171081:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789708672.171086:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:17136:x1876645365555584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708672.171091:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708672.171097:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d0000/0xf45f43947e47e58f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e588 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.171107:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d0000/0xf45f43947e47e58f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e588 expref: 24 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.171112:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d0000/0xf45f43947e47e58f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e588 expref: 24 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.171116:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0000, rc 0) 00000100:00100000:0.0:1789708672.171141:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:17136:x1876645365555584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 54us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708672.171146:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789708672.171162:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708672.171173:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.171182:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.171216:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.171240:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708672.171284:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed042159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.171293:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365555712 00000100:00100000:2.0:1789708672.171298:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365555712 00000100:00100000:2.0:1789708672.171333:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789708672.171339:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:17136:x1876645365555712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708672.171393:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:17136:x1876645365555712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.171401:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789708672.171414:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.171447:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708672.171482:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708672.171504:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365555840 00000100:00100000:0.0:1789708672.171507:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365555840 00000100:00100000:3.0:1789708672.171509:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed042159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708672.171531:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789708672.171536:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:17136:x1876645365555840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708672.171613:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:17136:x1876645365555840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708672.171621:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789708672.171634:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fda82b2e-0d6b-4cb4-a087-54f6744e5277:17136:1876645365555840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789708672.172103:0:20281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789708672.172160:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789708672.172182:0:17136:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708672.172188:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.172196:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.175579:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.175626:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357144960 00000100:00100000:2.0:1789708672.175634:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357144960 00000100:00100000:2.0:1789708672.175668:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:2.0:1789708672.175675:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+38:15677:x1876645357144960:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708672.175690:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.175705:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e596 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4a6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175765:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e59d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175775:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e59d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175791:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e59d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175799:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175803:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175807:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175883:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175888:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175892:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708672.175899:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789708672.175952:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e59d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175956:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e59d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175961:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e59d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175964:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.175973:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e59d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175978:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e59d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175986:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708672.175989:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708672.175991:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e59d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.175995:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e59d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.176002:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.176005:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.176009:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.176012:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.176014:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.176017:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.176020:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee2c76a700) 00010000:00010000:2.0:1789708672.176022:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708672.176027:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5a4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.176031:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.176054:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e596 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4a6 expref: 41 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.176061:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4a6 expref: 40 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.176065:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.176067:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708672.176069:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebda00, rc 0) 00000100:00100000:2.0:1789708672.176108:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+40:15677:x1876645357144960:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 433us (536us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1789708672.176112:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:0.0:1789708672.177073:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708672.177097:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.177104:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357145088 00000100:00100000:2.0:1789708672.177108:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357145088 00000100:00100000:2.0:1789708672.177139:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1789708672.177142:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357145344 00000100:00100000:2.0:1789708672.177148:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+40:2396:x1876645357145088:12345-192.168.201.52@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789708672.177150:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357145344 00010000:00010000:2.0:1789708672.177156:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708672.177167:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4a6 expref: 41 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.177175:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.177177:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708672.177188:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1789708672.177198:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2d986c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+40:15677:x1876645357145344:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789708672.177208:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+40:2396:x1876645357145088:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 61us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.177213:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1789708672.177392:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2d986c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+40:15677:x1876645357145344:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 194us (291us total) trans 8589934619 rc 0/0 00000100:00100000:3.0:1789708672.177400:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:0.0:1789708672.177973:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.178001:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357145472 00000100:00100000:2.0:1789708672.178005:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357145472 00000100:00100000:2.0:1789708672.178027:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:2.0:1789708672.178031:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+40:15677:x1876645357145472:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:2.0:1789708672.178051:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.178058:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.178063:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.178074:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.178077:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.178081:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.178084:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebcc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.178086:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.178089:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.178102:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.178104:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708672.178106:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5b9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.178110:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.178137:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+40:15677:x1876645357145472:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 106us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.178141:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:1.0:1789708672.242327:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.242383:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357145600 00000100:00100000:2.0:1789708672.242391:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357145600 00000100:00100000:2.0:1789708672.242441:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:2.0:1789708672.242448:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+40:15696:x1876645357145600:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708672.242463:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.242480:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4ad expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.242529:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.242540:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.242548:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708672.242591:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789708672.242605:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708672.242620:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.242637:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ad expref: 42 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.242649:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ad expref: 41 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.242654:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708672.242657:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708672.242659:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebda00, rc 0) 00000100:00100000:2.0:1789708672.242704:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+41:15696:x1876645357145600:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 257us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.242708:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:1.0:1789708672.244623:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708672.244669:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357145984 00000100:00100000:0.0:1789708672.244676:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357145984 00000100:00100000:0.0:1789708672.244715:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789708672.244735:0:17141:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1789708672.244740:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+41:15696:x1876645357145984:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708672.244744:0:17141:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1789708672.244938:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+42:15696:x1876645357145984:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 199us (317us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789708672.244946:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:0.0:1789708672.245552:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708672.245590:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357146112 00000100:00100000:1.0:1789708672.245594:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357146112 00000100:00100000:1.0:1789708672.245624:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:1.0:1789708672.245632:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+42:15696:x1876645357146112:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:1.0:1789708672.245642:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789708672.245659:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e52d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e498 expref: 42 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.245673:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47e470 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e459 expref: 41 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.245679:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:1.0:1789708672.245682:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708672.245704:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+40:15696:x1876645357146112:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708672.245711:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:1.0:1789708672.246197:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.246233:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357146240 00000100:00100000:2.0:1789708672.246237:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357146240 00000100:00100000:2.0:1789708672.246284:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:2.0:1789708672.246293:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+40:15696:x1876645357146240:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:2.0:1789708672.246357:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e5ce lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.246366:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e5ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.246373:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e5ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708672.246841:0:17140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708672.246867:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789708672.246948:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789708672.246985:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+40:15696:x1876645357146240:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 695us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.246990:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:0.0:1789708672.255470:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.255530:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357146368 00000100:00100000:2.0:1789708672.255539:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357146368 00000100:00100000:2.0:1789708672.255595:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:2.0:1789708672.255603:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+40:15698:x1876645357146368:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708672.255619:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.255634:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4b4 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255712:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5dc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255724:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255731:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255738:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e5e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255743:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255747:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255814:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255820:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255824:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708672.255858:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789708672.255861:0:17138:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708672.255875:0:17138:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255882:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255888:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255892:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5dc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255896:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255900:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.255902:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255907:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5dc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255920:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708672.255922:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708672.255926:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255930:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255938:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255942:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e5e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255945:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255948:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.255950:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255953:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255956:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee2c76a700) 00010000:00010000:2.0:1789708672.255958:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708672.255960:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e5e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255963:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e5e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255985:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e5d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4b4 expref: 42 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255994:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4b4 expref: 41 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.255998:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.256000:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708672.256001:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd400, rc 0) 00000100:00100000:2.0:1789708672.256045:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+41:15698:x1876645357146368:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 443us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.256049:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000001:00100000:2.0:1789708672.359445:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000001:00100000:2.0:1789708672.359458:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f84d004b-f450-4582-bbe2-71415469e27b 00000001:00100000:1.0:1789708672.361208:0:17871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000001:00100000:1.0:1789708672.361217:0:17871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f84d004b-f450-4582-bbe2-71415469e27b 00010000:00010000:2.0:1789708672.551504:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708672.622034:0:20320:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789708672.622043:0:20320:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708672.622075:0:20320:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789708672.622086:0:20320:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789708672.735449:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708672.735488:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708672.735516:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.735518:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357146624 00000100:00100000:2.0:1789708672.735530:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357146624 00000100:00100000:3.0:1789708672.735538:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357146880 00000100:00100000:3.0:1789708672.735545:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357146880 00000100:00100000:0.0:1789708672.735564:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.735596:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357147136 00000100:00100000:0.0:1789708672.735597:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.735603:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357147136 00000100:00100000:3.0:1789708672.735612:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357147392 00000100:00100000:3.0:1789708672.735617:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357147392 00000100:00100000:0.0:1789708672.735631:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.735640:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789708672.735654:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+5:2398:x1876645357146624:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708672.735661:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357146752 00000100:00100000:3.0:1789708672.735666:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357146752 00000100:00100000:0.0:1789708672.735671:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.735700:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1789708672.735710:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+5:2398:x1876645357146880:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708672.735731:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+5:2398:x1876645357146624:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 80us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.735741:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:1.0:1789708672.735760:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357147008 00000100:00100000:2.0:1789708672.735763:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1789708672.735771:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2398:x1876645357147136:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708672.735778:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357147008 00000100:00100000:1.0:1789708672.735815:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:1.0:1789708672.735823:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+12:2398:x1876645357147008:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708672.736883:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+5:2398:x1876645357146880:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 1174us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708672.736891:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.736896:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1789708672.736910:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357147264 00000100:00100000:3.0:1789708672.736914:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357147264 00000100:00100000:2.0:1789708672.736915:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2398:x1876645357147136:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 1142us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.736925:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:3.0:1789708672.736934:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1789708672.736941:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2398:x1876645357147392:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708672.736959:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357146496 00000100:00100000:2.0:1789708672.736965:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357146496 00000100:00100000:3.0:1789708672.736966:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2398:x1876645357147392:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 25us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708672.736972:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1789708672.736987:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789708672.736992:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+5:2398:x1876645357146752:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708672.737003:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00100000:3.0:1789708672.737009:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+5:2398:x1876645357146752:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 17us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.737016:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:2398:x1876645357146496:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708672.737019:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789708672.737041:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:3.0:1789708672.737051:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2398:x1876645357147264:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708672.737054:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:2398:x1876645357146496:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 42us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.737063:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00100000:3.0:1789708672.737094:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2398:x1876645357147264:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00080000:2.0:1789708672.737129:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789708672.737135:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708672.737180:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1789708672.737280:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+12:2398:x1876645357147008:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 1430us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708672.737289:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000040:00080000:1.0:1789708672.742461:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789708672.742469:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708672.742499:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789708672.742512:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789708672.742645:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17175:1876645365555968:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789708672.742720:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708672.743795:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17175:1876645365555968:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789708672.744571:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.744642:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357147520 00000100:00100000:2.0:1789708672.744649:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357147520 00000100:00100000:2.0:1789708672.744711:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:2.0:1789708672.744722:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+41:15710:x1876645357147520:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789708672.744760:0:17139:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789708672.744850:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+41:15710:x1876645357147520:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 130us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.744858:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:0.0:1789708672.745800:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.745856:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357147648 00000100:00100000:2.0:1789708672.745862:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357147648 00000100:00100000:2.0:1789708672.745892:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1789708672.745901:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+41:15710:x1876645357147648:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789708672.745952:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e5f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.745973:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.745984:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746040:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e5f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746048:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746054:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746076:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746084:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746091:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708672.746125:0:19935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789708672.746130:0:19935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708672.746141:0:19935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746153:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746172:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e5f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746178:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746183:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.746186:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746193:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746205:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee2c76a300) 00010000:00010000:2.0:1789708672.746207:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708672.746211:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e5f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746217:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e5f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746228:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746234:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e5f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746240:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746245:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebdc00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.746253:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746299:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e5f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746331:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9bee2c76aa00) 00010000:00010000:2.0:1789708672.746333:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708672.746335:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e5f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746340:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e5f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746353:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746357:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746361:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746364:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708672.746366:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746369:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746373:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.746374:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708672.746383:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.746389:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e5ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.746434:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+41:15710:x1876645357147648:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 534us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.746443:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:0.0:1789708672.747289:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708672.747350:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357147904 00000100:00100000:1.0:1789708672.747355:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357147904 00000100:00100000:1.0:1789708672.747387:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:1.0:1789708672.747395:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+41:15710:x1876645357147904:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708672.747406:0:18837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708672.747417:0:18837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e606 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4bb expref: -99 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747477:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e60d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747487:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e60d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747494:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e60d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708672.747510:0:18837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789708672.747573:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e60d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747580:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e60d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747586:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e60d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747591:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708672.747594:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e60d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747600:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e60d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747608:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:1.0:1789708672.747610:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708672.747613:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e60d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747619:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e60d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747648:0:18837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e606 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4bb expref: 43 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747657:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee2c76a300) 00010000:00010000:1.0:1789708672.747659:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708672.747668:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e606 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4bb expref: 43 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.747678:0:18837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9000, rc 0) 00000100:00100000:1.0:1789708672.747715:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+42:15710:x1876645357147904:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 321us (427us total) trans 8589934621 rc 301/301 00000100:00100000:1.0:1789708672.747722:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:0.0:1789708672.748531:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.748569:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357148032 00000100:00100000:2.0:1789708672.748575:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357148032 00000100:00100000:2.0:1789708672.748606:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:2.0:1789708672.748614:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+42:15710:x1876645357148032:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789708672.748631:0:17139:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789708672.748697:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+42:15710:x1876645357148032:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 84us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.748706:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:0.0:1789708672.749642:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.749685:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357148288 00000100:00100000:2.0:1789708672.749689:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357148288 00000100:00100000:2.0:1789708672.749722:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:2.0:1789708672.749731:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+42:15710:x1876645357148288:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708672.749748:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.749754:0:19935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789708672.749769:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e5c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ad expref: 42 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.749781:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708672.749785:0:19935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708672.749798:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e61b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4c2 expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789708672.750058:0:19935:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1789708672.750062:0:19935:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789708672.750071:0:19935:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1789708672.750165:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e622 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.750172:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.750177:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.750200:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e61b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c2 expref: 44 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.750208:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e622 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c2 expref: 43 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.750213:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76ae00) 00010000:00010000:2.0:1789708672.750215:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708672.750216:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebcc00, rc 0) 00000100:00100000:2.0:1789708672.750242:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+43:15710:x1876645357148288:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 514us (603us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789708672.750246:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:0.0:1789708672.751299:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708672.751347:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357148544 00000100:00100000:1.0:1789708672.751352:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357148544 00000100:00100000:1.0:1789708672.751379:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:1.0:1789708672.751385:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+43:15710:x1876645357148544:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789708672.751410:0:18837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708672.751419:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebcc00/0xf45f43947e47e622 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c2 expref: 43 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751429:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76ae00) 00010000:00010000:1.0:1789708672.751434:0:18837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708672.751443:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e630 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751450:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e630 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751456:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e630 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751501:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e637 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xda87f5db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751508:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda87f5db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751524:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda87f5db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751552:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e630 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751557:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e630 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751561:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e630 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751564:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708672.751567:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e630 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751572:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e630 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751578:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:1.0:1789708672.751580:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708672.751582:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e630 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751585:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e630 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751591:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda87f5db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751595:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e637 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda87f5db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751603:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e637 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda87f5db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751606:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708672.751608:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e637 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda87f5db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751611:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e637 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda87f5db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751615:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xda87f5db (ffff9bed08847900) 00010000:00010000:1.0:1789708672.751617:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708672.751618:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e637 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xda87f5db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.751621:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e637 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xda87f5db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.751656:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+42:15710:x1876645357148544:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 271us (360us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789708672.751660:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:0.0:1789708672.753763:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.754057:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357148672 00000100:00100000:2.0:1789708672.754065:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357148672 00000100:00100000:2.0:1789708672.754127:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:2.0:1789708672.754149:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+42:15710:x1876645357148672:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708672.754168:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.754187:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e63e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4c9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.754219:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.754231:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.754242:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.754372:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e63e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c9 expref: 44 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.754389:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c9 expref: 43 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.754398:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:2.0:1789708672.754400:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789708672.754403:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc400, rc 0) 00000100:00100000:2.0:1789708672.754450:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+43:15710:x1876645357148672:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 302us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.754456:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:0.0:1789708672.755678:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.755718:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357148928 00000100:00100000:2.0:1789708672.755724:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357148928 00000100:00100000:2.0:1789708672.755762:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:2.0:1789708672.755782:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+43:15710:x1876645357148928:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789708672.755842:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.755853:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.755862:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708672.756026:0:19935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1789708672.756037:0:19935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 243565775730ns, next at 244565772945ns, rc = 0 00000004:00010000:2.0:1789708672.756083:0:19935:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000686a08e3 reply state 000000004b677bf4 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.756095:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.756102:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:2.0:1789708672.756105:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789708672.756107:0:19935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708672.756174:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+45:15710:x1876645357148928:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 395us (500us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1789708672.756181:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:0.0:1789708672.759034:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708672.759136:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357149056 00000100:00100000:1.0:1789708672.759146:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357149056 00000100:00100000:1.0:1789708672.759196:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:1.0:1789708672.759206:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+45:15710:x1876645357149056:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708672.759230:0:18837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708672.759247:0:18837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e653 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4d0 expref: -99 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.759352:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e653 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d0 expref: 46 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.759366:0:18837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e653 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d0 expref: 46 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.759385:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:1.0:1789708672.759388:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708672.759391:0:18837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9000, rc 0) 00000100:00100000:1.0:1789708672.759438:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+46:15710:x1876645357149056:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 233us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708672.759445:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:0.0:1789708672.760436:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.760483:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357149184 00000100:00100000:2.0:1789708672.760489:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357149184 00000100:00100000:2.0:1789708672.760533:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789708672.760541:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+5:2395:x1876645357149184:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789708672.760701:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+6:2395:x1876645357149184:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 160us (265us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789708672.760716:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:1.0:1789708672.761632:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.761689:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357149440 00000100:00100000:3.0:1789708672.761695:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357149440 00000100:00100000:3.0:1789708672.761730:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1789708672.761738:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+46:15710:x1876645357149440:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789708672.761878:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+47:15710:x1876645357149440:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 140us (246us total) trans 8589934624 rc 0/0 00000100:00100000:3.0:1789708672.761885:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1789708672.763152:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.763190:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357149696 00000100:00100000:2.0:1789708672.763194:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357149696 00000100:00100000:2.0:1789708672.763224:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:2.0:1789708672.763230:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+47:15710:x1876645357149696:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789708672.763324:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+47:15710:x1876645357149696:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 93us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.763332:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:0.0:1789708672.764120:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.764157:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357149824 00000100:00100000:2.0:1789708672.764163:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357149824 00000100:00100000:2.0:1789708672.764192:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:2.0:1789708672.764201:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+47:15710:x1876645357149824:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708672.764211:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.764229:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e65a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4d7 expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.764317:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e661 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.764331:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e661 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.764342:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e661 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708672.764377:0:19935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708672.764391:0:19935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e661 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.764423:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e65a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d7 expref: 49 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.764436:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e661 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d7 expref: 48 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.764445:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:2.0:1789708672.764448:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789708672.764451:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebdc00, rc 0) 00000100:00100000:2.0:1789708672.764480:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+48:15710:x1876645357149824:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 281us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.764486:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:1.0:1789708672.765419:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.765457:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357149952 00000100:00100000:2.0:1789708672.765463:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357149952 00000100:00100000:2.0:1789708672.765499:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1789708672.765507:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f84d004b-f450-4582-bbe2-71415469e27b+6:2395:x1876645357149952:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708672.765515:0:18838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.765529:0:18838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47e668 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4de expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708672.765549:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacc980, blocks: 0x0 00010000:00010000:2.0:1789708672.765563:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=243s v=(0 0) 00010000:00010000:2.0:1789708672.765568:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708672.765575:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47e668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4de expref: 7 pid: 18838 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.765602:0:18838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47e668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4de expref: 7 pid: 18838 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.765613:0:18838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc200, rc 0) 00000100:00100000:2.0:1789708672.765643:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f84d004b-f450-4582-bbe2-71415469e27b+7:2395:x1876645357149952:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 138us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.765651:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:0.0:1789708672.766467:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708672.766502:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357150208 00000100:00100000:1.0:1789708672.766508:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357150208 00000100:00100000:1.0:1789708672.766541:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:1.0:1789708672.766547:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+48:15710:x1876645357150208:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789708672.766587:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+48:15710:x1876645357150208:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 41us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708672.766593:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:0.0:1789708672.767422:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.767454:0:19635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357150336 00000100:00100000:2.0:1789708672.767461:0:19635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357150336 00000100:00100000:2.0:1789708672.767488:0:19635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1789708672.767493:0:19635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f84d004b-f450-4582-bbe2-71415469e27b+7:15710:x1876645357150336:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708672.767499:0:19635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708672.767509:0:19635:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4e5 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.767522:0:19635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47e668 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4de expref: 8 pid: 18838 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.767527:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708672.767530:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708672.767533:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 8 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.767554:0:19635:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47e668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4de expref: 8 pid: 18838 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.767569:0:19635:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47e668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4de expref: 8 pid: 18838 timeout: 343 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.767579:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19635:1876645365556096:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708672.767621:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.768489:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19635:1876645365556096:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708672.768500:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:2.0:1789708672.768507:0:19635:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 8 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.768520:0:19635:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebda00, rc 0) 00000100:00100000:1.0:1789708672.768538:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357150464 00000100:00100000:1.0:1789708672.768542:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357150464 00000100:00100000:2.0:1789708672.768549:0:19635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f84d004b-f450-4582-bbe2-71415469e27b+9:15710:x1876645357150336:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1056us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.768556:0:19635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00010000:00010000:1.0:1789708672.768561:0:17891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47e668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4de expref: 9 pid: 18838 timeout: 343 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.768600:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:1.0:1789708672.768610:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+8:2395:x1876645357150464:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708672.768620:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708672.768634:0:17891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47e668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4de expref: 8 pid: 18838 timeout: 343 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.768642:0:17891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47e668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4de expref: 8 pid: 18838 timeout: 343 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.768653:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47e668 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4de expref: 8 pid: 18838 timeout: 343 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.768661:0:17891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708672.768663:0:17891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708672.768669:0:17891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 7 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.768674:0:17891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 7 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.768689:0:17891:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 7 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.768696:0:17891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:17891:1876645365556224:192.168.201.52@tcp:105: 00000100:00100000:1.0:1789708672.768729:0:17891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed088b5540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708672.769441:0:17891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:17891:1876645365556224:192.168.201.52@tcp:105: 00010000:00010000:1.0:1789708672.769450:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708672.769470:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+7:2395:x1876645357150464:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 865us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708672.769475:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:0.0:1789708672.770076:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.770120:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357150592 00000100:00100000:3.0:1789708672.770124:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357150592 00002000:00100000:3.0:1789708672.770147:0:18649:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff9bee11043800 x1876645357150592/t0(0) o4->f84d004b-f450-4582-bbe2-71415469e27b@192.168.201.52@tcp:58/0 lens 504/0 e 0 to 0 dl 1789708683 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789708672.770157:0:18649:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee11043800 with x1876645357150592 ext(0->8) 00002000:00010000:3.0:1789708672.770162:0:18649:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee11043800 00000100:00100000:3.0:1789708672.770183:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1789708672.770192:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357150592:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789708672.770789:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f84d004b-f450-4582-bbe2-71415469e27b+9:2396:x1876645357150592:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 598us (713us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789708672.770796:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00002000:00100000:3.0:1789708672.770803:0:18649:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff9bee11043800 x1876645357150592/t8589934596(0) o4->f84d004b-f450-4582-bbe2-71415469e27b@192.168.201.52@tcp:58/0 lens 504/448 e 0 to 0 dl 1789708683 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789708672.770812:0:18649:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee11043800 with x1876645357150592 ext(0->8) 00002000:00010000:3.0:1789708672.770815:0:18649:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee11043800 00000100:00100000:0.0:1789708672.771467:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.771505:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357150720 00000100:00100000:2.0:1789708672.771512:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357150720 00000100:00100000:2.0:1789708672.771543:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:2.0:1789708672.771551:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+48:15710:x1876645357150720:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789708672.772596:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000004:00080000:3.0:1789708672.772607:0:17119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1789708672.772665:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772677:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708672.772686:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1789708672.772687:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772697:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.772702:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772710:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772734:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bee18087b00) 00010000:00010000:0.0:1789708672.772738:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708672.772743:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772750:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a600/0xf45f43947e47e389 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772767:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772774:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772781:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772789:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.772793:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772800:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772809:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:0.0:1789708672.772812:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708672.772816:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772822:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a400/0xf45f43947e47e390 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772847:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772854:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772860:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772867:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.772871:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.772879:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+20:15710:x1876645357150720:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 1326us (1409us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708672.772880:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.772895:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00010000:00010000:0.0:1789708672.772899:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee2c76a700) 00010000:00010000:0.0:1789708672.772903:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708672.772907:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772914:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5600/0xf45f43947e47e438 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772930:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772937:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772944:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772955:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.772959:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772966:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772976:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:0.0:1789708672.772979:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708672.772983:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.772989:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e4a8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773002:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773009:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773015:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773020:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.773024:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773031:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773049:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:0.0:1789708672.773052:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708672.773055:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773061:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e4cb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.773070:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365556352:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789708672.773074:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773083:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773089:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773095:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.773098:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773105:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.773115:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708672.773115:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:0.0:1789708672.773121:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708672.773124:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773130:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8a00/0xf45f43947e47e51f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773154:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773161:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773168:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773174:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebca00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.773178:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773184:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.773193:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:0.0:1789708672.773196:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789708672.773200:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.773204:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365556352 00010000:00010000:0.0:1789708672.773207:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e64c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.773210:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365556352 00010000:00010000:1.0:1789708672.773325:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.773327:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789708672.773336:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.773345:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.773346:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365556352:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789708672.773358:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103be00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708672.773361:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.773366:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.773373:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:1.0:1789708672.773375:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789708672.773378:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708672.773382:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103be00/0xf45f43947e47e3dd lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708672.773431:0:19636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789708672.773435:0:19636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789708672 00002000:00010000:2.0:1789708672.773438:0:19636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789708672.773440:0:19636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789708672 -> 1789708672 00002000:00010000:2.0:1789708672.773442:0:19636:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789708672.773473:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365556352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (360us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789708672.773478:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789708672.773523:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789708672.773524:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bee18001880/2, rc 0, transno 8589934597 00000100:00100000:1.0:1789708672.773540:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365556352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789708672.776244:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.776298:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357150848 00000100:00100000:2.0:1789708672.776315:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357150848 00000100:00100000:2.0:1789708672.776355:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1789708672.776363:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+9:2395:x1876645357150848:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789708672.777318:0:18640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1789708672.777326:0:18640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000100:00100000:2.0:1789708672.777431:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+6:2395:x1876645357150848:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 1067us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708672.777444:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1789708672.778403:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708672.778443:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357151104 00000100:00100000:0.0:1789708672.778448:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357151104 00000100:00100000:0.0:1789708672.778479:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:0.0:1789708672.778485:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+15:15710:x1876645357151104:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789708672.778518:0:19935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708672.778546:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e661 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d7 expref: 15 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.778562:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:0.0:1789708672.778567:0:19935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708672.778590:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.778600:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.778607:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708672.778695:0:19935:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df28eb96 reply state 00000000ccfbfb29 transno 8589934625 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.778703:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.778707:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:0.0:1789708672.778708:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708672.778710:0:19935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708672.778767:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+16:15710:x1876645357151104:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 281us (364us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1789708672.778774:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:0.0:1789708672.779462:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.779505:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357151232 00000100:00100000:2.0:1789708672.779510:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357151232 00000100:00100000:2.0:1789708672.779539:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:2.0:1789708672.779548:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f84d004b-f450-4582-bbe2-71415469e27b+6:2396:x1876645357151232:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789708672.779627:0:18838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789708672.779631:0:18838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789708672 -> 1789708671 00002000:00010000:2.0:1789708672.779633:0:18838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789708671 00002000:00010000:2.0:1789708672.779635:0:18838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789708672 -> 1789708671 00002000:00010000:2.0:1789708672.779638:0:18838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789708672.779686:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357151232:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 140us (223us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789708672.779694:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1789708672.780767:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.780822:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357151488 00000100:00100000:3.0:1789708672.780828:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357151488 00000100:00100000:3.0:1789708672.780860:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:3.0:1789708672.780867:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+16:15710:x1876645357151488:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789708672.780902:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.780912:0:18837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c9 expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.780918:0:18837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.780945:0:18837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c9 expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.780958:0:18837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c9 expref: 16 pid: 17139 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.780972:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365556480:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708672.781032:0:18837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01759f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708672.783656:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365556480:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708672.783676:0:18837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.783832:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708672.783864:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357151616 00000100:00100000:0.0:1789708672.783870:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357151616 00010000:00010000:0.0:1789708672.783896:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c9 expref: 17 pid: 17139 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708672.783940:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:0.0:1789708672.783949:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+17:2395:x1876645357151616:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708672.783961:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708672.783968:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c9 expref: 17 pid: 17139 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.783977:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c9 expref: 17 pid: 17139 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.784000:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e645 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4c9 expref: 17 pid: 17139 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.784013:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:0.0:1789708672.784018:0:17125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.784026:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.784034:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.784058:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708672.784081:0:18837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.784092:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708672.784099:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+16:2395:x1876645357151616:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 151us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708672.784107:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00010000:00010000:3.0:1789708672.784128:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.784138:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.784145:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.784151:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ac00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708672.784156:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.784162:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.784170:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:3.0:1789708672.784172:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789708672.784175:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.784180:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e67d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.784320:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+15:15710:x1876645357151488:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 3351us (3454us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789708672.784329:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:1.0:1789708672.786337:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.786373:0:19635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357151744 00000100:00100000:2.0:1789708672.786378:0:19635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357151744 00000100:00100000:2.0:1789708672.786407:0:19635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:2.0:1789708672.786412:0:19635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357151744:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789708672.786439:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.786452:0:19635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 7 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.786458:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708672.786461:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708672.786464:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.786483:0:19635:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 7 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.786491:0:19635:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 7 pid: 19635 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.786504:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19635:1876645365556608:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708672.786559:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.787377:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19635:1876645365556608:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708672.787392:0:19635:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.787503:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.787545:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357151872 00000100:00100000:2.0:1789708672.787550:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357151872 00010000:00010000:2.0:1789708672.787568:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 8 pid: 19635 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.787593:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1789708672.787598:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+8:2395:x1876645357151872:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708672.787606:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708672.787621:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 8 pid: 19635 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.787629:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 8 pid: 19635 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.787640:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cca0796/0xf45f43947e47e66f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4e5 expref: 8 pid: 19635 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.787648:0:17124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708672.787650:0:17124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708672.787653:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.787668:0:17124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.787685:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708672.787707:0:19635:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.787714:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+7:2395:x1876645357151872:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 113us (210us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708672.787726:0:19635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.787730:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00010000:00010000:3.0:1789708672.787751:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.787760:0:19635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.787767:0:19635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.787773:0:19635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708672.787777:0:19635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.787785:0:19635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.787798:0:19635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.787805:0:19635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47e684 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.787901:0:19635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f84d004b-f450-4582-bbe2-71415469e27b+6:2396:x1876645357151744:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 1486us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708672.787909:0:19635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:1.0:1789708672.788543:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.788581:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357152128 00000100:00100000:2.0:1789708672.788587:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357152128 00000100:00100000:2.0:1789708672.788624:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:2.0:1789708672.788632:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+15:15710:x1876645357152128:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789708672.788687:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.788700:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e467 expref: 15 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.788708:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.788729:0:17139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e467 expref: 15 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.788740:0:17139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e467 expref: 15 pid: 17138 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.788766:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17139:1876645365556736:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708672.788809:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f00540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708672.789472:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17139:1876645365556736:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708672.789484:0:17139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.789731:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.789766:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357152256 00000100:00100000:2.0:1789708672.789772:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357152256 00010000:00010000:2.0:1789708672.789789:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e467 expref: 16 pid: 17138 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.789817:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1789708672.789823:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36243050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+16:2395:x1876645357152256:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708672.789831:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708672.789836:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e467 expref: 16 pid: 17138 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.789846:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e467 expref: 16 pid: 17138 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.789858:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e4a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e467 expref: 16 pid: 17138 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.789869:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.789873:0:17126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.789885:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.789892:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.789911:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708672.789929:0:17139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.789942:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36243050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+15:2395:x1876645357152256:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 116us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708672.789949:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.789954:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00010000:00010000:0.0:1789708672.790144:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.790154:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e653 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d0 expref: 15 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.790161:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.790177:0:17139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e653 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d0 expref: 15 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.790188:0:17139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e653 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d0 expref: 15 pid: 18837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708672.790197:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17139:1876645365556864:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708672.790238:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708672.790981:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17139:1876645365556864:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708672.790991:0:17139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708672.791372:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708672.791441:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357152384 00000100:00100000:3.0:1789708672.791447:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357152384 00010000:00010000:3.0:1789708672.791465:0:17891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e653 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d0 expref: 16 pid: 18837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.791491:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:3.0:1789708672.791499:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+16:2395:x1876645357152384:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708672.791507:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708672.791512:0:17891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e653 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d0 expref: 16 pid: 18837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.791522:0:17891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e653 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d0 expref: 16 pid: 18837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.791535:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e653 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4d0 expref: 16 pid: 18837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.791545:0:17891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:3.0:1789708672.791549:0:17891:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.791557:0:17891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.791573:0:17891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.791593:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708672.791606:0:17139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.791613:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708672.791624:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+15:2395:x1876645357152384:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 125us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708672.791632:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000001:00080000:0.0:1789708672.791659:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000001:00080000:0.0:1789708672.791744:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:0.0:1789708672.791790:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000100:00100000:0.0:1789708672.791845:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17139:1876645365556992:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789708672.791881:0:17139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708672.791904:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed04215180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708672.792362:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365556992 00000100:00100000:1.0:1789708672.792367:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365556992 00000100:00100000:1.0:1789708672.792400:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708672.792407:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:17139:x1876645365556992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789708672.792485:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:17139:x1876645365556992:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708672.792492:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789708672.792553:0:17139:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789708672.792559:0:17139:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bee18001880, transno 8589934597 00000100:00100000:0.0:1789708672.792577:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17139:1876645365556992:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789708672.792732:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:0.0:1789708672.792788:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17139:1876645365557120:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789708672.792823:0:17139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708672.792846:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708672.793094:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365557120 00000100:00100000:1.0:1789708672.793109:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365557120 00000100:00100000:3.0:1789708672.793176:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789708672.793186:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:17139:x1876645365557120:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789708672.793322:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17139:x1876645365557120:12345-0@lo:1000:mdt00_001.0 Request processed in 138us (498us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789708672.793330:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708672.793356:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17139:1876645365557120:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789708672.793379:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793385:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793390:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793393:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.793397:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793401:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793414:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:0.0:1789708672.793416:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708672.793419:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793422:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47e692 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793443:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e5ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793446:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e5ce lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793450:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e5ce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793453:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.793455:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e5ce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793458:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e5ce lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793462:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:0.0:1789708672.793463:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708672.793465:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e5ce lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793468:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e5ce lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793512:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793523:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4b4 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793532:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793550:0:17139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4b4 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.793558:0:17139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4b4 expref: 18 pid: 17138 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708672.793565:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17139:1876645365557248:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708672.793599:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708672.799706:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708672.799711:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17139:1876645365557248:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708672.799756:0:17139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.799774:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357152512 00000100:00100000:2.0:1789708672.799782:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357152512 00010000:00010000:2.0:1789708672.799820:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4b4 expref: 19 pid: 17138 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.799859:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1789708672.799868:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+19:2396:x1876645357152512:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708672.799884:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708672.799891:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4b4 expref: 19 pid: 17138 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.799904:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4b4 expref: 19 pid: 17138 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.799927:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47e5ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4b4 expref: 19 pid: 17138 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.799957:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:2.0:1789708672.799962:0:17125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.799971:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.799979:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.800002:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708672.800021:0:17139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800031:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800044:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.800057:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+18:2396:x1876645357152512:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 189us (359us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708672.800060:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.800072:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00010000:00010000:0.0:1789708672.800073:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800082:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.800087:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800094:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800114:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:0.0:1789708672.800117:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708672.800121:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800128:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0800/0xf45f43947e47e699 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800139:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800146:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800152:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800157:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebca00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708672.800167:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800174:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800182:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee2c76a800) 00010000:00010000:0.0:1789708672.800185:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708672.800188:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708672.800203:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e68b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708672.800402:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+17:15710:x1876645357152128:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 11770us (11859us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1789708672.800411:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00000020:00080000:0.0:1789708672.800416:0:17139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789708672.800576:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789708672.800580:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708672.800605:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789708672.800618:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789708672.801337:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708672.801375:0:20282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357152768 00000100:00100000:2.0:1789708672.801381:0:20282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357152768 00000100:00100000:2.0:1789708672.801415:0:20282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1789708672.801425:0:20282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+17:15710:x1876645357152768:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789708672.801649:0:20282:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789708672.801678:0:20282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00010000:00010000:2.0:1789708672.801705:0:20282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.801716:0:20282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.801725:0:20282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.801744:0:20282:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.801750:0:20282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.801756:0:20282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708672.801775:0:20282:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708672.801805:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708672.801814:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.801823:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebda00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708672.801827:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.801834:0:20282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+19:15710:x1876645357152768:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 410us (497us total) trans 8589934632 rc 0/0 00010000:00010000:3.0:1789708672.801838:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708672.801847:0:20282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000020:00080000:2.0:1789708672.801852:0:20282:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789708672.801855:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:3.0:1789708672.801860:0:17127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789708672.801864:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.801872:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e6a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708672.801894:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708672.801896:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708672.801898:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708673.574459:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708673.894822:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708673.894843:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365557376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789708673.894909:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708673.894951:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365557376 00000100:00100000:3.0:1789708673.894958:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365557376 00000100:00100000:3.0:1789708673.895003:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789708673.895012:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365557376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789708673.895045:0:18670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789708673.895090:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365557376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708673.895098:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789708673.895143:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365557376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708673.896612:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365557504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708673.896654:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708673.896692:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365557504 00000100:00100000:1.0:1789708673.896698:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365557504 00000100:00100000:1.0:1789708673.896736:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789708673.896743:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365557504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708673.896766:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789708673.896804:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365557504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708673.896811:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789708673.896847:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365557504:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789708673.966132:0:20372:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789708673.966143:0:20372:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708673.966177:0:20372:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789708673.966191:0:20372:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789708674.023522:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.023612:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357152896 00000100:00100000:0.0:1789708674.023622:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357152896 00000100:00100000:0.0:1789708674.023698:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:0.0:1789708674.023709:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+19:15727:x1876645357152896:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:0.0:1789708674.023780:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.023797:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.023808:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.023833:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.023841:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.023848:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.023995:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024004:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789708674.024006:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789708674.024011:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708674.024155:0:19935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024169:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024176:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024183:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024189:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.024193:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024208:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024221:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:0.0:1789708674.024224:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.024229:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024236:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024246:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024252:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024907:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024916:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.024920:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024926:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024934:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.024937:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.024940:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6ae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024956:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024972:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024978:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024984:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024989:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.024992:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.024998:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.025005:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bee08f48300) 00010000:00010000:0.0:1789708674.025008:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.025011:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.025016:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e6b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.025203:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+19:15727:x1876645357152896:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 1494us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.025212:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:3.0:1789708674.049771:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708674.049850:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357153152 00000100:00100000:1.0:1789708674.049860:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357153152 00000100:00100000:1.0:1789708674.049925:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:1.0:1789708674.049936:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+19:15730:x1876645357153152:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708674.049956:0:18837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708674.049975:0:18837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e6bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4ec expref: -99 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050052:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e6c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050066:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050077:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050089:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e6ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050094:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e6ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050105:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e6ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050202:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050207:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050212:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708674.050218:0:18837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:1.0:1789708674.050312:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050321:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e6c3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050327:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e6c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050333:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708674.050337:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e6c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050345:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e6c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050356:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:1.0:1789708674.050359:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708674.050369:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e6c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050376:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9c00/0xf45f43947e47e6c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050386:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e6ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050392:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e6ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050397:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e6ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050402:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708674.050404:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e6ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050407:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e6ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050412:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bed08847900) 00010000:00010000:1.0:1789708674.050414:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708674.050416:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e6ca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.050419:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9000/0xf45f43947e47e6ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.050481:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e6bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ec expref: 22 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.050496:0:18837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ec expref: 21 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.050503:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:0.0:1789708674.050505:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708674.050508:0:18837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9400, rc 0) 00000100:00100000:0.0:1789708674.050568:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+21:15730:x1876645357153152:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 634us (808us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1789708674.050574:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:2.0:1789708674.058331:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708674.058372:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357153280 00000100:00100000:1.0:1789708674.058382:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357153280 00000100:00100000:1.0:1789708674.058441:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:1.0:1789708674.058457:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+21:15730:x1876645357153280:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1789708674.058519:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e6df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.058535:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e6df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.058546:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e6df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.058577:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e6df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.058583:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e6df lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.058590:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e6df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.058597:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708674.058600:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e6df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.058608:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e6df lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.058618:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:1.0:1789708674.058621:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708674.058626:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e6df lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.058631:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8200/0xf45f43947e47e6df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708674.058694:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+21:15730:x1876645357153280:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 239us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708674.058702:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:2.0:1789708674.065679:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.065847:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357153536 00000100:00100000:3.0:1789708674.065856:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357153536 00000100:00100000:3.0:1789708674.065907:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1789708674.065919:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+21:15730:x1876645357153536:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708674.066796:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+22:15730:x1876645357153536:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 876us (1123us total) trans 8589934634 rc 0/0 00000100:00100000:3.0:1789708674.066813:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1789708674.092359:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.092466:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357153792 00000100:00100000:0.0:1789708674.092477:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357153792 00000100:00100000:0.0:1789708674.092551:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:0.0:1789708674.092882:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+22:12961:x1876645357153792:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708674.092907:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.092927:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4f3 expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.093031:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.093045:0:19935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ec expref: 23 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.093055:0:19935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.093106:0:19935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ec expref: 23 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.093118:0:19935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ec expref: 23 pid: 18837 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.093133:0:19935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19935:1876645365557632:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708674.094215:0:19935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708674.101446:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.101570:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357153920 00000100:00100000:2.0:1789708674.101581:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357153920 00010000:00010000:2.0:1789708674.101621:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ec expref: 24 pid: 18837 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.101662:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:2.0:1789708674.101673:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+24:2396:x1876645357153920:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708674.101695:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708674.101702:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ec expref: 24 pid: 18837 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.101737:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ec expref: 24 pid: 18837 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.101759:0:19935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19935:1876645365557632:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708674.101762:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e6d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4ec expref: 24 pid: 18837 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.101782:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:2.0:1789708674.101787:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.101796:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.101804:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.101817:0:19935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.101822:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708674.101832:0:19935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.101839:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708674.101857:0:19935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:0.0:1789708674.101977:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e6e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4f3 expref: 25 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.101993:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4f3 expref: 24 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.102001:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:0.0:1789708674.102003:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789708674.102013:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30493400, rc 0) 00000100:00100000:2.0:1789708674.102118:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+24:2396:x1876645357153920:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 446us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.102126:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:0.0:1789708674.104669:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+23:12961:x1876645357153792:12345-192.168.201.52@tcp:101:bash.0 Request processed in 12097us (12305us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1789708674.104684:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:2.0:1789708674.110854:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.110902:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357154048 00000100:00100000:0.0:1789708674.110915:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357154048 00000100:00100000:0.0:1789708674.110977:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:0.0:1789708674.110991:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+23:12961:x1876645357154048:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708674.111021:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.111047:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e6fb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e4fa expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.111087:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e702 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.111145:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e702 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.111157:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e702 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.111323:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e6fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4fa expref: 25 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.111339:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e702 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4fa expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.111347:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:0.0:1789708674.111349:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708674.111358:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30492c00, rc 0) 00000100:00100000:0.0:1789708674.111417:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+24:12961:x1876645357154048:12345-192.168.201.52@tcp:101:bash.0 Request processed in 431us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.111423:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:1.0:1789708674.113870:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.113963:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357154304 00000100:00100000:2.0:1789708674.113972:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357154304 00000100:00100000:2.0:1789708674.114020:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:2.0:1789708674.114029:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+24:12961:x1876645357154304:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:2.0:1789708674.115961:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.116003:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.116014:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708674.116080:0:17140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934636 00000004:00010000:2.0:1789708674.116111:0:17140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eafe2473 reply state 000000000d9bd737 transno 8589934637 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.116123:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.116131:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:2.0:1789708674.116134:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789708674.116138:0:17140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789708674.116224:0:17140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934637 00000100:00100000:2.0:1789708674.116335:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+28:12961:x1876645357154304:12345-192.168.201.52@tcp:36:bash.0 Request processed in 2304us (2471us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1789708674.116342:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00000020:00080000:2.0:1789708674.116346:0:17140:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789708674.119131:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.119372:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357154432 00000100:00100000:0.0:1789708674.119382:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357154432 00000100:00100000:0.0:1789708674.119431:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:0.0:1789708674.119440:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+28:12961:x1876645357154432:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708674.119463:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.119482:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e710 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e501 expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.119530:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e710 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e501 expref: 29 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.119545:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e710 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e501 expref: 29 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.119562:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:0.0:1789708674.119565:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708674.119569:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30493c00, rc 0) 00000100:00100000:0.0:1789708674.119612:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+29:12961:x1876645357154432:12345-192.168.201.52@tcp:101:bash.0 Request processed in 173us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.119619:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:1.0:1789708674.123007:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.123214:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357154560 00000100:00100000:2.0:1789708674.123223:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357154560 00000100:00080000:3.0:1789708674.123304:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708674.123369:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:2.0:1789708674.123380:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee40721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+6:12961:x1876645357154560:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708674.123399:0:19636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708674.123421:0:19636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47e717 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e508 expref: -99 pid: 19636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708674.123464:0:19636:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 9, mtime: 0x6aacc97f, atime: 0x6aacc97f, ctime: 0x6aacc97f, blocks: 0x8 00010000:00010000:2.0:1789708674.123487:0:19636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=244s v=(0 0) 00010000:00010000:2.0:1789708674.123492:0:19636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708674.123499:0:19636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47e717 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e508 expref: 7 pid: 19636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.123515:0:19636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47e717 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e508 expref: 7 pid: 19636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.123528:0:19636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd400, rc 0) 00000100:00100000:2.0:1789708674.123580:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee40721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+7:12961:x1876645357154560:12345-192.168.201.52@tcp:101:bash.0 Request processed in 202us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.123588:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:3.0:1789708674.125082:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.125145:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357154688 00000100:00100000:0.0:1789708674.125153:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357154688 00002000:00010000:0.0:1789708674.125180:0:18651:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/34 (0->18446744073709551615) 00002000:00100000:0.0:1789708674.125185:0:18651:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee107e5500 with x1876645357154688 ext(0->18446744073709551615) 00002000:00010000:0.0:1789708674.125202:0:18651:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee107e5500. 00000100:00100000:0.0:1789708674.125230:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:0.0:1789708674.125240:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357154688:12345-192.168.201.52@tcp:10:bash.0 00002000:00010000:0.0:1789708674.125543:0:18651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789708674.125547:0:18651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789708671 -> 1789708673 00002000:00010000:0.0:1789708674.125549:0:18651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 1789708671 -> 1789708671 00002000:00010000:0.0:1789708674.125551:0:18651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789708671 -> 1789708673 00002000:00010000:0.0:1789708674.125553:0:18651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789708674.125602:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f84d004b-f450-4582-bbe2-71415469e27b+8:2396:x1876645357154688:12345-192.168.201.52@tcp:10:bash.0 Request processed in 363us (580us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789708674.125610:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00002000:00010000:0.0:1789708674.125613:0:18651:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/34 (0->18446744073709551615) 00002000:00100000:0.0:1789708674.125616:0:18651:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee107e5500 with x1876645357154688 ext(0->18446744073709551615) 00002000:00010000:0.0:1789708674.125621:0:18651:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee107e5500. 00000100:00100000:3.0:1789708674.168375:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.168444:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357154816 00000100:00100000:0.0:1789708674.168456:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357154816 00000100:00100000:0.0:1789708674.168523:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:0.0:1789708674.168533:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+29:15744:x1876645357154816:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:0.0:1789708674.168603:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e71e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168620:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e71e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168631:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e71e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168663:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e725 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168671:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168676:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168748:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168758:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168764:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708674.168812:0:17138:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168824:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e71e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168830:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e71e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168836:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e71e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168842:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.168846:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e71e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168860:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e71e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168872:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:0.0:1789708674.168874:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.168877:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e71e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168882:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e71e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168891:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168895:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e725 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168899:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e725 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168901:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.168903:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e725 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168906:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e725 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168910:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee08f48300) 00010000:00010000:0.0:1789708674.168911:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.168912:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e725 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168922:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e725 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168932:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168935:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168939:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168942:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.168943:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168947:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168950:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:0.0:1789708674.168951:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.168953:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.168956:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e72c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.169019:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+29:15744:x1876645357154816:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 488us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.169031:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:1.0:1789708674.191867:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.192006:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357155072 00000100:00100000:2.0:1789708674.192022:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357155072 00000100:00100000:2.0:1789708674.192108:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:2.0:1789708674.192121:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+29:15747:x1876645357155072:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708674.192159:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708674.192186:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e733 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e50f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192335:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e73a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192352:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e73a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192382:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e73a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192397:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e741 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192401:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e741 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192407:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e741 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192531:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e748 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192540:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192547:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708674.192557:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789708674.192640:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e73a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192645:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e73a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192650:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e73a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192655:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebca00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708674.192662:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e73a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192669:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e73a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192680:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708674.192682:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708674.192686:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e73a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192690:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebca00/0xf45f43947e47e73a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192700:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e741 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192704:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e741 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192707:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e741 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192710:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708674.192712:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e741 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192715:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e741 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192718:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee2c76a400) 00010000:00010000:2.0:1789708674.192720:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708674.192725:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e741 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192729:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e741 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192760:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebda00/0xf45f43947e47e733 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e50f expref: 32 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192769:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e748 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e50f expref: 31 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.192774:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:2.0:1789708674.192776:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789708674.192777:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd000, rc 0) 00000100:00100000:2.0:1789708674.192837:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+31:15747:x1876645357155072:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 720us (990us total) trans 8589934639 rc 0/0 00000100:00100000:2.0:1789708674.192844:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:1.0:1789708674.194984:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.195140:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357155200 00000100:00100000:0.0:1789708674.195340:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357155200 00000100:00100000:0.0:1789708674.195401:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:0.0:1789708674.195413:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+31:15747:x1876645357155200:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789708674.195628:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.195648:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4f3 expref: 31 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.195659:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.195700:0:17139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4f3 expref: 31 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.195715:0:17139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4f3 expref: 31 pid: 19935 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.195730:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17139:1876645365557760:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708674.195853:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3403e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708674.198056:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.198061:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17139:1876645365557760:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708674.198091:0:17139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.198135:0:20282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357155456 00000100:00100000:2.0:1789708674.198144:0:20282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357155456 00000100:00100000:2.0:1789708674.198239:0:20282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789708674.198250:0:20282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+32:15612:x1876645357155456:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789708674.198631:0:20282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+33:15612:x1876645357155456:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 382us (584us total) trans 8589934640 rc 0/0 00000100:00100000:2.0:1789708674.198639:0:20282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1789708674.200155:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.200239:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357155584 00000100:00100000:2.0:1789708674.200247:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357155584 00010000:00010000:2.0:1789708674.200317:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4f3 expref: 33 pid: 19935 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.200383:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:2.0:1789708674.200394:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+33:2395:x1876645357155584:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708674.200410:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708674.200418:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4f3 expref: 33 pid: 19935 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.200432:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4f3 expref: 33 pid: 19935 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.200458:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e6ed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4f3 expref: 33 pid: 19935 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.200474:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:2.0:1789708674.200479:0:17126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.200490:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.200497:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.200524:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708674.200553:0:17139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.200572:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.200612:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.200620:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+32:2395:x1876645357155584:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 225us (470us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708674.200623:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.200633:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00010000:00010000:0.0:1789708674.200635:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.200643:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.200647:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.200655:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.200664:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:0.0:1789708674.200668:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708674.200671:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.200678:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e756 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.200870:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+31:15747:x1876645357155200:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 5458us (5900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.200879:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:1.0:1789708674.203857:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.203926:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357155840 00000100:00100000:3.0:1789708674.203939:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357155840 00000100:00100000:3.0:1789708674.204015:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:3.0:1789708674.204028:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2d985c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+31:15747:x1876645357155840:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708674.204425:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2d985c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+32:15747:x1876645357155840:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 395us (571us total) trans 8589934641 rc 0/0 00000100:00100000:3.0:1789708674.204435:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:3.0:1789708674.250185:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.250461:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357156096 00000100:00100000:0.0:1789708674.250480:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357156096 00000100:00100000:0.0:1789708674.250537:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:0.0:1789708674.250559:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+32:15758:x1876645357156096:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1789708674.250583:0:18837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.250603:0:18837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e75d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e516 expref: -99 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250676:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e764 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250690:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e764 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250700:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e764 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250713:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e76b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250720:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e76b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250726:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e76b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250819:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e772 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250827:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250834:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708674.250852:0:18837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:0.0:1789708674.250917:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e764 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250925:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e764 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250931:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e764 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250937:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.250941:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e764 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250948:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e764 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250959:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:0.0:1789708674.250962:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.250966:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e764 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250972:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e764 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250985:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e76b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.250990:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e76b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.251004:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e76b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.251009:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.251011:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e76b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.251017:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e76b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.251024:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee08f48300) 00010000:00010000:0.0:1789708674.251027:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.251029:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e76b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.251034:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e76b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.251092:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e75d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e516 expref: 35 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.251105:0:18837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e772 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e516 expref: 34 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.251112:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:0.0:1789708674.251113:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708674.251116:0:18837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30493800, rc 0) 00000100:00100000:0.0:1789708674.251177:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+34:15758:x1876645357156096:12345-192.168.201.52@tcp:101:cat.0 Request processed in 619us (1002us total) trans 8589934642 rc 0/0 00000100:00100000:0.0:1789708674.251193:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:2.0:1789708674.255686:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708674.255762:0:20282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357156352 00000100:00100000:1.0:1789708674.255773:0:20282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357156352 00000100:00100000:1.0:1789708674.255832:0:20282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1789708674.255842:0:20282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+34:15758:x1876645357156352:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:1.0:1789708674.256172:0:20282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+35:15758:x1876645357156352:12345-192.168.201.52@tcp:35:cat.0 Request processed in 331us (494us total) trans 8589934643 rc 0/0 00000100:00100000:1.0:1789708674.256181:0:20282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1789708674.268997:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.269060:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357156608 00000100:00100000:0.0:1789708674.269071:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357156608 00000100:00100000:0.0:1789708674.269137:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:0.0:1789708674.269147:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+35:15759:x1876645357156608:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:0.0:1789708674.269207:0:19935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789708674.269233:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e710 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e501 expref: 35 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269302:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e772 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e516 expref: 34 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269320:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd000/0xf45f43947e47e748 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e50f expref: 33 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269332:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e702 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e4fa expref: 32 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269341:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:0.0:1789708674.269345:0:19935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708674.269362:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e780 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269373:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269379:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269397:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269402:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269406:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269475:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e78e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269482:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e78e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269489:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e78e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708674.269660:0:19935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3, 64 off8408 00000004:00080000:0.0:1789708674.269667:0:19935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 245079406039ns, next at 246079404165ns, rc = 0 00010000:00010000:0.0:1789708674.269697:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269703:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269707:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269712:0:19935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269725:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269729:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269747:0:19935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708674.269787:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e78e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269791:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e78e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269795:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e78e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269799:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.269801:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e78e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269806:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e78e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269811:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:0.0:1789708674.269813:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789708674.269816:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e78e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269819:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e78e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269828:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269835:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e780 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269839:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e780 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269841:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.269843:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e780 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269847:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e780 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269851:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:0.0:1789708674.269852:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.269854:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e780 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269857:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e780 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708674.269861:0:19935:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f65d6c74 reply state 000000001f8d43f4 transno 8589934644 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269868:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.269872:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee08f48300) 00010000:00010000:0.0:1789708674.269873:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708674.269875:0:19935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708674.269933:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+33:15759:x1876645357156608:12345-192.168.201.52@tcp:36:rm.0 Request processed in 787us (945us total) trans 8589934644 rc 0/0 00000100:00100000:0.0:1789708674.269944:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00010000:00010000:2.0:1789708674.270313:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708674.270322:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.270329:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708674.270332:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.270339:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.270349:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:2.0:1789708674.270351:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789708674.270354:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.270360:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493a00/0xf45f43947e47e795 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.270371:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708674.270373:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708674.270375:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708674.293019:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.293091:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357156864 00000100:00100000:0.0:1789708674.293101:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357156864 00000100:00100000:0.0:1789708674.293163:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:0.0:1789708674.293173:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+33:15765:x1876645357156864:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708674.293198:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.293218:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e79c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e51d expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293369:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293383:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293394:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293404:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293412:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293418:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293773:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293793:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293798:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708674.293805:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789708674.293822:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293827:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7a3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293831:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293834:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.293838:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293842:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7a3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293849:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:0.0:1789708674.293851:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.293854:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7a3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293858:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7a3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708674.293866:0:17139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b555ce77 reply state 00000000c9f908b2 transno 8589934645 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293877:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293881:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee08f48300) 00010000:00010000:0.0:1789708674.293883:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708674.293884:0:17139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789708674.293902:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e79c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e51d expref: 36 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293910:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e51d expref: 35 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.293915:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.293916:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789708674.293917:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30493800, rc 0) 00000100:00100000:0.0:1789708674.293965:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+36:15765:x1876645357156864:12345-192.168.201.52@tcp:101:bash.0 Request processed in 795us (957us total) trans 8589934645 rc 0/0 00000100:00100000:0.0:1789708674.293969:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:1.0:1789708674.295996:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.296039:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357156992 00000100:00100000:0.0:1789708674.296047:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357156992 00000100:00100000:0.0:1789708674.296087:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:0.0:1789708674.296094:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+36:15765:x1876645357156992:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708674.296111:0:18837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.296127:0:18837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e524 expref: -99 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.296178:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.296198:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.296208:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708674.296246:0:18837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789708674.296250:0:18837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708674.296298:0:18837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.296309:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.296327:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e524 expref: 38 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.296338:0:18837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e524 expref: 37 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.296343:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.296346:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708674.296348:0:18837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30492400, rc 0) 00000100:00100000:0.0:1789708674.296382:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+37:15765:x1876645357156992:12345-192.168.201.52@tcp:101:bash.0 Request processed in 290us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.296387:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:1.0:1789708674.297315:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.297358:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357157248 00000100:00100000:3.0:1789708674.297363:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357157248 00000100:00100000:3.0:1789708674.297387:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1789708674.297393:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+37:15765:x1876645357157248:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:3.0:1789708674.297572:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+38:15765:x1876645357157248:12345-192.168.201.52@tcp:35:bash.0 Request processed in 177us (256us total) trans 8589934646 rc 0/0 00000100:00100000:3.0:1789708674.297579:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1789708674.343616:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.343669:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357157504 00000100:00100000:0.0:1789708674.343679:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357157504 00000100:00100000:0.0:1789708674.343725:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:0.0:1789708674.343756:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+38:15778:x1876645357157504:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708674.343782:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.343801:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e52b expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.343896:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e7d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.343907:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e7d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.343913:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e7d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708674.343921:0:19935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789708674.344016:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e52b expref: 41 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.344034:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e52b expref: 40 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.344042:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.344045:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789708674.344048:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30492000, rc 0) 00000100:00100000:0.0:1789708674.344099:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+40:15778:x1876645357157504:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 349us (491us total) trans 8589934647 rc 0/0 00000100:00100000:0.0:1789708674.344106:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:1.0:1789708674.345092:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.345127:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357157632 00000100:00100000:0.0:1789708674.345131:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357157632 00000100:00100000:0.0:1789708674.345161:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:0.0:1789708674.345168:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+40:15778:x1876645357157632:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789708674.345199:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.345209:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.345217:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.345232:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.345236:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.345241:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.345245:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.345247:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.345252:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.345300:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.345304:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708674.345308:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.345325:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.345366:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+40:15778:x1876645357157632:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 198us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.345372:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:1.0:1789708674.375040:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.375141:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357157888 00000100:00100000:0.0:1789708674.375149:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357157888 00000100:00100000:0.0:1789708674.375193:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:0.0:1789708674.375200:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+40:15788:x1876645357157888:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708674.375216:0:18837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.375232:0:18837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e532 expref: -99 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.375368:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.375380:0:18837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e51d expref: 41 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.375386:0:18837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e524 expref: 41 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.375391:0:18837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.375417:0:18837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e524 expref: 41 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.375458:0:18837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e524 expref: 41 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.375480:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365557888:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708674.375565:0:18837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e51d expref: 41 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.375575:0:18837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e51d expref: 41 pid: 17139 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.375585:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365558016:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708674.375610:0:18837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789708674.376515:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365557888:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708674.376525:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365558016:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708674.376540:0:18837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708674.376841:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708674.376889:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.376925:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357158016 00000100:00100000:2.0:1789708674.376932:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357158144 00000100:00100000:2.0:1789708674.376936:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357158144 00000100:00100000:3.0:1789708674.376937:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357158016 00010000:00010000:2.0:1789708674.376958:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e51d expref: 43 pid: 17139 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.376987:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00010000:00010000:3.0:1789708674.376991:0:17891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e524 expref: 43 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.376995:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+43:2396:x1876645357158144:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708674.377005:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708674.377011:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e51d expref: 43 pid: 17139 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.377026:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00010000:00010000:2.0:1789708674.377029:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e51d expref: 43 pid: 17139 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.377039:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+43:2396:x1876645357158016:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708674.377049:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493800/0xf45f43947e47e7b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e51d expref: 43 pid: 17139 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.377050:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708674.377060:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e524 expref: 43 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.377069:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708674.377074:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.377079:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.377083:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708674.377088:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e524 expref: 42 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.377112:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e7c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e524 expref: 42 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.377118:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+42:2396:x1876645357158144:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 121us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708674.377129:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00000100:00100000:2.0:1789708674.377130:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00010000:00010000:0.0:1789708674.377135:0:17125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.377142:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.377147:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.377167:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708674.377190:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+40:2396:x1876645357158016:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 155us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.377199:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00010000:00010000:3.0:1789708674.377209:0:18837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.377220:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708674.377335:0:18837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789708674.377480:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492e00/0xf45f43947e47e7e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e532 expref: 41 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.377494:0:18837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e532 expref: 40 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.377502:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:3.0:1789708674.377505:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789708674.377508:0:18837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30493c00, rc 0) 00000100:00100000:3.0:1789708674.377541:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+40:15788:x1876645357157888:12345-192.168.201.52@tcp:101:bash.0 Request processed in 2340us (2507us total) trans 8589934648 rc 0/0 00000100:00100000:3.0:1789708674.377548:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:1.0:1789708674.378582:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.378621:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357158272 00000100:00100000:0.0:1789708674.378626:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357158272 00000100:00100000:0.0:1789708674.378663:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:0.0:1789708674.378671:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+40:15788:x1876645357158272:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789708674.378687:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.378698:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e7fe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e539 expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.378721:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.378742:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.378751:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.378830:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e7fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e539 expref: 42 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.378843:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e539 expref: 41 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.378850:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.378853:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708674.378855:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30492200, rc 0) 00000100:00100000:0.0:1789708674.378887:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+41:15788:x1876645357158272:12345-192.168.201.52@tcp:101:bash.0 Request processed in 217us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.378893:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:2.0:1789708674.379986:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.380032:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357158528 00000100:00100000:0.0:1789708674.380038:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357158528 00000100:00100000:2.0:1789708674.380145:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:2.0:1789708674.380157:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+41:15788:x1876645357158528:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:2.0:1789708674.380329:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.380340:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.380346:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708674.380387:0:17140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934649 00000004:00010000:2.0:1789708674.380402:0:17140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e56cc7c0 reply state 00000000ca4d5bd3 transno 8589934650 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.380410:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.380415:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708674.380416:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789708674.380418:0:17140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708674.380463:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+44:15788:x1876645357158528:12345-192.168.201.52@tcp:36:bash.0 Request processed in 310us (479us total) trans 8589934650 rc 0/0 00000100:00100000:2.0:1789708674.380469:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00000020:00080000:2.0:1789708674.380473:0:17140:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789708674.381327:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.381366:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357158656 00000100:00100000:3.0:1789708674.381371:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357158656 00000100:00100000:3.0:1789708674.381404:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:3.0:1789708674.381413:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+44:15788:x1876645357158656:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708674.381423:0:18837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708674.381433:0:18837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e813 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e540 expref: -99 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.381486:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.381497:0:18837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e532 expref: 45 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.381505:0:18837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.381535:0:18837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e532 expref: 45 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.381547:0:18837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e532 expref: 45 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.381558:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365558144:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708674.381610:0:18837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708674.382352:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365558144:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708674.382369:0:18837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708674.382526:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.382591:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357158784 00000100:00100000:3.0:1789708674.382596:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357158784 00010000:00010000:3.0:1789708674.382614:0:17891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e532 expref: 46 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.382640:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:3.0:1789708674.382656:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+46:2396:x1876645357158784:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708674.382665:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708674.382671:0:17891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e532 expref: 46 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.382683:0:17891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e532 expref: 46 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.382713:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493c00/0xf45f43947e47e7f0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e532 expref: 46 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.382725:0:17891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:3.0:1789708674.382729:0:17891:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.382737:0:17891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.382743:0:17891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.382763:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708674.382783:0:18837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.382792:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.382793:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+45:2396:x1876645357158784:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 137us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.382806:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000004:00200000:0.0:1789708674.382823:0:18837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789708674.382828:0:18837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708674.382840:0:18837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.382864:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47e813 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e540 expref: 45 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.382873:0:18837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e540 expref: 44 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.382878:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.382879:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708674.382881:0:18837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103b000, rc 0) 00000100:00100000:0.0:1789708674.382909:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+44:15788:x1876645357158656:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1498us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.382913:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:1.0:1789708674.383889:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.383942:0:20282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357159040 00000100:00100000:2.0:1789708674.383947:0:20282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357159040 00000100:00100000:2.0:1789708674.383982:0:20282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789708674.383990:0:20282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+44:15788:x1876645357159040:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:2.0:1789708674.384135:0:20282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+45:15788:x1876645357159040:12345-192.168.201.52@tcp:35:bash.0 Request processed in 145us (247us total) trans 8589934651 rc 0/0 00000100:00100000:2.0:1789708674.384142:0:20282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:1.0:1789708674.409225:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.409313:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357159168 00000100:00100000:0.0:1789708674.409324:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357159168 00000100:00100000:0.0:1789708674.409381:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:0.0:1789708674.409397:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+45:15794:x1876645357159168:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708674.409420:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.409440:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e821 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e547 expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.409526:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e828 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.409540:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.409551:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708674.409598:0:19935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789708674.409602:0:19935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708674.409619:0:19935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.409643:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e821 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e547 expref: 47 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.409665:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e828 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e547 expref: 46 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.409675:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:0.0:1789708674.409677:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708674.409681:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30492400, rc 0) 00000100:00100000:0.0:1789708674.409742:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+46:15794:x1876645357159168:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 347us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.409751:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:3.0:1789708674.410983:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.411044:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357159296 00000100:00100000:2.0:1789708674.411051:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357159296 00000100:00100000:2.0:1789708674.411090:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:2.0:1789708674.411099:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+46:15794:x1876645357159296:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708674.411110:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708674.411122:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e82f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e54e expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411167:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e836 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411177:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e836 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411185:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e836 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411194:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e83d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411201:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e83d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411207:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e83d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411319:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e844 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411328:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411344:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708674.411374:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789708674.411379:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708674.411389:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411409:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411417:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e836 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411424:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e836 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411430:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e836 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411436:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708674.411440:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e836 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411447:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e836 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411456:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708674.411458:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708674.411462:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e836 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411469:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e836 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411479:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e83d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411485:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e83d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411497:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e83d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411501:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708674.411504:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e83d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411510:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e83d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411516:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee08f48300) 00010000:00010000:2.0:1789708674.411519:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708674.411521:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e83d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411526:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e83d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411545:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e82f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e54e expref: 48 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411555:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e844 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e54e expref: 47 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.411561:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708674.411563:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708674.411565:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebdc00, rc 0) 00000100:00100000:2.0:1789708674.411600:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+47:15794:x1876645357159296:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 503us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.411616:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:1.0:1789708674.412854:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.412894:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357159424 00000100:00100000:2.0:1789708674.412899:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357159424 00000100:00100000:2.0:1789708674.412943:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:2.0:1789708674.412954:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+47:2395:x1876645357159424:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708674.412967:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708674.412982:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e844 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e54e expref: 47 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.412996:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708674.412999:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708674.413012:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.413044:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+46:2395:x1876645357159424:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 92us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.413051:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789708674.413136:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357159680 00000100:00100000:0.0:1789708674.413141:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357159680 00000100:00100000:0.0:1789708674.413172:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:0.0:1789708674.413178:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+46:15794:x1876645357159680:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708674.413187:0:18837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.413195:0:18837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e84b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e555 expref: -99 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.413244:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.413294:0:18837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e540 expref: 47 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.413308:0:18837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.413339:0:18837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e540 expref: 47 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.413351:0:18837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e540 expref: 47 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.413364:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365558272:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708674.413409:0:18837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789708674.414058:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365558272:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708674.414077:0:18837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708674.414340:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.414367:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357159808 00000100:00100000:2.0:1789708674.414372:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357159808 00010000:00010000:2.0:1789708674.414387:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e540 expref: 48 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.414407:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708674.414412:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+48:2396:x1876645357159808:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708674.414418:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708674.414422:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e540 expref: 48 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.414433:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e540 expref: 48 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.414470:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b000/0xf45f43947e47e81a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e540 expref: 48 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.414485:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708674.414489:0:17126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.414497:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.414504:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.414527:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708674.414553:0:18837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.414555:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+47:2396:x1876645357159808:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 141us (215us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708674.414560:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.414562:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000004:00200000:0.0:1789708674.414573:0:18837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789708674.414668:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e84b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e555 expref: 48 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.414693:0:18837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e555 expref: 47 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.414700:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.414703:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789708674.414705:0:18837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30492a00, rc 0) 00000100:00100000:0.0:1789708674.414735:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+47:15794:x1876645357159680:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1557us (1724us total) trans 8589934652 rc 0/0 00000100:00100000:0.0:1789708674.414742:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:1.0:1789708674.416171:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.416216:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357160192 00000100:00100000:3.0:1789708674.416223:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357160192 00000100:00100000:3.0:1789708674.416294:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1789708674.416304:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+47:15794:x1876645357160192:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708674.416440:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+48:15794:x1876645357160192:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 138us (271us total) trans 8589934653 rc 0/0 00000100:00100000:3.0:1789708674.416447:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1789708674.417062:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.417097:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357160320 00000100:00100000:0.0:1789708674.417103:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357160320 00000100:00100000:0.0:1789708674.417138:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1789708674.417145:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+48:15794:x1876645357160320:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:0.0:1789708674.417158:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708674.417173:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e7d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e52b expref: 48 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.417185:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.417189:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708674.417219:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+47:15794:x1876645357160320:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.417226:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:1.0:1789708674.417982:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.418029:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357160448 00000100:00100000:0.0:1789708674.418034:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357160448 00000100:00100000:0.0:1789708674.418067:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:0.0:1789708674.418086:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+47:15794:x1876645357160448:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:0.0:1789708674.418149:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.418163:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.418172:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708674.418235:0:19935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:0.0:1789708674.418323:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+47:15794:x1876645357160448:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 238us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.418331:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:1.0:1789708674.421665:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.421708:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357160576 00000100:00100000:2.0:1789708674.421717:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357160576 00000100:00100000:2.0:1789708674.421765:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:2.0:1789708674.421773:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+47:15794:x1876645357160576:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789708674.421786:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708674.421799:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e867 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e55c expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.421834:0:17140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.421851:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e867 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e55c expref: 48 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.421864:0:17140:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.421873:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e867 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e55c expref: 48 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.421882:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708674.421884:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708674.421887:0:17140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e867 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e55c expref: 48 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.421891:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd600, rc 0) 00000100:00100000:2.0:1789708674.421929:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+48:15794:x1876645357160576:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 157us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.421936:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 98 00010000:00010000:2.0:1789708674.598411:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708674.854557:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789708674.854565:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708674.854603:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789708674.854624:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789708674.854927:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17175:1876645365558400:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789708674.855014:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed088b5900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708674.862775:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.862914:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17175:1876645365558400:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789708674.863423:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357160704 00000100:00100000:0.0:1789708674.863431:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357160704 00000100:00100000:0.0:1789708674.863482:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:0.0:1789708674.863492:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+48:15796:x1876645357160704:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789708674.863538:0:18837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708674.863772:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+48:15796:x1876645357160704:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 280us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.863779:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:3.0:1789708674.870907:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.871034:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357160832 00000100:00100000:0.0:1789708674.871045:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357160832 00000100:00100000:0.0:1789708674.871106:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:0.0:1789708674.871118:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+48:15796:x1876645357160832:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789708674.871186:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e86e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871217:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e86e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871229:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e86e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871615:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e875 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871623:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e875 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871628:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e875 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871647:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871652:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871656:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708674.871695:0:19935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789708674.871698:0:19935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789708674.871707:0:19935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871714:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e86e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871726:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e86e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871731:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e86e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871734:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.871737:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e86e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871742:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e86e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871750:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee2c76a300) 00010000:00010000:0.0:1789708674.871752:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.871755:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e86e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871759:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e86e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871768:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e875 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871771:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e875 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871774:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e875 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871777:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.871783:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e875 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871787:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e875 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871790:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff9bee08f48b00) 00010000:00010000:0.0:1789708674.871792:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.871793:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e875 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871796:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e875 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871806:0:19935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871809:0:19935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871812:0:19935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871815:0:19935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.871817:0:19935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871820:0:19935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871824:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.871825:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.871830:0:19935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.871834:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e87c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.871902:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+48:15796:x1876645357160832:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 786us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.871907:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:1.0:1789708674.874057:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.874789:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357161088 00000100:00100000:2.0:1789708674.874798:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357161088 00000100:00100000:2.0:1789708674.874850:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:2.0:1789708674.874856:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+48:15796:x1876645357161088:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708674.874871:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708674.874886:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e883 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e563 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.874993:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e88a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875008:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e88a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875019:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e88a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708674.875029:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789708674.875106:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e88a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875112:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e88a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875116:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e88a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875119:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708674.875122:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e88a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875127:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e88a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875135:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708674.875137:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789708674.875140:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e88a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875151:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e88a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875180:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e883 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e563 expref: 50 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875187:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee2c76a300) 00010000:00010000:2.0:1789708674.875188:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708674.875191:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e883 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e563 expref: 50 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.875196:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebdc00, rc 0) 00000100:00100000:2.0:1789708674.875242:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+49:15796:x1876645357161088:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 386us (1192us total) trans 8589934654 rc 301/301 00000100:00100000:2.0:1789708674.875249:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:1.0:1789708674.877597:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.878019:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357161216 00000100:00100000:0.0:1789708674.878029:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357161216 00000100:00100000:0.0:1789708674.878076:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:0.0:1789708674.878086:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+49:15796:x1876645357161216:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789708674.878117:0:18837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708674.878212:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+49:15796:x1876645357161216:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 128us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.878220:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:0.0:1789708674.881600:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.881936:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357161472 00000100:00100000:2.0:1789708674.881946:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357161472 00000100:00100000:2.0:1789708674.882000:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:2.0:1789708674.882011:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+49:15796:x1876645357161472:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708674.882031:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708674.882034:0:19935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789708674.882060:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492400/0xf45f43947e47e828 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e547 expref: 49 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.882078:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708674.882083:0:19935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708674.882110:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e898 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e56a expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789708674.882489:0:19935:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1789708674.882497:0:19935:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789708674.882510:0:19935:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789708674.882661:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e89f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.882674:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e89f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.882684:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e89f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.882728:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e898 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e56a expref: 51 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.882741:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e89f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e56a expref: 50 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.882748:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee2c76a400) 00010000:00010000:2.0:1789708674.882750:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708674.882752:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebdc00, rc 0) 00000100:00100000:2.0:1789708674.882813:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+50:15796:x1876645357161472:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 804us (1220us total) trans 8589934655 rc 0/0 00000100:00100000:2.0:1789708674.882821:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:1.0:1789708674.885471:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.886008:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357161728 00000100:00100000:3.0:1789708674.886016:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357161728 00000100:00100000:3.0:1789708674.886068:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:3.0:1789708674.886078:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+50:15796:x1876645357161728:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708674.886127:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708674.886145:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebdc00/0xf45f43947e47e89f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e56a expref: 50 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886158:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee2c76a400) 00010000:00010000:3.0:1789708674.886165:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708674.886179:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e8ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886187:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e8ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886193:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e8ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886201:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b400/0xf45f43947e47e8b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1bfd6f3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886218:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b400/0xf45f43947e47e8b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfd6f3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886222:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b400/0xf45f43947e47e8b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfd6f3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886296:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e8ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886304:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e8ad lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886310:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e8ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886316:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ba00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708674.886320:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e8ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886328:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e8ad lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886336:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:3.0:1789708674.886339:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708674.886343:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e8ad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886349:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e8ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886359:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b400/0xf45f43947e47e8b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfd6f3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886372:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b400/0xf45f43947e47e8b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfd6f3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886378:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b400/0xf45f43947e47e8b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfd6f3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886383:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708674.886387:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b400/0xf45f43947e47e8b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfd6f3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886393:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b400/0xf45f43947e47e8b4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfd6f3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886401:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x1bfd6f3b (ffff9bee02bcbe00) 00010000:00010000:3.0:1789708674.886402:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708674.886404:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b400/0xf45f43947e47e8b4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1bfd6f3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.886408:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b400/0xf45f43947e47e8b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1bfd6f3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.886462:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+49:15796:x1876645357161728:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 385us (996us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708674.886468:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:1.0:1789708674.889550:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.889634:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357161856 00000100:00100000:0.0:1789708674.889643:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357161856 00000100:00100000:0.0:1789708674.889684:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:0.0:1789708674.889692:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+49:15796:x1876645357161856:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708674.889707:0:18837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708674.889725:0:18837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e8bb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e571 expref: -99 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.889754:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.889778:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.889788:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.889887:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493600/0xf45f43947e47e8bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e571 expref: 51 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.889904:0:18837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e571 expref: 50 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.889912:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:0.0:1789708674.889915:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708674.889918:0:18837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30492000, rc 0) 00000100:00100000:0.0:1789708674.889999:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+50:15796:x1876645357161856:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 307us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.890015:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:0.0:1789708674.892347:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.892669:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357162112 00000100:00100000:2.0:1789708674.892677:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357162112 00000100:00100000:2.0:1789708674.892710:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:2.0:1789708674.892726:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+50:15796:x1876645357162112:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789708674.892780:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.892791:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.892798:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708674.893080:0:19935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789708674.893089:0:19935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 245702828347ns, next at 246702826199ns, rc = 0 00000004:00010000:2.0:1789708674.893127:0:19935:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033a5a514 reply state 00000000d38c9d1a transno 8589934656 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.893136:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.893141:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:2.0:1789708674.893143:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789708674.893146:0:19935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708674.893244:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+52:15796:x1876645357162112:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 519us (904us total) trans 8589934656 rc 0/0 00000100:00100000:2.0:1789708674.893249:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:1.0:1789708674.894639:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.894699:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357162240 00000100:00100000:3.0:1789708674.894705:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357162240 00000100:00100000:3.0:1789708674.894772:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:3.0:1789708674.894779:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+52:15796:x1876645357162240:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708674.894796:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708674.894818:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e8d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e578 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.894923:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e8d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e578 expref: 53 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.894934:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e8d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e578 expref: 53 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.894947:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:3.0:1789708674.894949:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708674.894951:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103bc00, rc 0) 00000100:00100000:3.0:1789708674.894995:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+53:15796:x1876645357162240:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 216us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.895003:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:1.0:1789708674.897395:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.897517:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357162368 00000100:00100000:2.0:1789708674.897525:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357162368 00000100:00080000:3.0:1789708674.897579:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708674.897593:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:2.0:1789708674.897604:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+5:2395:x1876645357162368:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789708674.897869:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+6:2395:x1876645357162368:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 267us (480us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789708674.897879:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:0.0:1789708674.900227:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.900413:0:20282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357162624 00000100:00100000:2.0:1789708674.900422:0:20282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357162624 00000100:00100000:2.0:1789708674.900584:0:20282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1789708674.900594:0:20282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+53:15796:x1876645357162624:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789708674.900823:0:20282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+54:15796:x1876645357162624:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 231us (603us total) trans 8589934657 rc 0/0 00000100:00100000:2.0:1789708674.900832:0:20282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1789708674.902792:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.902928:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357162880 00000100:00100000:0.0:1789708674.902936:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357162880 00000100:00100000:0.0:1789708674.903029:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:0.0:1789708674.903040:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+54:15796:x1876645357162880:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789708674.903134:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+54:15796:x1876645357162880:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 96us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.903141:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:1.0:1789708674.904867:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.904953:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357163008 00000100:00100000:2.0:1789708674.904960:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357163008 00000100:00100000:2.0:1789708674.905157:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:2.0:1789708674.905167:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+54:15796:x1876645357163008:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708674.905184:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708674.905204:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e57f expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.905288:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e8de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.905307:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e8de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.905319:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e8de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708674.905364:0:19935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708674.905384:0:19935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e8de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.905424:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e57f expref: 56 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.905442:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e8de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e57f expref: 55 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.905451:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:2.0:1789708674.905454:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789708674.905457:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc200, rc 0) 00000100:00100000:2.0:1789708674.905547:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+55:15796:x1876645357163008:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 382us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.905552:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:3.0:1789708674.906912:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.906951:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357163136 00000100:00100000:2.0:1789708674.906958:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357163136 00000100:00100000:2.0:1789708674.907006:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789708674.907014:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f84d004b-f450-4582-bbe2-71415469e27b+6:2396:x1876645357163136:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708674.907027:0:18838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708674.907044:0:18838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e586 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708674.907065:0:18838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacc982, blocks: 0x0 00010000:00010000:2.0:1789708674.907082:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=245s v=(0 0) 00010000:00010000:2.0:1789708674.907086:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708674.907095:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e586 expref: 7 pid: 18838 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.907119:0:18838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e586 expref: 7 pid: 18838 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.907128:0:18838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebca00, rc 0) 00000100:00100000:2.0:1789708674.907163:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357163136:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 151us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.907167:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:1.0:1789708674.908418:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.908513:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357163392 00000100:00100000:3.0:1789708674.908518:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357163392 00000100:00100000:3.0:1789708674.908554:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:3.0:1789708674.908563:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+55:15796:x1876645357163392:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789708674.908631:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+55:15796:x1876645357163392:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 69us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.908638:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:1.0:1789708674.909956:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.909998:0:19635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357163520 00000100:00100000:3.0:1789708674.910004:0:19635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357163520 00000100:00100000:3.0:1789708674.910045:0:19635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:3.0:1789708674.910054:0:19635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f84d004b-f450-4582-bbe2-71415469e27b+7:15796:x1876645357163520:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708674.910080:0:19635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708674.910098:0:19635:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e58d expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.910125:0:19635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e586 expref: 8 pid: 18838 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.910132:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708674.910148:0:19635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708674.910153:0:19635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 8 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.910186:0:19635:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e586 expref: 8 pid: 18838 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.910199:0:19635:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e586 expref: 8 pid: 18838 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.910209:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:19635:1876645365558528:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708674.910300:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22180 going to sleep for 11 seconds 00000100:00100000:3.0:1789708674.911950:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:19635:1876645365558528:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708674.911977:0:19635:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 8 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.911994:0:19635:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103b400, rc 0) 00000100:00100000:1.0:1789708674.912005:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.912080:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357163648 00000100:00100000:2.0:1789708674.912088:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357163648 00010000:00010000:2.0:1789708674.912118:0:17891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e586 expref: 9 pid: 18838 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.912194:0:19635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f84d004b-f450-4582-bbe2-71415469e27b+9:15796:x1876645357163520:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 2140us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.912202:0:19635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708674.912296:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1789708674.912307:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+8:2395:x1876645357163648:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708674.912319:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708674.912352:0:17891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e586 expref: 8 pid: 18838 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.912365:0:17891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e586 expref: 8 pid: 18838 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.912384:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e586 expref: 8 pid: 18838 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.912409:0:17891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708674.912413:0:17891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708674.912421:0:17891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 7 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.912431:0:17891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 7 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.912460:0:17891:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 7 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.912472:0:17891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18000700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:17891:1876645365558656:192.168.201.52@tcp:105: 00000100:00100000:2.0:1789708674.912514:0:17891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f00cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708674.914130:0:17891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18000700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:17891:1876645365558656:192.168.201.52@tcp:105: 00010000:00010000:2.0:1789708674.914148:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708674.914190:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+7:2395:x1876645357163648:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 1885us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.914199:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:0.0:1789708674.915105:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.915161:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357163776 00000100:00100000:3.0:1789708674.915167:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357163776 00002000:00100000:3.0:1789708674.915200:0:18649:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->12) req@ffff9bee3fac4e00 x1876645357163776/t0(0) o4->f84d004b-f450-4582-bbe2-71415469e27b@192.168.201.52@tcp:60/0 lens 504/0 e 0 to 0 dl 1789708685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789708674.915208:0:18649:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee3fac4e00 with x1876645357163776 ext(0->12) 00002000:00010000:3.0:1789708674.915212:0:18649:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bee3fac4e00 00000100:00100000:3.0:1789708674.915300:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:3.0:1789708674.915309:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357163776:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789708674.916032:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f84d004b-f450-4582-bbe2-71415469e27b+9:2396:x1876645357163776:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 721us (926us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789708674.916040:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00002000:00100000:3.0:1789708674.916048:0:18649:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->12) req@ffff9bee3fac4e00 x1876645357163776/t8589934596(0) o4->f84d004b-f450-4582-bbe2-71415469e27b@192.168.201.52@tcp:60/0 lens 504/448 e 0 to 0 dl 1789708685 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789708674.916057:0:18649:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee3fac4e00 with x1876645357163776 ext(0->12) 00002000:00010000:3.0:1789708674.916060:0:18649:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bee3fac4e00 00000100:00100000:1.0:1789708674.917130:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.917198:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357163904 00000100:00100000:0.0:1789708674.917204:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357163904 00000100:00100000:0.0:1789708674.917304:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:0.0:1789708674.917313:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+55:15796:x1876645357163904:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789708674.918650:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365558784:0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.918659:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365558912:0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.918708:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708674.918738:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365559424:0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.918759:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708674.918778:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365559936:0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.918794:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365558912 00000100:00100000:1.0:1789708674.918803:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365558912 00000100:00100000:2.0:1789708674.918808:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708674.918830:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee10fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365560448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708674.918835:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365559424 00000100:00100000:2.0:1789708674.918853:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708674.918886:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789708674.918895:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365558912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.918939:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365558912:12345-0@lo:400:kworker.0 Request processed in 46us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.918943:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365559936 00000100:00100000:3.0:1789708674.918946:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365559936 00000100:00100000:2.0:1789708674.918946:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789708674.918965:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708674.918981:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365558912:0@lo:400:kworker.0 00000100:00100000:3.0:1789708674.918989:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789708674.918994:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365559936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.919031:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365559424 00000100:00100000:2.0:1789708674.919050:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365559168:0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.919053:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789708674.919058:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365559424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.919075:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708674.919086:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365559424:12345-0@lo:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.919092:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365559680:0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.919092:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789708674.919111:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708674.919126:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365560192:0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.919130:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365560448 00000100:00100000:1.0:1789708674.919133:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365560448 00000100:00100000:2.0:1789708674.919150:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708674.919161:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708674.919194:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708674.919220:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365559296:0@lo:400:kworker.0 00000100:00100000:0.0:1789708674.919247:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365558784 00000100:00100000:0.0:1789708674.919251:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365558784 00000100:00100000:0.0:1789708674.919335:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789708674.919341:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3617:x1876645365558784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.919400:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365560448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789708674.919416:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789708674.919543:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3617:x1876645365558784:12345-0@lo:400:kworker.0 Request processed in 202us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.919550:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1789708674.919583:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789708674.919708:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934657 is committed 00000004:00080000:0.0:1789708674.919716:0:17119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:0.0:1789708674.919738:0:17119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789708674.919762:0:17119:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bed04215c00 refcount 2 committed 0 result 0 batchid 4294967513 00000020:00080000:0.0:1789708674.919766:0:17119:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee3e94f200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bed04215180 00000020:00080000:0.0:1789708674.919769:0:17119:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee3e94ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bed01422a00 00010000:00010000:0.0:1789708674.919795:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919804:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919817:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919823:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.919827:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919834:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919903:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bee2c76a900) 00010000:00010000:0.0:1789708674.919905:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.919909:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919914:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47e676 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919930:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919934:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919937:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919940:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.919942:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919952:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919958:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bed08847200) 00010000:00010000:0.0:1789708674.919959:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.919961:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919964:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc000/0xf45f43947e47e709 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919973:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919977:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919981:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919983:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.919985:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919988:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.919991:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee08f48300) 00010000:00010000:0.0:1789708674.919993:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.919994:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920000:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e787 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920008:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920014:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920019:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920024:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.920027:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920032:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920040:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee08f48300) 00010000:00010000:0.0:1789708674.920042:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.920045:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920051:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492c00/0xf45f43947e47e7aa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920063:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920067:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920075:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920078:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.920080:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920083:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920089:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.920090:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708674.920092:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920096:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd800/0xf45f43947e47e80c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920102:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920106:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920109:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920112:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.920114:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920123:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920127:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:0.0:1789708674.920128:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789708674.920130:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.920133:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd200/0xf45f43947e47e8c9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789708674.920198:0:17179:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967513 committed batchid 8 00000020:00080000:0.0:1789708674.920242:0:17179:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1789708674.920370:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365560704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708674.920396:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708674.920410:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365560448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1013us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.920414:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [0->1] 00000100:00100000:1.0:1789708674.920416:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708674.920419:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365559040:0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.920430:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365560704 00000100:00100000:1.0:1789708674.920433:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365560704 00000100:00100000:2.0:1789708674.920438:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708674.920455:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365559552:0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.920490:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708674.920508:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365560064:0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.920529:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708674.920531:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708674.920537:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365560704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708674.920548:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789708674.920551:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee10fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365560576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708674.920567:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708674.920570:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365560704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.920575:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365561088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789708674.920576:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708674.920585:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365560576 00000100:00100000:1.0:1789708674.920588:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365560576 00000100:00100000:2.0:1789708674.920591:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708674.920605:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708674.920610:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365560576:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708674.920613:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789708674.920628:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365560704:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708674.920631:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789708674.920655:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365559168 00000100:00100000:2.0:1789708674.920659:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365559168 00000100:00100000:1.0:1789708674.920660:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365560576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708674.920665:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708674.920679:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365559680 00000100:00100000:2.0:1789708674.920682:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365559680 00000100:00100000:1.0:1789708674.920692:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee10fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365560576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708674.920696:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365559040 00000100:00100000:2.0:1789708674.920698:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365559040 00000100:00100000:2.0:1789708674.920709:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365559552 00000100:00100000:2.0:1789708674.920711:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365559552 00000100:00100000:2.0:1789708674.920720:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365561088 00000100:00100000:2.0:1789708674.920723:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365561088 00000100:00100000:1.0:1789708674.920728:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708674.920735:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789708674.920735:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365559168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.920739:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365559680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708674.920799:0:19634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708674.920807:0:19634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3616:x1876645365559040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708674.920808:0:19635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708674.920814:0:19635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365559552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.920854:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365559680:12345-0@lo:400:kworker.0 Request processed in 113us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.920860:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708674.920875:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789708674.920880:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3616:x1876645365561088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789708674.920897:0:18838:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:34 count 1 00010000:00010000:2.0:1789708674.920923:0:18838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.920942:0:18838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47e717 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e508 expref: 7 pid: 19636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.920957:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789708674.920961:0:18838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708674.920965:0:18838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.920990:0:18838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47e717 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e508 expref: 7 pid: 19636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.921002:0:18838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47e717 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e508 expref: 7 pid: 19636 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.921027:0:18838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:18838:1876645365561216:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708674.921248:0:18838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708674.921300:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365560960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789708674.921393:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708674.921420:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee10fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365560448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708674.921432:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365559424:0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.921462:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708674.921468:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365560832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708674.921490:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708674.921514:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365560832 00000100:00100000:2.0:1789708674.921518:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365560832 00000100:00100000:2.0:1789708674.921542:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708674.921545:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365559168:12345-0@lo:400:kworker.0 Request processed in 810us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708674.921552:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708674.921553:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3618:x1876645365560832:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708674.921562:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365560960 00002000:00000024:2.0:1789708674.921563:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789708674.921565:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365560960 00000100:00100000:1.0:1789708674.921579:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789708674.921584:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365560960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789708674.921592:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3618:x1876645365560832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.921597:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708674.921628:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365560832:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1789708674.921682:0:18645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789708674.921685:0:18645:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789708674 00002000:00010000:1.0:1789708674.921687:0:18645:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789708674.921689:0:18645:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789708674 -> 1789708674 00002000:00010000:1.0:1789708674.921691:0:18645:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789708674.921726:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365560960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (333us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789708674.921733:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789708674.921754:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708674.921776:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365559808:0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.921801:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708674.921822:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365560320:0@lo:400:kworker.0 00000100:00100000:3.0:1789708674.921834:0:19635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365559552:12345-0@lo:400:kworker.0 Request processed in 1020us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.921841:0:19635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708674.921859:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365560192 00000100:00100000:3.0:1789708674.921864:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365560192 00000100:00100000:3.0:1789708674.921895:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365560064 00000100:00100000:3.0:1789708674.921898:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365560064 00000100:00100000:3.0:1789708674.921911:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365559296 00000100:00100000:3.0:1789708674.921913:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365559296 00000100:00100000:3.0:1789708674.921926:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365559808 00000100:00100000:3.0:1789708674.921928:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365559808 00000100:00100000:3.0:1789708674.921939:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789708674.921944:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365560192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.921993:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708674.922001:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365560192:12345-0@lo:400:kworker.0 Request processed in 56us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708674.922015:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365558784:0@lo:400:kworker.0 00000100:00100000:3.0:1789708674.922018:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789708674.922028:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365560320 00000100:00100000:3.0:1789708674.922031:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365560320 00000100:00100000:1.0:1789708674.922035:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789708674.922041:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365560064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708674.922046:0:17140:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:3.0:1789708674.922051:0:17140:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1789708674.922070:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365560064:12345-0@lo:400:kworker.0 Request processed in 30us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708674.922077:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789708674.922090:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789708674.922095:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365559296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.922123:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365559296:12345-0@lo:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708674.922128:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789708674.922138:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789708674.922145:0:17138:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1789708674.922145:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365559808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708674.922151:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789708674.922156:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365560320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.922168:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365559808:12345-0@lo:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708674.922174:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789708674.922179:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365560320:12345-0@lo:400:kworker.0 Request processed in 23us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.922184:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789708674.922200:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365559296:0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.922211:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365559808:0@lo:400:kworker.0 00010000:00080000:1.0:1789708674.922221:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fa92d80 x1876645365560320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708674.922230:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365560320:0@lo:400:kworker.0 00000100:00080000:1.0:1789708674.922303:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789708674.922307:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789708674.922310:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708674.922312:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708674.922380:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+16:15796:x1876645357163904:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 5068us (5251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708674.922388:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:3.0:1789708674.922420:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365559936:12345-0@lo:400:kworker.0 Request processed in 3425us (3610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.922427:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1789708674.922467:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bee3fa91880/2, rc 0, transno 8589934597 00000100:00100000:3.0:1789708674.922473:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365560960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789708674.922483:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365559936:0@lo:400:kworker.0 00000100:00100000:0.0:1789708674.922999:0:19634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3616:x1876645365559040:12345-0@lo:400:kworker.0 Request processed in 2192us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.923007:0:19634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708674.924766:0:18838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:18838:1876645365561216:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708674.924792:0:18838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.924833:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365559040:0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.924847:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365559552:0@lo:400:kworker.0 00010000:00080000:2.0:1789708674.924860:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fa90000 x1876645365560064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708674.924869:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365560064:0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.924882:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365559168:0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.924892:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365559680:0@lo:400:kworker.0 00000100:00100000:2.0:1789708674.924903:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365560192:0@lo:400:kworker.0 00000100:00100000:1.0:1789708674.925025:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.925079:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357164032 00000100:00100000:2.0:1789708674.925086:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357164032 00000100:00100000:1.0:1789708674.925095:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.925173:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357164160 00000100:00100000:3.0:1789708674.925180:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357164160 00000100:00100000:2.0:1789708674.925316:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1789708674.925332:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+9:2395:x1876645357164032:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789708674.925510:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47e717 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e508 expref: 8 pid: 19636 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.925541:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1789708674.925550:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+8:2396:x1876645357164160:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708674.925562:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708674.925567:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47e717 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e508 expref: 8 pid: 19636 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.925580:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47e717 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e508 expref: 8 pid: 19636 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.925596:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47e717 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e508 expref: 8 pid: 19636 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.925607:0:17124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789708674.925610:0:17124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789708674.925614:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.925620:0:17124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.925654:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708674.925671:0:18838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.925679:0:18838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.925701:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357164160:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 153us (605us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708674.925701:0:18838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.925709:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00010000:00010000:0.0:1789708674.925709:0:18838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.925726:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708674.925786:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708674.925793:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.925800:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebca00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708674.925810:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.925819:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.925831:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.925837:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f3f98c/0xf45f43947e47e8f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.925854:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708674.925856:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708674.925857:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708674.926682:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3616:x1876645365561088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5799us (6086us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789708674.926692:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000004:00080000:2.0:1789708674.926839:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bee3fa92300/2, rc 0, transno 8589934601 00000100:00100000:2.0:1789708674.926846:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365561088:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789708674.927757:0:19461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1789708674.927765:0:19461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:2.0:1789708674.927917:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+6:2395:x1876645357164032:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 2591us (2890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.927926:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:1.0:1789708674.929598:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.929639:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357164416 00000100:00100000:2.0:1789708674.929648:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357164416 00000100:00100000:2.0:1789708674.929693:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:2.0:1789708674.929703:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+16:15796:x1876645357164416:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789708674.929750:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708674.929771:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e8de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e57f expref: 16 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.929793:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:2.0:1789708674.929797:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708674.929820:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.929829:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.929889:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708674.929988:0:17139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f08f67ac reply state 00000000316731c0 transno 8589934658 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.929996:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.930000:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:2.0:1789708674.930002:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789708674.930004:0:17139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708674.930087:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+17:15796:x1876645357164416:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 385us (493us total) trans 8589934658 rc 0/0 00000100:00100000:2.0:1789708674.930094:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:1.0:1789708674.931609:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.931664:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357164544 00000100:00100000:0.0:1789708674.931677:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357164544 00000100:00100000:0.0:1789708674.931727:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:0.0:1789708674.931736:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f84d004b-f450-4582-bbe2-71415469e27b+6:2395:x1876645357164544:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789708674.931936:0:18645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789708674.931939:0:18645:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789708674 -> 1789708674 00002000:00010000:0.0:1789708674.931941:0:18645:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789708674 00002000:00010000:0.0:1789708674.931943:0:18645:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789708674 -> 1789708674 00002000:00010000:0.0:1789708674.931944:0:18645:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789708674.931983:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f84d004b-f450-4582-bbe2-71415469e27b+7:2395:x1876645357164544:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 249us (378us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789708674.931991:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:1.0:1789708674.933884:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.933970:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357164800 00000100:00100000:3.0:1789708674.933979:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357164800 00000100:00100000:3.0:1789708674.934087:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:3.0:1789708674.934098:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+17:15796:x1876645357164800:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789708674.934167:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.934183:0:17140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e571 expref: 17 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.934192:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.934225:0:17140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e571 expref: 17 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.934238:0:17140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e571 expref: 17 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.934252:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876645365561344:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708674.934384:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708674.935885:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876645365561344:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708674.935910:0:17140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708674.936453:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708674.936523:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357164928 00000100:00100000:2.0:1789708674.936531:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357164928 00010000:00010000:2.0:1789708674.936565:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e571 expref: 18 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.936604:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1789708674.936627:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+18:2395:x1876645357164928:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708674.936641:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708674.936648:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e571 expref: 18 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.936659:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e571 expref: 18 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.936681:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492000/0xf45f43947e47e8c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e571 expref: 18 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.936696:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:2.0:1789708674.936701:0:17126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.936711:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.936718:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.936747:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708674.936762:0:17140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.936769:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.936801:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+17:2395:x1876645357164928:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 175us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.936808:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00010000:00010000:3.0:1789708674.936810:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.936817:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.936823:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.936829:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ba00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708674.936833:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.936841:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.936855:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:3.0:1789708674.936857:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789708674.936861:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.936878:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e901 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.936916:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+16:15796:x1876645357164800:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 2821us (3039us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789708674.936923:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:1.0:1789708674.938873:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.939086:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357165056 00000100:00100000:0.0:1789708674.939095:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357165056 00000100:00100000:0.0:1789708674.939147:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:0.0:1789708674.939168:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357165056:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789708674.939213:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.939234:0:18644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 7 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.939242:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708674.939246:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708674.939251:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.939475:0:18644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 7 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.939491:0:18644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 7 pid: 19635 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.939506:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18644:1876645365561472:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708674.939618:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708674.946439:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.946718:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18644:1876645365561472:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708674.946748:0:18644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.947537:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357165184 00000100:00100000:2.0:1789708674.947548:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357165184 00010000:00010000:2.0:1789708674.947584:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 8 pid: 19635 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.947638:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:2.0:1789708674.947648:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+8:2395:x1876645357165184:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708674.947663:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708674.947682:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 8 pid: 19635 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.947691:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 8 pid: 19635 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.947708:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009692303/0xf45f43947e47e8ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e58d expref: 8 pid: 19635 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.947720:0:17125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708674.947723:0:17125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708674.947728:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.947734:0:17125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.947754:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708674.947778:0:18644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.947792:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.947809:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+7:2395:x1876645357165184:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 163us (1379us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708674.947812:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708674.947816:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00010000:00010000:0.0:1789708674.947821:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.947827:0:18644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.947834:0:18644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708674.947838:0:18644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.947847:0:18644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.947858:0:18644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.947864:0:18644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a86f9cc/0xf45f43947e47e908 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.947918:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f84d004b-f450-4582-bbe2-71415469e27b+6:2396:x1876645357165056:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 8751us (9052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708674.947925:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1789708674.950120:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.950217:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357165440 00000100:00100000:0.0:1789708674.950227:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357165440 00000100:00100000:0.0:1789708674.950492:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:0.0:1789708674.950504:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+16:15796:x1876645357165440:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789708674.950576:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.950594:0:18837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e539 expref: 16 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.950605:0:18837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.950638:0:18837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e539 expref: 16 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.950650:0:18837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e539 expref: 16 pid: 19935 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.950665:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365561600:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708674.950769:0:18837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708674.952976:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.952995:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365561600:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708674.953033:0:18837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.953188:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357165568 00000100:00100000:3.0:1789708674.953196:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357165568 00010000:00010000:3.0:1789708674.953228:0:17891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e539 expref: 17 pid: 19935 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.953650:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1789708674.953662:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+17:2396:x1876645357165568:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708674.953676:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708674.953683:0:17891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e539 expref: 17 pid: 19935 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.954364:0:17891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e539 expref: 17 pid: 19935 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.954392:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492200/0xf45f43947e47e805 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e539 expref: 17 pid: 19935 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.954408:0:17891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:3.0:1789708674.954414:0:17891:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e867 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e55c expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.954441:0:17891:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.954449:0:17891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.954457:0:17891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.954491:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708674.954525:0:18837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.954535:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.954745:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.954759:0:18837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e8d0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e578 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.954767:0:18837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.954798:0:18837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e8d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e578 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.954811:0:18837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e8d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e578 expref: 17 pid: 17138 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.954825:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365561728:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708674.954949:0:18837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01ee1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789708674.955006:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84d004b-f450-4582-bbe2-71415469e27b+17:2396:x1876645357165568:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 1345us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708674.955017:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1789708674.957882:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.957926:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357165696 00000100:00100000:3.0:1789708674.957936:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357165696 00000100:00100000:0.0:1789708674.957950:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365561728:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708674.957976:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e8d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e578 expref: 17 pid: 17138 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.957977:0:18837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.958024:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:3.0:1789708674.958035:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+17:2395:x1876645357165696:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708674.958048:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708674.958054:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e8d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e578 expref: 17 pid: 17138 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.958066:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e8d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e578 expref: 17 pid: 17138 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.958088:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e8d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e578 expref: 17 pid: 17138 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.958169:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:3.0:1789708674.958180:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.958190:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.958197:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.958222:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708674.958243:0:18837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.958252:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.958318:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84d004b-f450-4582-bbe2-71415469e27b+16:2395:x1876645357165696:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 283us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.958326:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000001:00080000:0.0:1789708674.959194:0:18837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934659 00000001:00080000:0.0:1789708674.959415:0:18837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934660 00000001:00080000:0.0:1789708674.959451:0:18837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934661 00000100:00100000:0.0:1789708674.959747:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18837:1876645365561856:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789708674.959804:0:18837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708674.959880:0:18837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01759480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708674.959915:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365561856 00000100:00100000:1.0:1789708674.959922:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365561856 00000100:00100000:1.0:1789708674.959999:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789708674.960018:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:18837:x1876645365561856:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789708674.960090:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:18837:x1876645365561856:12345-0@lo:1000:mdt00_003.0 Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708674.960097:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789708674.960145:0:18837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789708674.960150:0:18837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bee3fa91880, transno 8589934597 00000100:00100000:0.0:1789708674.960166:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18837:1876645365561856:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789708674.960333:0:18837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934662 00000100:00100000:0.0:1789708674.960366:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18837:1876645365561984:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789708674.960396:0:18837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708674.960794:0:18837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed017599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708674.960824:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365561984 00000100:00100000:2.0:1789708674.960828:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365561984 00000100:00100000:2.0:1789708674.960851:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789708674.960857:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:18837:x1876645365561984:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789708674.961049:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18837:x1876645365561984:12345-0@lo:1000:mdt00_003.0 Request processed in 191us (652us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789708674.961056:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789708674.961154:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18837:1876645365561984:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789708674.961184:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961192:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961199:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961215:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.961218:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961225:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961238:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:0.0:1789708674.961240:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708674.961245:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961250:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493400/0xf45f43947e47e916 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961426:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961434:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961440:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961445:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708674.961448:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961455:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961473:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708674.961476:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708674.961482:0:18837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e867 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e55c expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961493:0:18837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e867 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e55c expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961502:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e867 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e55c expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708674.961528:0:18837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e867 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e55c expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708674.961539:0:18837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365562112:192.168.201.52@tcp:105: 00000100:00100000:0.0:1789708674.961592:0:18837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed017599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708674.964756:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708674.964829:0:18837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18837:1876645365562112:192.168.201.52@tcp:105: 00010000:00010000:1.0:1789708674.964855:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964878:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47e860 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964908:0:18837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e91d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964920:0:18837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e91d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964930:0:18837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e91d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964940:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e91d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964946:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e91d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964952:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e91d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964957:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708674.964961:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e91d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964968:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e91d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964978:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:1.0:1789708674.964981:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708674.964985:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e91d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.964997:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8000/0xf45f43947e47e91d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.965018:0:18837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.965024:0:18837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.965030:0:18837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.965035:0:18837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708674.965039:0:18837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.965044:0:18837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.965051:0:18837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:1.0:1789708674.965054:0:18837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789708674.965057:0:18837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708674.965063:0:18837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492600/0xf45f43947e47e90f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708674.965213:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84d004b-f450-4582-bbe2-71415469e27b+19:15796:x1876645357165440:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 14710us (15100us total) trans 8589934663 rc 0/0 00000100:00100000:1.0:1789708674.965222:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 114 00000020:00080000:1.0:1789708674.965234:0:18837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789708674.965486:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789708674.965490:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708674.965516:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1789708674.965530:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789708674.965731:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357165824 00000100:00100000:3.0:1789708674.965738:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357165824 00000100:00100000:3.0:1789708674.965773:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:3.0:1789708674.965781:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2d984850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+19:15794:x1876645357165824:12345-192.168.201.52@tcp:49:lfs.0 00000100:00100000:3.0:1789708674.965870:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2d984850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+19:15794:x1876645357165824:12345-192.168.201.52@tcp:49:lfs.0 Request processed in 89us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.965876:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:0.0:1789708674.969792:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708674.970003:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.970070:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357166336 00000100:00100000:3.0:1789708674.970080:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357166336 00000100:00100000:3.0:1789708674.970136:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:3.0:1789708674.970148:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+19:15794:x1876645357166336:12345-192.168.201.52@tcp:58:lfs.0 00000040:00080000:3.0:1789708674.970366:0:17138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 136 off8600 00000100:00100000:2.0:1789708674.970530:0:20282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357166080 00000100:00100000:2.0:1789708674.970535:0:20282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357166080 00000100:00100000:2.0:1789708674.970566:0:20282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789708674.970574:0:20282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+20:15796:x1876645357166080:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789708674.970751:0:20282:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789708674.970783:0:20282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00010000:00010000:2.0:1789708674.970813:0:20282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.970828:0:20282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.970840:0:20282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.970866:0:20282:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.970873:0:20282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.970879:0:20282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.970897:0:20282:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789708674.971316:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+22:15794:x1876645357166336:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 1169us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708674.971658:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:2.0:1789708674.971765:0:20282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+21:15796:x1876645357166080:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 1190us (1980us total) trans 8589934665 rc 0/0 00000100:00100000:2.0:1789708674.971772:0:20282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000020:00080000:2.0:1789708674.971776:0:20282:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789708674.971796:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708674.971802:0:18292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.971810:0:18292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708674.971813:0:18292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.971821:0:18292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.971832:0:18292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:2.0:1789708674.971834:0:18292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789708674.971839:0:18292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.971855:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47e924 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 20282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708674.971869:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708674.971871:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708674.971873:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708674.994603:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708674.994671:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357166464 00000100:00100000:3.0:1789708674.994683:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357166464 00000100:00100000:3.0:1789708674.994742:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:3.0:1789708674.994751:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f84d004b-f450-4582-bbe2-71415469e27b+21:15798:x1876645357166464:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708674.994773:0:20386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708674.994792:0:20386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e92b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e594 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.994852:0:20386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e932 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.994864:0:20386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e932 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.994875:0:20386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e932 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.994887:0:20386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e939 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.994894:0:20386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e939 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.994900:0:20386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e939 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.994969:0:20386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.994980:0:20386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e555 expref: 22 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.995007:0:20386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.995040:0:20386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e555 expref: 22 pid: 18837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708674.995054:0:20386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e555 expref: 22 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708674.995068:0:20386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20386:1876645365562240:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708674.995151:0:20386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708675.005493:0:20386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20386:1876645365562240:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708675.005523:0:20386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708675.007240:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708675.007972:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357166720 00000100:00100000:1.0:1789708675.007981:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357166720 00000100:00100000:0.0:1789708675.008137:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:0.0:1789708675.008145:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+23:14874:x1876645357166720:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789708675.008344:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+24:14874:x1876645357166720:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 199us (1109us total) trans 8589934666 rc 0/0 00000100:00100000:0.0:1789708675.008369:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:1.0:1789708675.010367:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708675.010623:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357166848 00000100:00100000:2.0:1789708675.010630:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357166848 00010000:00010000:2.0:1789708675.010658:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e555 expref: 24 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708675.010698:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:2.0:1789708675.010706:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+24:2396:x1876645357166848:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708675.010717:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708675.010723:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e555 expref: 24 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708675.010736:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e555 expref: 24 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708675.010756:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492a00/0xf45f43947e47e852 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e555 expref: 24 pid: 18837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708675.010770:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708675.010775:0:17126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708675.010783:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708675.010800:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708675.010833:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708675.010875:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84d004b-f450-4582-bbe2-71415469e27b+23:2396:x1876645357166848:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 170us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708675.010883:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00010000:00010000:3.0:1789708675.011125:0:20386:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011133:0:20386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708675.011176:0:20386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789708675.011180:0:20386:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708675.011195:0:20386:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011205:0:20386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011220:0:20386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e932 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011224:0:20386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e932 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011229:0:20386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e932 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011232:0:20386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ba00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708675.011235:0:20386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e932 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011240:0:20386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e932 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011246:0:20386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:3.0:1789708675.011247:0:20386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708675.011250:0:20386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e932 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011254:0:20386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e932 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011302:0:20386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e939 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011307:0:20386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e939 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011311:0:20386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e939 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011319:0:20386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708675.011322:0:20386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e939 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011325:0:20386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e939 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011330:0:20386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bee02bcb800) 00010000:00010000:3.0:1789708675.011332:0:20386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708675.011334:0:20386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e939 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011338:0:20386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e939 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011362:0:20386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e92b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e594 expref: 23 pid: 20386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011370:0:20386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e594 expref: 22 pid: 20386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708675.011374:0:20386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:3.0:1789708675.011376:0:20386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708675.011377:0:20386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103ae00, rc 0) 00000100:00100000:3.0:1789708675.011399:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f84d004b-f450-4582-bbe2-71415469e27b+22:15798:x1876645357166464:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 16651us (16805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708675.011403:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 116 00000040:00080000:1.0:1789708675.441699:0:20424:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789708675.441707:0:20424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708675.441745:0:20424:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1789708675.441756:0:20424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789708675.622459:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708676.006537:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789708676.006546:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708676.006574:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1789708676.006587:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789708676.006711:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17175:1876645365562368:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708676.006798:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07e3e900 going to sleep for 11 seconds 00000040:00080000:3.0:1789708676.006847:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789708676.010926:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708676.011076:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357166976 00000100:00100000:3.0:1789708676.011085:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357166976 00000100:00100000:3.0:1789708676.011212:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:3.0:1789708676.011223:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+23:15810:x1876645357166976:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000100:00100000:2.0:1789708676.011229:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17175:1876645365562368:192.168.201.52@tcp:107:hsm_cdtr.0 00000004:00000080:3.0:1789708676.011292:0:19935:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789708676.011427:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+22:15810:x1876645357166976:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 205us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708676.011435:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00080000:1.0:1789708676.011599:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708676.015247:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708676.015553:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357167232 00000100:00100000:3.0:1789708676.015564:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357167232 00000100:00100000:3.0:1789708676.015686:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:3.0:1789708676.015698:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+22:15810:x1876645357167232:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708676.015720:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708676.015741:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e947 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e59b expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708676.015847:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e94e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708676.015858:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e94e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708676.015866:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e94e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708676.015874:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789708676.015965:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e947 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e59b expref: 25 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708676.016007:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e94e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e59b expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708676.016015:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:3.0:1789708676.016018:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708676.016022:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103b600, rc 0) 00000100:00100000:3.0:1789708676.016074:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+24:15810:x1876645357167232:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 380us (842us total) trans 8589934667 rc 0/0 00000100:00100000:3.0:1789708676.016081:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:2.0:1789708676.019070:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708676.019230:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357167488 00000100:00100000:0.0:1789708676.019240:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357167488 00000100:00100000:0.0:1789708676.019596:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:0.0:1789708676.019606:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+24:15810:x1876645357167488:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789708676.019678:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e95c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708676.019692:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e95c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708676.019702:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e95c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708676.019852:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e95c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708676.019860:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e95c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708676.019869:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e95c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708676.019875:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708676.019879:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e95c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708676.019887:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e95c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708676.019919:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:0.0:1789708676.019922:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708676.019928:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e95c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708676.019934:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47e95c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708676.020367:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789708676.020373:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708676.020754:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 4 00000040:00080000:2.0:1789708676.020771:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789708676.021089:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+25:15810:x1876645357167488:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 1479us (2020us total) trans 8589934668 rc 0/0 00000100:00100000:0.0:1789708676.021102:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:1.0:1789708676.026190:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708676.026292:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357167616 00000100:00100000:2.0:1789708676.026305:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357167616 00000100:00100000:2.0:1789708676.026381:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:2.0:1789708676.026393:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+25:2395:x1876645357167616:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708676.026410:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708676.026435:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47e94e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e59b expref: 25 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708676.026467:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708676.026474:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708676.026531:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84d004b-f450-4582-bbe2-71415469e27b+24:2395:x1876645357167616:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 141us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708676.026541:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1789708676.028510:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708676.028591:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357167872 00000100:00100000:2.0:1789708676.028599:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357167872 00000100:00100000:2.0:1789708676.028708:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1789708676.028716:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+24:15810:x1876645357167872:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789708676.028881:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+25:15810:x1876645357167872:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 165us (378us total) trans 8589934669 rc 0/0 00000100:00100000:2.0:1789708676.028889:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00010000:00010000:2.0:1789708676.647683:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789708677.018970:0:20475:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789708677.018979:0:20475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789708677.019021:0:20475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:0.0:1789708677.019034:0:20475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789708677.133697:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708677.133766:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357168128 00000100:00100000:3.0:1789708677.133777:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357168128 00000100:00100000:3.0:1789708677.133836:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:3.0:1789708677.133847:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+25:15830:x1876645357168128:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708677.133872:0:19935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708677.133894:0:19935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e963 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e5a2 expref: -99 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708677.134028:0:19935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e96a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708677.134045:0:19935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e96a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708677.134058:0:19935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e96a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708677.134070:0:19935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789708677.134200:0:19935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103bc00/0xf45f43947e47e963 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5a2 expref: 28 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708677.134219:0:19935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e96a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5a2 expref: 27 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708677.134241:0:19935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:3.0:1789708677.134244:0:19935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789708677.134248:0:19935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103ba00, rc 0) 00000100:00100000:3.0:1789708677.134552:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+27:15830:x1876645357168128:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 706us (865us total) trans 8589934670 rc 0/0 00000100:00100000:3.0:1789708677.134561:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:0.0:1789708677.136896:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708677.137059:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357168256 00000100:00100000:1.0:1789708677.137071:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357168256 00000100:00100000:1.0:1789708677.137141:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:1.0:1789708677.137154:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+27:15830:x1876645357168256:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1789708677.137242:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e978 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708677.137792:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e978 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708677.137808:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e978 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708677.137851:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e978 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708677.137859:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e978 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708677.137884:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e978 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708677.137890:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708677.137896:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e978 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708677.137905:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e978 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708677.137918:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:1.0:1789708677.137921:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708677.137926:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e978 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708677.137932:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9400/0xf45f43947e47e978 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708677.138077:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+27:15830:x1876645357168256:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 924us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708677.138085:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:1.0:1789708677.224561:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708677.224649:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357168384 00000100:00100000:0.0:1789708677.224661:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357168384 00000100:00100000:0.0:1789708677.224748:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:0.0:1789708677.224761:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+6:2395:x1876645357168384:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1789708677.224781:0:19636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708677.224804:0:19636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e97f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e5a9 expref: -99 pid: 19636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708677.224830:0:19636:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 13, mtime: 0x6aacc982, atime: 0x6aacc982, ctime: 0x6aacc982, blocks: 0x8 00010000:00010000:0.0:1789708677.224852:0:19636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=248s v=(0 0) 00010000:00010000:0.0:1789708677.224871:0:19636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708677.224881:0:19636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5a9 expref: 7 pid: 19636 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708677.224901:0:19636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5a9 expref: 7 pid: 19636 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708677.224917:0:19636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30493800, rc 0) 00000100:00080000:1.0:1789708677.225043:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708677.225143:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+7:2395:x1876645357168384:12345-192.168.201.52@tcp:101:cat.0 Request processed in 383us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708677.225151:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:1.0:1789708677.227555:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708677.227645:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357168512 00000100:00100000:0.0:1789708677.227655:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357168512 00002000:00100000:0.0:1789708677.227707:0:18651:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x22:0x0] (0->4095) req@ffff9bee086d3480 x1876645357168512/t0(0) o3->f84d004b-f450-4582-bbe2-71415469e27b@192.168.201.52@tcp:63/0 lens 488/0 e 0 to 0 dl 1789708688 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789708677.227720:0:18651:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086d3480 with x1876645357168512 ext(0->4095) 00002000:00010000:0.0:1789708677.227727:0:18651:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bee086d3480 00000100:00100000:0.0:1789708677.227801:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1789708677.227812:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f84d004b-f450-4582-bbe2-71415469e27b+7:2397:x1876645357168512:12345-192.168.201.52@tcp:3:cat.0 00000100:00100000:0.0:1789708677.227998:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f84d004b-f450-4582-bbe2-71415469e27b+7:2397:x1876645357168512:12345-192.168.201.52@tcp:3:cat.0 Request processed in 187us (451us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789708677.228007:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00002000:00100000:0.0:1789708677.228014:0:18651:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x22:0x0] (0->4095) req@ffff9bee086d3480 x1876645357168512/t0(0) o3->f84d004b-f450-4582-bbe2-71415469e27b@192.168.201.52@tcp:63/0 lens 488/4536 e 0 to 0 dl 1789708688 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789708677.228023:0:18651:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086d3480 with x1876645357168512 ext(0->4095) 00002000:00010000:0.0:1789708677.228043:0:18651:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bee086d3480 00010000:00010000:0.0:1789708677.673446:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708677.858130:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708677.858356:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357168640 00000100:00100000:3.0:1789708677.858369:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357168640 00000100:00100000:3.0:1789708677.858429:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 157 00000100:00100000:3.0:1789708677.858440:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:2396:x1876645357168640:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708677.858531:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:2396:x1876645357168640:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 92us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708677.858540:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 157 00000100:00100000:2.0:1789708677.861645:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708677.861680:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708677.861703:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708677.861724:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708677.861744:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708677.861766:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708677.861797:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357168896 00000100:00100000:2.0:1789708677.861805:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357168896 00000100:00100000:2.0:1789708677.861859:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357169280 00000100:00100000:2.0:1789708677.861862:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357169280 00000100:00100000:2.0:1789708677.861883:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357169408 00000100:00100000:2.0:1789708677.861886:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357169408 00000100:00100000:2.0:1789708677.861921:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1789708677.861931:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357168896:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708677.862001:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+7:2396:x1876645357168896:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 71us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708677.862009:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1789708677.862028:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:2.0:1789708677.862036:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2395:x1876645357169280:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708677.862060:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2395:x1876645357169280:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708677.862066:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:2.0:1789708677.862077:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1789708677.862083:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2396:x1876645357169408:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708677.862107:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2396:x1876645357169408:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 24us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708677.862113:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1789708677.862130:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357168768 00000100:00100000:2.0:1789708677.862133:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357168768 00000100:00100000:2.0:1789708677.862159:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357169024 00000100:00100000:2.0:1789708677.862163:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357169024 00000100:00100000:2.0:1789708677.862184:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357169152 00000100:00100000:2.0:1789708677.862187:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357169152 00000100:00100000:2.0:1789708677.862219:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789708677.862228:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f84d004b-f450-4582-bbe2-71415469e27b+5:2395:x1876645357168768:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708677.862286:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f84d004b-f450-4582-bbe2-71415469e27b+5:2395:x1876645357168768:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 32us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708677.862303:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789708677.862317:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708677.862324:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:2395:x1876645357169024:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708677.862353:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:2395:x1876645357169024:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 30us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708677.862358:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708677.862370:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1789708677.862375:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2396:x1876645357169152:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708677.862413:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2396:x1876645357169152:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 37us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708677.862419:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00080000:2.0:1789708677.862463:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708677.862467:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708677.862470:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789708677.862471:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789708678.096389:0:18640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:3.0:1789708678.096405:0:18640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:2.0:1789708678.694739:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708679.016326:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708679.016360:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365562496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708679.016463:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708679.016523:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365562624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708679.016808:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365562496 00000100:00100000:1.0:1789708679.016818:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365562496 00000100:00100000:1.0:1789708679.016887:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789708679.016897:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365562496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708679.016952:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789708679.023516:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708679.023561:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365562624 00000100:00100000:1.0:1789708679.023572:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365562624 00000100:00100000:1.0:1789708679.023627:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789708679.023639:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365562624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789708679.023686:0:18670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789708679.023750:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365562624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708679.023900:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365562496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7001us (7435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708679.024511:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789708679.024569:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365562624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708679.024577:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365562496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708679.024642:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1789708679.718496:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708680.038420:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365562752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708680.038507:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708680.038598:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365562752 00000100:00100000:1.0:1789708680.038607:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365562752 00000100:00100000:1.0:1789708680.038665:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789708680.038675:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365562752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789708680.038710:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789708680.038751:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365562752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.038759:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789708680.038779:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708680.038834:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365562752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708680.040517:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365562880:0@lo:400:kworker.0 00000100:00100000:0.0:1789708680.040588:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708680.040626:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365563392:0@lo:400:kworker.0 00000100:00100000:0.0:1789708680.040664:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708680.040683:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365563904:0@lo:400:kworker.0 00000100:00100000:0.0:1789708680.040702:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708680.040723:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789708680.040728:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365563008:0@lo:400:kworker.0 00000100:00100000:0.0:1789708680.040752:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708680.040770:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365563520:0@lo:400:kworker.0 00000100:00100000:0.0:1789708680.040790:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708680.040805:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365564032:0@lo:400:kworker.0 00000100:00100000:0.0:1789708680.040823:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708680.040852:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365563008 00000100:00100000:0.0:1789708680.040860:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365563008 00000100:00100000:1.0:1789708680.041082:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365563520 00000100:00100000:1.0:1789708680.041087:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365563520 00000100:00100000:1.0:1789708680.041135:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789708680.041143:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365563520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041309:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365563520:12345-0@lo:400:kworker.0 Request processed in 166us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.041317:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789708680.041344:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365563264:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041370:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708680.041387:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365563776:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041405:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708680.041418:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365564288:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041434:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708680.041449:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789708680.041453:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365563136:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041470:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708680.041484:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365563648:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041500:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708680.041512:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876645365564160:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041533:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708680.041554:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365563264 00000100:00100000:1.0:1789708680.041558:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365563264 00000100:00100000:1.0:1789708680.041590:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365563136 00000100:00100000:1.0:1789708680.041592:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365563136 00000100:00100000:1.0:1789708680.041608:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365563648 00000100:00100000:1.0:1789708680.041610:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365563648 00000100:00100000:1.0:1789708680.041626:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708680.041632:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365563264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041672:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365563264:12345-0@lo:400:kworker.0 Request processed in 41us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.041679:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708680.041690:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789708680.041695:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365563136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041716:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365563136:12345-0@lo:400:kworker.0 Request processed in 22us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.041722:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789708680.041730:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708680.041734:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365563648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041754:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365563648:12345-0@lo:400:kworker.0 Request processed in 19us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.041759:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708680.041773:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365563392 00000100:00100000:1.0:1789708680.041776:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365563392 00000100:00100000:1.0:1789708680.041793:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365563904 00000100:00100000:1.0:1789708680.041795:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365563904 00000100:00100000:1.0:1789708680.041804:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365564032 00000100:00100000:1.0:1789708680.041806:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365564032 00000100:00100000:1.0:1789708680.041815:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365563776 00000100:00100000:1.0:1789708680.041817:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365563776 00000100:00100000:1.0:1789708680.041827:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365564288 00000100:00100000:1.0:1789708680.041829:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365564288 00000100:00100000:1.0:1789708680.041839:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365564160 00000100:00100000:1.0:1789708680.041841:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365564160 00000100:00100000:1.0:1789708680.041852:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789708680.041857:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365563392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.041882:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365563392:12345-0@lo:400:kworker.0 Request processed in 26us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.041893:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789708680.041904:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708680.042116:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789708680.042129:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365563008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708680.042164:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365563008:12345-0@lo:400:kworker.0 Request processed in 42us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708680.042183:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789708680.042223:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789708680.042233:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789708680.042237:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789708680.042239:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708680.042252:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365564416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708680.042299:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708680.042340:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365563008:0@lo:400:kworker.0 00000100:00100000:0.0:1789708680.042352:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365563520:0@lo:400:kworker.0 00000100:00100000:0.0:1789708680.042362:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365563392:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.042377:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365563904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708680.042413:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934601 gen 2 00000100:00100000:1.0:1789708680.042415:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365563904:12345-0@lo:400:kworker.0 Request processed in 506us (1712us total) trans 0 rc 0/0 00000004:00080000:0.0:1789708680.042419:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934601 00000100:00100000:1.0:1789708680.042421:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789708680.042433:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789708680.042439:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365564032:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1789708680.042446:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bee3fa92300, transno 8589934601 00000100:00100000:0.0:1789708680.042459:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365563136:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.042465:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365564032:12345-0@lo:400:kworker.0 Request processed in 27us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.042470:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789708680.042472:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365563648:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.042481:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708680.042481:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365563264:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.042486:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365563776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.042515:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365563776:12345-0@lo:400:kworker.0 Request processed in 29us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.042521:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789708680.042531:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789708680.042537:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365564288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.042561:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365564288:12345-0@lo:400:kworker.0 Request processed in 25us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.042566:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789708680.042576:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789708680.042581:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876645365564160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.042624:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876645365564160:12345-0@lo:400:kworker.0 Request processed in 43us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.042634:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789708680.042652:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365564416 00000100:00100000:1.0:1789708680.042656:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365564416 00000100:00100000:1.0:1789708680.042679:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708680.042685:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365564416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789708680.042701:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789708680.042733:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365564416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.042739:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708680.042764:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876645365564160:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.042774:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365563776:0@lo:400:kworker.0 00010000:00080000:1.0:1789708680.042784:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08beb800 x1876645365564288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708680.042795:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365564288:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.042825:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365564416:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789708680.042842:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08be9500 x1876645365564032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708680.042852:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365564032:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.042864:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365563904:0@lo:400:kworker.0 00000100:00100000:2.0:1789708680.043365:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365564544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708680.043405:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708680.043442:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365562880 00000100:00100000:2.0:1789708680.043447:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365562880 00000100:00100000:2.0:1789708680.043478:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789708680.043485:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3615:x1876645365562880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708680.043522:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3615:x1876645365562880:12345-0@lo:400:kworker.0 Request processed in 36us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708680.043538:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789708680.043620:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708680.043629:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee10fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365564672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708680.043666:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708680.043703:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365562880:0@lo:400:kworker.0 00000100:00100000:1.0:1789708680.043855:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365564544 00000100:00100000:1.0:1789708680.043859:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365564544 00000100:00100000:1.0:1789708680.043893:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365564672 00000100:00100000:1.0:1789708680.043896:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365564672 00000100:00100000:1.0:1789708680.043919:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708680.043925:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365564544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789708680.043952:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789708680.044675:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365564544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 747us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708680.044680:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365564544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708680.044681:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708680.044697:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789708680.044705:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365564672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708680.044717:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789708680.044789:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365564672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.044795:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708680.044858:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee10fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365564672:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789708680.156809:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934670 is committed 00000020:00080000:2.0:1789708680.156850:0:17119:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bed01759540 refcount 2 committed 0 result 0 batchid 4294967514 00000020:00080000:2.0:1789708680.156856:0:17119:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee3e94fa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bed01759480 00000020:00080000:2.0:1789708680.156860:0:17119:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee3e94f500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bed01746e00 00010000:00010000:1.0:1789708680.156860:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708680.156873:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789708680.156882:0:17119:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967513 batchid updated 00010000:00010000:1.0:1789708680.156886:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708680.156894:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708680.156900:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789708680.156910:0:17179:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967514 committed batchid 4294967513 00010000:00010000:1.0:1789708680.156956:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708680.156974:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9bee08f48b00) 00010000:00010000:1.0:1789708680.156991:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708680.156997:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708680.157002:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47e8fa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789708680.157003:0:17179:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967513 00010000:00010000:2.0:1789708680.743472:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708680.962874:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708680.962963:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357169536 00000100:00100000:1.0:1789708680.962975:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357169536 00000100:00100000:1.0:1789708680.963059:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:1.0:1789708680.963070:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+13:15540:x1876645357169536:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789708680.963183:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84d004b-f450-4582-bbe2-71415469e27b+13:15540:x1876645357169536:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 Request processed in 115us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.963190:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00080000:0.0:1789708680.963249:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708680.968927:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708680.969000:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357169664 00000100:00100000:0.0:1789708680.969014:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357169664 00000100:00100000:0.0:1789708680.969125:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:0.0:1789708680.969139:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+5:15540:x1876645357169664:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1789708680.969377:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708680.969663:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+5:15540:x1876645357169664:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 Request processed in 527us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708680.969672:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:2.0:1789708680.972182:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708680.972291:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357169920 00000100:00100000:0.0:1789708680.972305:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357169920 00000100:00100000:0.0:1789708680.972386:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:0.0:1789708680.972400:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+13:15540:x1876645357169920:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789708680.972661:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84d004b-f450-4582-bbe2-71415469e27b+14:15540:x1876645357169920:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 264us (489us total) trans 8589934671 rc 0/0 00000100:00100000:0.0:1789708680.972670:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000001:00080000:3.0:1789708681.068231:0:19461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1789708681.068245:0:19461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000040:00080000:0.0:1789708681.127122:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789708681.127131:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789708681.127170:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:0.0:1789708681.127188:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789708681.766504:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789708682.487048:0:20672:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 01:18:01 (1789708681) 00010000:00010000:2.0:1789708682.790390:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708682.975666:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708682.976742:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357170048 00000100:00100000:3.0:1789708682.976754:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357170048 00000100:00100000:3.0:1789708682.976802:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 159 00000100:00100000:3.0:1789708682.976811:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f57a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:2395:x1876645357170048:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708682.976890:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f57a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:2395:x1876645357170048:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 80us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708682.976898:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 159 00000100:00100000:2.0:1789708682.981296:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708682.981331:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708682.981358:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708682.981376:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708682.981395:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708682.981417:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708682.981436:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708682.981457:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708682.981482:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357170176 00000100:00100000:2.0:1789708682.981491:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357170176 00000100:00100000:2.0:1789708682.981543:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357170304 00000100:00100000:2.0:1789708682.981546:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357170304 00000100:00100000:3.0:1789708682.981661:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357170688 00000100:00100000:3.0:1789708682.981664:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357170688 00000100:00100000:3.0:1789708682.981684:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357170816 00000100:00100000:3.0:1789708682.981686:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357170816 00000100:00100000:3.0:1789708682.981696:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1789708682.981702:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+14:2395:x1876645357170176:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708682.981757:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+14:2395:x1876645357170176:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 56us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708682.981762:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1789708682.981780:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:3.0:1789708682.981783:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:2396:x1876645357170688:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708682.981811:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:2396:x1876645357170688:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708682.981815:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:3.0:1789708682.981823:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:3.0:1789708682.981827:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2395:x1876645357170816:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708682.981838:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2395:x1876645357170816:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 11us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708682.981841:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:3.0:1789708682.981934:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357170432 00000100:00100000:3.0:1789708682.981937:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357170432 00000100:00100000:3.0:1789708682.981954:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357170560 00000100:00100000:3.0:1789708682.981955:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357170560 00000100:00100000:3.0:1789708682.981964:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357171072 00000100:00100000:3.0:1789708682.981965:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357171072 00000100:00100000:3.0:1789708682.981975:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357170944 00000100:00100000:3.0:1789708682.981976:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357170944 00000100:00100000:3.0:1789708682.981985:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789708682.981988:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+5:2395:x1876645357170432:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708682.982007:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+5:2395:x1876645357170432:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 18us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708682.982011:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789708682.982017:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1789708682.982021:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+6:2395:x1876645357170560:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708682.982040:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f84d004b-f450-4582-bbe2-71415469e27b+6:2395:x1876645357170560:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 18us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708682.982055:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1789708682.982067:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:3.0:1789708682.982073:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2395:x1876645357171072:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708682.982094:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2395:x1876645357171072:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 22us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708682.982098:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:3.0:1789708682.982107:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1789708682.982124:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2396:x1876645357170944:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708682.982146:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2396:x1876645357170944:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 33us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708682.982152:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00080000:3.0:1789708682.982183:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789708682.982186:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789708682.982187:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708682.982189:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708682.982452:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:2.0:1789708682.982459:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+5:2395:x1876645357170304:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708682.982487:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84d004b-f450-4582-bbe2-71415469e27b+5:2395:x1876645357170304:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 30us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708682.982491:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00010000:00010000:2.0:1789708683.815661:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708684.135475:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708684.135498:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365564800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708684.135631:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708684.136500:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365564800 00000100:00100000:1.0:1789708684.136509:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365564800 00000100:00100000:1.0:1789708684.136568:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789708684.136578:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365564800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708684.136609:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789708684.136658:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365564800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708684.136665:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789708684.136709:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365564800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708684.137223:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365564928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789708684.137251:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708684.137313:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365564928 00000100:00100000:0.0:1789708684.137317:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365564928 00000100:00100000:0.0:1789708684.137352:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789708684.137361:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365564928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789708684.137380:0:18670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789708684.137416:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365564928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708684.137422:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789708684.137446:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365564928:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789708684.839537:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708685.158578:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708685.158602:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365565056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708685.158675:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708685.158883:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365565056 00000100:00100000:2.0:1789708685.158892:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365565056 00000100:00100000:2.0:1789708685.158944:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789708685.158955:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365565056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789708685.158998:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789708685.159045:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365565056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708685.159052:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789708685.159083:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708685.159093:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365565184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708685.159120:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708685.159148:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365565184 00000100:00100000:2.0:1789708685.159286:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365565184 00000100:00100000:2.0:1789708685.159310:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708685.159316:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365565184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789708685.159326:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789708685.159353:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365565184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708685.159359:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708685.159386:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 2 00000004:00080000:2.0:1789708685.159390:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934599 00000100:00100000:2.0:1789708685.159434:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365565184:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789708685.159501:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708685.159586:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365565056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708685.160350:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365565568:0@lo:400:kworker.0 00000100:00100000:0.0:1789708685.160385:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708685.160409:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365566080:0@lo:400:kworker.0 00000100:00100000:0.0:1789708685.160428:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708685.160440:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365566592:0@lo:400:kworker.0 00000100:00100000:0.0:1789708685.160459:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708685.160475:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789708685.160480:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365565440:0@lo:400:kworker.0 00000100:00100000:0.0:1789708685.160500:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708685.160649:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365565952:0@lo:400:kworker.0 00000100:00100000:0.0:1789708685.160672:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708685.160685:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365566464:0@lo:400:kworker.0 00000100:00100000:0.0:1789708685.160703:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708685.160727:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365565440 00000100:00100000:0.0:1789708685.160732:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365565440 00000100:00100000:0.0:1789708685.160772:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789708685.160779:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365565440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708685.161471:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365565440:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.161756:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365565568 00000100:00100000:3.0:1789708685.161760:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365565568 00000100:00100000:3.0:1789708685.161792:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365565952 00000100:00100000:3.0:1789708685.161795:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365565952 00000100:00100000:3.0:1789708685.161811:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789708685.161817:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365565568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708685.161887:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365565440:12345-0@lo:400:kworker.0 Request processed in 1108us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708685.161895:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789708685.161930:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708685.161940:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365565952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708685.161996:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365566080 00000100:00100000:1.0:1789708685.162000:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365566080 00000100:00100000:1.0:1789708685.162029:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365566592 00000100:00100000:1.0:1789708685.162031:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365566592 00000100:00100000:1.0:1789708685.162045:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365566464 00000100:00100000:1.0:1789708685.162047:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365566464 00000100:00100000:1.0:1789708685.162062:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789708685.162067:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365566080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708685.163179:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789708685.163189:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365566592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.165287:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365565568:12345-0@lo:400:kworker.0 Request processed in 3463us (4895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708685.165300:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789708685.165347:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789708685.165358:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365566464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.165402:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365566464:12345-0@lo:400:kworker.0 Request processed in 49us (4698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708685.165409:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1789708685.165433:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789708685.165438:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708685.165441:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708685.165462:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365565696:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.165498:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708685.165536:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365566208:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.165559:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708685.165577:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365566720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708685.165599:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708685.165623:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789708685.165630:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365565312:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.165658:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708685.165683:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365565824:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.165705:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708685.165724:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365566336:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.165746:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708685.165757:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365566848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708685.165793:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708685.165818:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365565312 00000100:00100000:3.0:1789708685.165825:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365565312 00000100:00100000:3.0:1789708685.165854:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789708685.165860:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2f579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3617:x1876645365565312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.165894:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2f579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3617:x1876645365565312:12345-0@lo:400:kworker.0 Request processed in 34us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708685.165901:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789708685.165925:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365565696 00000100:00100000:3.0:1789708685.165928:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365565696 00000100:00100000:3.0:1789708685.165941:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365566208 00000100:00100000:3.0:1789708685.165943:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365566208 00000100:00100000:3.0:1789708685.165959:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365566336 00000100:00100000:3.0:1789708685.165961:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365566336 00000100:00100000:3.0:1789708685.165972:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789708685.165976:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365565696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.166003:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365565696:12345-0@lo:400:kworker.0 Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708685.166008:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789708685.166017:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789708685.166022:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365566208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.166042:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365566208:12345-0@lo:400:kworker.0 Request processed in 21us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708685.166047:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789708685.166055:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789708685.166060:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365566336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.166214:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365566336:12345-0@lo:400:kworker.0 Request processed in 153us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708685.166227:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789708685.166248:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708685.166250:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708685.166296:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365566464:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.166306:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365565568:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.166333:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365565312:0@lo:400:kworker.0 00010000:00080000:3.0:1789708685.166343:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08beb800 x1876645365566336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708685.166353:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365566336:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.166361:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365565696:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.166369:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365566208:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.166418:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365566720 00000100:00100000:3.0:1789708685.166422:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365566720 00000100:00100000:3.0:1789708685.166441:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365566848 00000100:00100000:3.0:1789708685.166443:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365566848 00000100:00100000:3.0:1789708685.166455:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789708685.166461:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1876645365566720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789708685.166484:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708685.166518:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1876645365566720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708685.166524:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789708685.166536:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789708685.166542:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365566848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708685.166560:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708685.166583:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365566848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708685.166589:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789708685.166621:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365566848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708685.166636:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365566720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708685.166682:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365565824 00000100:00100000:3.0:1789708685.166686:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365565824 00000100:00100000:3.0:1789708685.166711:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789708685.166718:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365565824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.166755:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365565824:12345-0@lo:400:kworker.0 Request processed in 38us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708685.166761:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789708685.166783:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365565824:0@lo:400:kworker.0 00000100:00100000:0.0:1789708685.167944:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365565952:12345-0@lo:400:kworker.0 Request processed in 6001us (7264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708685.167954:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789708685.168337:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365566080:12345-0@lo:400:kworker.0 Request processed in 6266us (7905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708685.168345:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789708685.168532:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365565952:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.168547:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365566080:0@lo:400:kworker.0 00000100:00100000:2.0:1789708685.170291:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365566592:12345-0@lo:400:kworker.0 Request processed in 7096us (9823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708685.170307:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789708685.171135:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fa93800 x1876645365566592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708685.171209:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365566592:0@lo:400:kworker.0 00000100:00100000:3.0:1789708685.440113:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708685.440415:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357171328 00000100:00100000:0.0:1789708685.440426:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357171328 00000100:00100000:0.0:1789708685.440517:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:0.0:1789708685.440529:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+14:16503:x1876645357171328:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:0.0:1789708685.440779:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84d004b-f450-4582-bbe2-71415469e27b+15:16503:x1876645357171328:12345-192.168.201.52@tcp:35:umount.0 Request processed in 251us (673us total) trans 8589934672 rc 0/0 00000100:00100000:0.0:1789708685.440793:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00080000:0.0:1789708685.445188:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789708685.447337:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934672 is committed 00000020:00080000:2.0:1789708685.447357:0:17119:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967514 batchid updated 00000020:00080000:3.0:1789708685.447507:0:17179:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967514 00000020:00080000:3.0:1789708685.447521:0:17179:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967514 00000100:00100000:2.0:1789708685.449107:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708685.449204:0:20282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357171584 00000100:00100000:1.0:1789708685.449215:0:20282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357171584 00000100:00100000:1.0:1789708685.449306:0:20282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1789708685.449317:0:20282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2d987450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+13:16503:x1876645357171584:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:1.0:1789708685.449647:0:20282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2d987450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f84d004b-f450-4582-bbe2-71415469e27b+14:16503:x1876645357171584:12345-192.168.201.52@tcp:35:umount.0 Request processed in 331us (547us total) trans 8589934673 rc 0/0 00000100:00100000:1.0:1789708685.449655:0:20282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:3.0:1789708685.458408:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708685.458534:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708685.464301:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708685.464398:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708685.464451:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357172096 00000100:00100000:1.0:1789708685.464462:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357172096 00000100:00100000:1.0:1789708685.464534:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:1.0:1789708685.464545:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+6:2394:x1876645357172096:12345-192.168.201.52@tcp:9:umount.0 00000020:00000080:1.0:1789708685.464577:0:18646:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e2d3 00000020:00010000:1.0:1789708685.464590:0:18646:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bee3d93f800: total 0 00000100:00080000:1.0:1789708685.464595:0:18646:0:(import.c:65:import_set_state_nolock()) ffff9bee3d93c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789708685.464638:0:18646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1789708685.464791:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84d004b-f450-4582-bbe2-71415469e27b+4:2394:x1876645357172096:12345-192.168.201.52@tcp:9:umount.0 Request processed in 248us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708685.464800:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000020:00010000:1.0:1789708685.464842:0:17127:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bee3d93f800: total 0 00010000:00010000:1.0:1789708685.464865:0:17127:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bee3d93f800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789708685.464922:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac91052/0xf45f43947e47e97f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5a9 expref: 3 pid: 19636 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708685.464949:0:17127:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bee3d93f800, canceled 1 locks, left on hash table 0. 00000100:00100000:0.0:1789708685.464954:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357171712 00000100:00100000:0.0:1789708685.464959:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357171712 00010000:00010000:1.0:1789708685.464962:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708685.464964:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708685.464966:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708685.465010:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357171840 00000100:00100000:0.0:1789708685.465014:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357171840 00000100:00100000:0.0:1789708685.467175:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1789708685.467210:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+14:2398:x1876645357171712:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708685.467226:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708685.467246:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e949400/0xf45f43947e47e2a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e31e expref: 14 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708685.467277:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708685.467320:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+13:2398:x1876645357171712:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 131us (8922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708685.467328:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1789708685.467360:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789708685.467369:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+12:2397:x1876645357171840:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708685.467378:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708685.467386:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e948800/0xf45f43947e47e2b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e34f expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708685.467413:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708685.467434:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:2397:x1876645357171840:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 67us (8900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708685.467440:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00080000:0.0:1789708685.467480:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708685.475890:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357172224 00000100:00100000:0.0:1789708685.475906:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357172224 00000100:00100000:0.0:1789708685.475984:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789708685.475997:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:2395:x1876645357172224:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708685.476012:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708685.476034:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee1103b800/0xf45f43947e47e4d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e47c expref: 11 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708685.476063:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708685.476126:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:2395:x1876645357172224:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 133us (11727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708685.476134:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789708685.481968:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708685.482143:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357172352 00000100:00100000:2.0:1789708685.482218:0:18645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357172352 00000100:00100000:2.0:1789708685.482366:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:2.0:1789708685.482376:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f84d004b-f450-4582-bbe2-71415469e27b+5:2394:x1876645357172352:12345-192.168.201.52@tcp:9:umount.0 00000020:00000080:2.0:1789708685.482405:0:18645:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e2cc 00000100:00080000:2.0:1789708685.482419:0:18645:0:(import.c:65:import_set_state_nolock()) ffff9bee3d993800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789708685.482462:0:18645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:2.0:1789708685.482596:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f84d004b-f450-4582-bbe2-71415469e27b+2:2394:x1876645357172352:12345-192.168.201.52@tcp:9:umount.0 Request processed in 221us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708685.482603:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00010000:00010000:3.0:1789708685.483752:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708685.483927:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708685.498979:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708685.499921:0:19935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357173120 00000100:00100000:3.0:1789708685.499932:0:19935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357173120 00000100:00100000:3.0:1789708685.499987:0:19935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:3.0:1789708685.499997:0:19935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+14:2394:x1876645357173120:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:3.0:1789708685.500029:0:19935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e2be 00000020:00010000:3.0:1789708685.500046:0:19935:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bee3d939800: total 0 00000100:00080000:3.0:1789708685.500050:0:19935:0:(import.c:65:import_set_state_nolock()) ffff9bee3d93d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708685.500086:0:19935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934673 00000020:00010000:2.0:1789708685.500106:0:17128:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bee3d939800: total 0 00010000:00010000:2.0:1789708685.500169:0:17128:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bee3d939800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789708685.500205:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bee2c76a300) 00010000:00010000:2.0:1789708685.500209:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708685.500217:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5a00/0xf45f43947e47e35f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e405 expref: 13 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708685.500254:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:2.0:1789708685.500300:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708685.500306:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8600/0xf45f43947e47e39e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e413 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708685.500322:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708685.500324:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708685.500328:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47e940 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e594 expref: 11 pid: 20386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708685.500339:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708685.500341:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789708685.500345:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ba00/0xf45f43947e47e96a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5a2 expref: 10 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708685.500357:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708685.500359:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708685.500363:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc800/0xf45f43947e47e53b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e49f expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708685.500373:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9bee08f48f00) 00010000:00010000:2.0:1789708685.500375:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708685.500379:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47e867 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e55c expref: 8 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708685.500392:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bee08f48c00) 00010000:00010000:2.0:1789708685.500395:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708685.500398:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0e00/0xf45f43947e47e343 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3fe expref: 7 pid: 19935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708685.500421:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bee18087400) 00010000:00010000:2.0:1789708685.500424:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789708685.500427:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9200/0xf45f43947e47e423 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e43d expref: 6 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708685.500440:0:17128:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bee3d939800, canceled 8 locks, left on hash table 0. 00010000:00010000:2.0:1789708685.500452:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708685.500454:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708685.500456:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708685.501106:0:19935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f84d004b-f450-4582-bbe2-71415469e27b+4:2394:x1876645357173120:12345-192.168.201.52@tcp:39:umount.0 Request processed in 1107us (2133us total) trans 8589934674 rc 0/0 00000100:00100000:3.0:1789708685.501116:0:19935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:3.0:1789708685.509722:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708685.509949:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357173248 00000100:00100000:0.0:1789708685.509960:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357173248 00000100:00100000:0.0:1789708685.510054:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:0.0:1789708685.510074:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+5:2394:x1876645357173248:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:0.0:1789708685.510107:0:17140:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e2c5 00000100:00080000:0.0:1789708685.510124:0:17140:0:(import.c:65:import_set_state_nolock()) ffff9bee3d990000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789708685.510197:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708685.510310:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:0.0:1789708685.510360:0:17140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789708685.510616:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84d004b-f450-4582-bbe2-71415469e27b+3:2394:x1876645357173248:12345-192.168.201.52@tcp:39:umount.0 Request processed in 552us (903us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789708685.510631:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 125 00010000:00010000:1.0:1789708685.862510:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789708686.246914:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789708686.869411:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708686.869485:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708686.869602:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357173504 00000100:00100000:2.0:1789708686.869612:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357173504 00000100:00100000:2.0:1789708686.869674:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357173376 00000100:00100000:2.0:1789708686.869677:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357173376 00000100:00100000:2.0:1789708686.869710:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:2.0:1789708686.869721:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+11:2397:x1876645357173504:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708686.869738:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708686.869757:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bed09bb4e00/0xf45f43947e47e2ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e3bf expref: 11 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708686.869775:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708686.869829:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+10:2397:x1876645357173504:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 109us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708686.869837:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:2.0:1789708686.869857:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:2.0:1789708686.869863:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+9:2397:x1876645357173376:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708686.869889:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708686.869899:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d1800/0xf45f43947e47e2e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e38e expref: 9 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708686.869909:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708686.869929:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:2397:x1876645357173376:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 66us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708686.869936:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789708686.872418:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708686.872519:0:17891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357173632 00000100:00100000:2.0:1789708686.872531:0:17891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357173632 00000100:00100000:2.0:1789708686.872633:0:17891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789708686.872643:0:17891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+8:2398:x1876645357173632:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708686.872659:0:17891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708686.872678:0:17891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebce00/0xf45f43947e47e4d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e475 expref: 8 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708686.872709:0:17891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708686.872767:0:17891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+7:2398:x1876645357173632:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 126us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708686.872775:0:17891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1789708686.874209:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708686.874481:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357173760 00000100:00100000:0.0:1789708686.874490:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357173760 00000100:00100000:0.0:1789708686.874590:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:0.0:1789708686.874612:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2394:x1876645357173760:12345-192.168.201.52@tcp:9:umount.0 00000020:00000080:0.0:1789708686.874648:0:19636:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e30b 00000100:00080000:0.0:1789708686.874659:0:19636:0:(import.c:65:import_set_state_nolock()) ffff9bee3d932000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789708686.874778:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708686.874795:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1789708686.874844:0:19636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1789708686.875026:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+2:2394:x1876645357173760:12345-192.168.201.52@tcp:9:umount.0 Request processed in 426us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708686.875033:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:0.0:1789708686.878493:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708686.878726:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357173888 00000100:00100000:3.0:1789708686.878736:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357173888 00000100:00100000:3.0:1789708686.878819:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:3.0:1789708686.878830:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2394:x1876645357173888:12345-192.168.201.52@tcp:9:umount.0 00000020:00000080:3.0:1789708686.878869:0:18644:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e312 00000100:00080000:3.0:1789708686.878879:0:18644:0:(import.c:65:import_set_state_nolock()) ffff9bee3d9d1000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789708686.878921:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789708686.878928:0:18644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:3.0:1789708686.879096:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+2:2394:x1876645357173888:12345-192.168.201.52@tcp:9:umount.0 Request processed in 267us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708686.879128:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00080000:2.0:1789708686.880060:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708686.885602:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708686.885685:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357174144 00000100:00100000:3.0:1789708686.885696:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357174144 00000100:00100000:3.0:1789708686.885774:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:3.0:1789708686.885794:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+6:2394:x1876645357174144:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:3.0:1789708686.885839:0:20386:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e2fd 00000020:00010000:3.0:1789708686.885848:0:20386:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bee3d990800: total 0 00000100:00080000:3.0:1789708686.885852:0:20386:0:(import.c:65:import_set_state_nolock()) ffff9bee3d997000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708686.885882:0:20386:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934674 00000100:00100000:3.0:1789708686.886021:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2394:x1876645357174144:12345-192.168.201.52@tcp:39:umount.0 Request processed in 237us (427us total) trans 8589934675 rc 0/0 00000100:00100000:3.0:1789708686.886029:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 126 00000020:00010000:1.0:1789708686.886127:0:20169:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bee3d990800: total 0 00010000:00010000:1.0:1789708686.886132:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708686.886187:0:20169:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bee3d990800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789708686.886226:0:20169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bed08847c00) 00010000:00010000:1.0:1789708686.886230:0:20169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708686.886239:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c8e00/0xf45f43947e47e3ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e41a expref: 5 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708686.886289:0:20169:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bee3d990800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789708686.886302:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708686.886304:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708686.886306:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708686.886604:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789708686.886905:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708686.895482:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708686.895568:0:18837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357174272 00000100:00100000:3.0:1789708686.895583:0:18837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357174272 00000100:00100000:3.0:1789708686.895668:0:18837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:3.0:1789708686.895678:0:18837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+5:2394:x1876645357174272:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:3.0:1789708686.895736:0:18837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e304 00000100:00080000:3.0:1789708686.895746:0:18837:0:(import.c:65:import_set_state_nolock()) ffff9bee3d935000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708686.895777:0:18837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:1.0:1789708686.895887:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708686.895943:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708686.895948:0:18837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe38e29e-f16b-40a3-8fce-73b38f0cc7ba+3:2394:x1876645357174272:12345-192.168.201.52@tcp:39:umount.0 Request processed in 271us (475us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789708686.895956:0:18837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:0.0:1789708686.917463:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708686.920357:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357174528 00000100:00100000:2.0:1789708686.920371:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357174528 00000100:00100000:2.0:1789708686.920447:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 161 00000100:00100000:2.0:1789708686.920458:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed099ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+7:2394:x1876645357174528:12345-192.168.201.52@tcp:251:umount.0 00000020:00000080:2.0:1789708686.920522:0:17134:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e29b 00000020:00010000:2.0:1789708686.920530:0:17134:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bed01d42800: total 0 00000100:00080000:2.0:1789708686.920535:0:17134:0:(import.c:65:import_set_state_nolock()) ffff9bed01d40800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789708686.920640:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed099ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a+3:2394:x1876645357174528:12345-192.168.201.52@tcp:251:umount.0 Request processed in 183us (3186us total) trans 0 rc 0/0 00000020:00010000:0.0:1789708686.920642:0:17128:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bed01d42800: total 0 00000100:00100000:2.0:1789708686.920649:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 161 00010000:00010000:0.0:1789708686.920711:0:17128:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bed01d42800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789708686.920744:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e949a00/0xf45f43947e47e2a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e317 expref: 2 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708686.920759:0:17128:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bed01d42800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789708686.920772:0:17128:0:(genops.c:885:class_export_put()) final put ffff9bed01d42800/7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a 00010000:00010000:0.0:1789708686.920801:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708686.920804:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708686.920806:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789708686.921412:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed01d42800/7ba81bbe-6ae9-4f80-82ab-b6e8e48fe20a for MGS 00000020:00000080:2.0:1789708686.921444:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed01d40800 for MGS 00010000:00010000:1.0:1789708687.910548:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789708688.045423:0:20866:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789708688.060605:0:20866:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789708688.060662:0:20866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708688.060677:0:20866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708688.060685:0:20866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708688.060692:0:20866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708688.060742:0:20866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789708688.060748:0:20866:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789708688.060775:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789708688.060779:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789708688.060785:0:20866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789708688.060808:0:20866:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa8e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789708688.060868:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365566976:0@lo:39:umount.0 00000100:00100000:2.0:1789708688.060929:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708688.060987:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365566976 00000100:00100000:3.0:1789708688.060995:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365566976 00010000:00010000:0.0:1789708688.061010:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708688.061026:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.061034:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4c00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708688.061037:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.061046:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708688.061053:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708688.061058:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708688.061061:0:17127:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:3.0:1789708688.061062:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 10000000:01000000:0.0:1789708688.061064:0:17127:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1789708688.061071:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876645365566976:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789708688.061111:0:17139:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47df22 00000100:00080000:3.0:1789708688.061119:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9bee18012000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789708688.061158:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.061165:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708688.061184:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708688.061192:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3614:x1876645365566976:12345-0@lo:39:umount.0 Request processed in 122us (261us total) trans 0 rc 0/0 00010000:00010000:0.0:1789708688.061192:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4c00/0xf45f43947e47de5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47de65 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708688.061200:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:0.0:1789708688.061204:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708688.061205:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708688.061207:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789708688.061210:0:17139:0:(genops.c:885:class_export_put()) final put ffff9bee18010000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1789708688.061217:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365567104:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789708688.061246:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18010000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1789708688.061255:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708688.061314:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365567104 00000100:00100000:0.0:1789708688.061318:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365567104 00000100:00100000:0.0:1789708688.061359:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708688.061365:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+24:3615:x1876645365567104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708688.061375:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708688.061388:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509800/0xf45f43947e47de65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47de5e expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.061399:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708688.061426:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:3615:x1876645365567104:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708688.061432:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708688.061466:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365567104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708688.061538:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708688.061561:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee3fa8e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789708688.061573:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365566976:0@lo:39:umount.0 00000100:00080000:0.0:1789708688.061597:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708688.061600:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789708688.061604:0:20866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789708688.061668:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee18012000 for lustre-MDT0000 00010000:00010000:3.0:1789708688.062594:0:20866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.062602:0:20866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.062607:0:20866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.062610:0:20866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.062627:0:20866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708688.062633:0:20866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.062639:0:20866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062643:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708688.062644:0:20866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062649:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062655:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948200 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708688.062659:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.062663:0:20866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062667:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708688.062683:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708688.062689:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708688.062692:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789708688.062709:0:20866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708688.062711:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.062715:0:20866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062716:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708688.062721:0:20866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.062728:0:20866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.062734:0:20866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062741:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062748:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee3e948200/0xf45f43947e47ddaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47ddb6 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062759:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708688.062762:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062768:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a000 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708688.062771:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062777:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708688.062779:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365567232:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1789708688.062783:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708688.062788:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708688.062795:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789708688.062797:0:17128:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789708688.062812:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708688.062818:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708688.062818:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708688.062832:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062838:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103a000/0xf45f43947e47e28d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e294 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062848:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708688.062851:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062856:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103aa00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708688.062859:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708688.062861:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365567232 00000100:00100000:2.0:1789708688.062865:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365567232 00010000:00010000:0.0:1789708688.062865:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708688.062871:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708688.062876:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789708688.062878:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789708688.062888:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.062894:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789708688.062896:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708688.062903:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:3616:x1876645365567232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708688.062905:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708688.062912:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708688.062912:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708688.062913:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708688.062921:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d1000/0xf45f43947e47ddb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47ddaf expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708688.062944:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708688.062974:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:3616:x1876645365567232:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708688.062989:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708688.063030:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365567232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708688.065029:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708688.065214:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708688.065244:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365567360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708688.065328:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708688.065379:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708688.065386:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365567488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708688.065410:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708688.065445:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365567360 00000100:00100000:0.0:1789708688.065452:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365567360 00000100:00100000:0.0:1789708688.065503:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365567488 00000100:00100000:0.0:1789708688.065507:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365567488 00000100:00100000:0.0:1789708688.065528:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708688.065535:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+23:3617:x1876645365567360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708688.065548:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708688.065565:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e948000/0xf45f43947e47e294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47e28d expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.065580:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708688.065611:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+22:3617:x1876645365567360:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708688.065619:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708688.065628:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708688.065637:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+21:3617:x1876645365567488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708688.065645:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789708688.065650:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365567360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708688.065654:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d0000/0xf45f43947e47e58f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47e588 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708688.065664:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708688.065708:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:3617:x1876645365567488:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (296us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708688.065713:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708688.065714:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789708688.065795:0:20866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789708688.065802:0:20866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e588 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e58f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708688.065813:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365567488:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789708688.065815:0:20866:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789708688.065823:0:20866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.065831:0:20866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.065839:0:20866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.065859:0:20866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708688.065879:0:20866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789708688.065883:0:20866:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789708688.065887:0:20866:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789708688.065924:0:20866:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789708688.065928:0:20866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789708688.065933:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708688.065938:0:20866:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1789708688.065943:0:20866:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bed04221000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789708688.065949:0:20866:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bed018e2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789708688.065953:0:20866:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bee083c3800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789708688.065958:0:20866:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bee3fa71000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789708688.065965:0:20866:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9bee3d990800 fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 192.168.201.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1789708688.065971:0:20866:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9bee3d939800 f84d004b-f450-4582-bbe2-71415469e27b 192.168.201.52@tcp 3 (0 3 0) 1 0 0 0: 0000000000000000 8589934672 stale:0 00000020:00080000:3.0:1789708688.065975:0:20866:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9bed095f99c0) has exports, disconnecting them 00000020:00080000:3.0:1789708688.065979:0:20866:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bed04221000), last request at 1789708685 00000020:00000080:3.0:1789708688.065986:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e18a 00000100:00080000:3.0:1789708688.066002:0:20866:0:(import.c:65:import_set_state_nolock()) ffff9bed04222800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789708688.066066:0:20866:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed04221000): rc 0 00000020:00000080:3.0:1789708688.066069:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed04221000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789708688.066092:0:20866:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bed018e2000), last request at 1789708685 00000020:00000080:3.0:1789708688.066095:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e033 00000100:00080000:3.0:1789708688.066102:0:20866:0:(import.c:65:import_set_state_nolock()) ffff9bed018e5000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789708688.066122:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed04221000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1789708688.066128:0:20169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708688.066138:0:20169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.066145:0:20169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e948e00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708688.066148:0:20169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.066155:0:20169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789708688.066158:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed04222800 for lustre-MDT0000 10000000:00010000:0.0:1789708688.066162:0:20169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708688.066168:0:20169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:3.0:1789708688.066171:0:20866:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed018e2000): rc 0 10000000:01000000:0.0:1789708688.066171:0:20169:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789708688.066172:0:20169:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:3.0:1789708688.066173:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed018e2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789708688.066180:0:20866:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bee083c3800), last request at 1789708653 00000020:00000080:3.0:1789708688.066183:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47df7d 00000100:00080000:3.0:1789708688.066187:0:20866:0:(import.c:65:import_set_state_nolock()) ffff9bed0a045800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789708688.066194:0:20169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789708688.066197:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed018e2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1789708688.066201:0:20169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708688.066217:0:20169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789708688.066224:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed018e5000 for lustre-MDT0000 00010000:00010000:0.0:1789708688.066224:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee3e948e00/0xf45f43947e47dda1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47dda8 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789708688.066236:0:20866:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bee083c3800): rc 0 00000020:00000080:3.0:1789708688.066238:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bee083c3800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789708688.066245:0:20866:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bee3fa71000), last request at 1789708653 00010000:00010000:0.0:1789708688.066246:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789708688.066248:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47df14 00010000:00010000:0.0:1789708688.066248:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708688.066249:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708688.066252:0:20866:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf3800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789708688.066273:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365567616:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789708688.066276:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee083c3800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789708688.066299:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed0a045800 for lustre-MDT0000 00000100:00100000:0.0:1789708688.066299:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:3.0:1789708688.066310:0:20866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934675 00000100:00100000:0.0:1789708688.066336:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365567616 00000100:00100000:0.0:1789708688.066340:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365567616 00000100:00100000:0.0:1789708688.066363:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708688.066370:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+20:3615:x1876645365567616:12345-0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789708688.066375:0:20866:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bee3fa71000): rc 0 00010000:00010000:0.0:1789708688.066377:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00000080:3.0:1789708688.066381:0:20866:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbde281953ad8 00010000:00010000:0.0:1789708688.066385:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d1400/0xf45f43947e47dda8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47dda1 expref: 20 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708688.066393:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1789708688.066399:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789708688.066402:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789708688.066417:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:3615:x1876645365567616:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708688.066423:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708688.066444:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365567616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708688.066456:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708688.066459:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708688.066472:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708688.066786:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708688.067249:0:20866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789708688.067284:0:20866:0:(import.c:65:import_set_state_nolock()) ffff9bee0685d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789708688.067349:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365567744:0@lo:39:umount.0 00000100:00100000:2.0:1789708688.067386:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708688.067436:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365567744 00000100:00100000:3.0:1789708688.067442:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365567744 00000100:00100000:3.0:1789708688.067481:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789708688.067489:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876645365567744:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789708688.067510:0:17143:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e02c 00000100:00080000:3.0:1789708688.067524:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9bed018e1000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789708688.067537:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789708688.067539:0:17143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789708688.067645:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3614:x1876645365567744:12345-0@lo:39:umount.0 Request processed in 156us (258us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789708688.067653:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789708688.067746:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789708688.067749:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934601 gen 3 00000004:00080000:1.0:1789708688.067799:0:20866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789708688.067855:0:20866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789708688.067866:0:20866:0:(import.c:65:import_set_state_nolock()) ffff9bee18452000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789708688.067875:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789708688.067877:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 3 00000004:00080000:1.0:1789708688.067895:0:20866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789708688.067960:0:20866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789708688.067970:0:20866:0:(import.c:65:import_set_state_nolock()) ffff9bee18455800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789708688.068012:0:20866:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9bed095f99c0) has no exports 00000100:00100000:2.0:1789708688.068188:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365567872:0@lo:9:umount.0 00000100:00100000:2.0:1789708688.068219:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708688.068246:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365568000:0@lo:9:umount.0 00000100:00100000:2.0:1789708688.068291:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789708688.068372:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee0685d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789708688.068377:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365567744:0@lo:39:umount.0 00000100:00100000:3.0:1789708688.068491:0:19634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365567872 00000100:00100000:3.0:1789708688.068497:0:19634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365567872 00000100:00100000:3.0:1789708688.068583:0:19634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365568000 00000100:00100000:3.0:1789708688.068587:0:19634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365568000 00000100:00080000:1.0:1789708688.068611:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708688.068616:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708688.068786:0:19634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789708688.068795:0:19634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3614:x1876645365567872:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789708688.068811:0:19634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e04f 00000100:00080000:3.0:1789708688.068818:0:19634:0:(import.c:65:import_set_state_nolock()) ffff9bed04163800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708688.068854:0:19634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:3.0:1789708688.068947:0:19634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3614:x1876645365567872:12345-0@lo:9:umount.0 Request processed in 152us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708688.068953:0:19634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789708688.068966:0:19634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789708688.068972:0:19634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3614:x1876645365568000:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789708688.068983:0:19634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e1ad 00000100:00080000:3.0:1789708688.068988:0:19634:0:(import.c:65:import_set_state_nolock()) ffff9bed01d43800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708688.069009:0:19634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789708688.069159:0:19634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3614:x1876645365568000:12345-0@lo:9:umount.0 Request processed in 188us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708688.069165:0:19634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1789708688.069207:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee18452000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789708688.069216:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789708688.069218:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789708688.069229:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365567872:0@lo:9:umount.0 00000100:00080000:3.0:1789708688.069241:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee18455800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789708688.069247:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789708688.069248:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789708688.069250:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365568000:0@lo:9:umount.0 00010000:00010000:3.0:1789708688.070314:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708688.073397:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789708688.081619:0:20866:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9bed095f99c0) has no exports 00000020:00000080:1.0:1789708688.119633:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ddfc 00000020:00000080:1.0:1789708688.119648:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bee18286000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789708688.119710:0:20866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789708688.119815:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18286000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789708688.119845:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708688.119855:0:20866:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789708688.119873:0:20866:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9bee3dd799c0) has no exports 00000020:00000080:2.0:1789708688.120200:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ddf5 00000020:00000080:2.0:1789708688.120206:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed05009000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789708688.120415:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed05009000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789708688.120478:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708688.120486:0:20866:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789708688.120489:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed0500b000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789708688.120491:0:20866:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0500b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789708688.120495:0:20866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1789708688.934995:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708689.254557:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708689.254581:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365568128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708689.254648:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708689.254915:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365568128 00000100:00100000:3.0:1789708689.254924:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365568128 00000100:00100000:3.0:1789708689.254969:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789708689.254977:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3615:x1876645365568128:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789708689.254984:0:18670:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789708689.255081:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3615:x1876645365568128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (432us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789708689.255089:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:02020000:0.0:1789708689.255670:0:3615:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1789708689.262744:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789708689.262753:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789708689.262758:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789708689.275477:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708689.275492:0:3615:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 224 00000100:00080000:0.0:1789708689.275525:0:3615:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bee02bf5000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708689.275564:0:3615:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622df80 x1876645365568256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789708689.275705:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365568256:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789708689.275848:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708689.277890:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365568256 00000100:00100000:0.0:1789708689.277907:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365568256 00000100:00100000:0.0:1789708689.277953:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789708689.277961:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365568256:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789708689.277980:0:17143:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789708689.288962:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365568256:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 10995us (13108us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789708689.288976:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789708689.289140:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708689.289148:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708689.289152:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365568256:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1789708689.958565:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708690.278638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789708690.278645:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789708690.278648:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708690.278655:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 260 00000100:00080000:2.0:1789708690.278660:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789708690.278670:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bee02bf5000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708690.278688:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fa93100 x1876645365568512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789708690.278784:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365568896:0@lo:400:kworker.0 00000100:00100000:2.0:1789708690.278841:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708690.278870:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365569408:0@lo:400:kworker.0 00000100:00100000:2.0:1789708690.278891:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708690.278921:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789708690.278926:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365568768:0@lo:400:kworker.0 00000100:00100000:2.0:1789708690.278945:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708690.278956:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365569280:0@lo:400:kworker.0 00000100:00100000:2.0:1789708690.278971:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708690.279010:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365568896 00000100:00100000:2.0:1789708690.279017:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365568896 00000100:00100000:2.0:1789708690.279047:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365569408 00000100:00100000:2.0:1789708690.279049:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365569408 00000100:00100000:2.0:1789708690.279072:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365569280 00000100:00100000:2.0:1789708690.279073:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365569280 00000100:00100000:2.0:1789708690.279086:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789708690.279094:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365569408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708690.279137:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365569408:12345-0@lo:400:kworker.0 Request processed in 44us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708690.279143:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789708690.279158:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789708690.279162:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1876645365568896:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789708690.279167:0:17138:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789708690.279185:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1876645365568896:12345-0@lo:400:kworker.0 Request processed in 22us (344us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789708690.279190:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789708690.279198:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789708690.279201:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1876645365569280:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789708690.279205:0:17138:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789708690.279218:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1876645365569280:12345-0@lo:400:kworker.0 Request processed in 16us (246us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789708690.279222:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1789708690.279245:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708690.279288:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789708690.279292:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9bed0146d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789708690.279295:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789708690.279298:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9bed0146d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708690.279301:0:3616:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 234 00000100:00080000:2.0:1789708690.279305:0:3616:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bed0146d000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708690.279317:0:3616:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fabca80 x1876645365569536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789708690.279328:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365569280:0@lo:400:kworker.0 00000100:00080000:2.0:1789708690.279336:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789708690.279338:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9bed08bfe800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789708690.279341:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789708690.279343:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9bed08bfe800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708690.279346:0:3616:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 224 00000100:00080000:2.0:1789708690.279349:0:3616:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bed08bfe800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708690.279356:0:3616:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fabe300 x1876645365569664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789708690.279364:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365568896:0@lo:400:kworker.0 00010000:00080000:2.0:1789708690.279372:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fabea00 x1876645365569408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708690.279381:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365569408:0@lo:400:kworker.0 00000100:00100000:2.0:1789708690.279402:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365568512:0@lo:38:kworker.0 00000100:00100000:2.0:1789708690.279430:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708690.279448:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365569536:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789708690.279461:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708690.279470:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365569664:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789708690.279482:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708690.279500:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365569536 00000100:00100000:2.0:1789708690.279504:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365569536 00000100:00100000:2.0:1789708690.279516:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365569664 00000100:00100000:2.0:1789708690.279518:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365569664 00000100:00100000:2.0:1789708690.279526:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789708690.279530:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1876645365569536:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789708690.279542:0:20386:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789708690.279565:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1876645365569536:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 34us (103us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789708690.279570:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789708690.279578:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789708690.279582:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1876645365569664:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789708690.279587:0:20386:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789708690.279601:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1876645365569664:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 19us (118us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789708690.279606:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789708690.279620:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365568512 00000100:00100000:2.0:1789708690.279623:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365568512 00000100:00100000:2.0:1789708690.279636:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789708690.279640:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3614:x1876645365568512:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1789708690.279645:0:18670:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789708690.279663:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3614:x1876645365568512:12345-0@lo:38:kworker.0 Request processed in 22us (232us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789708690.279673:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789708690.279696:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708690.279699:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708690.279702:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365568512:0@lo:38:kworker.0 00000100:00080000:2.0:1789708690.279708:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0146d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708690.279710:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708690.279713:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365569536:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1789708690.279718:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08bfe800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708690.279720:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708690.279722:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365569664:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789708690.279945:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365568384:0@lo:400:kworker.0 00000100:00100000:0.0:1789708690.279989:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708690.280020:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365569024:0@lo:400:kworker.0 00000100:00100000:0.0:1789708690.280038:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708690.280057:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365569792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708690.280075:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708690.280089:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789708690.280094:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365568640:0@lo:400:kworker.0 00000100:00100000:0.0:1789708690.280107:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708690.280121:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee11040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365569152:0@lo:400:kworker.0 00000100:00100000:0.0:1789708690.280136:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708690.280147:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365569920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708690.280160:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708690.280190:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365568768 00000100:00100000:0.0:1789708690.280193:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365568768 00000100:00100000:0.0:1789708690.280221:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365568640 00000100:00100000:0.0:1789708690.280223:0:19636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365568640 00000100:00100000:0.0:1789708690.280238:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708690.280252:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365568768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708690.280304:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365568768:12345-0@lo:400:kworker.0 Request processed in 61us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708690.280309:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708690.280319:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789708690.280325:0:19636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365568640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708690.280348:0:19636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365568640:12345-0@lo:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708690.280353:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789708690.280366:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789708690.280368:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708690.280374:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365569024 00000100:00100000:0.0:1789708690.280377:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365569024 00000100:00100000:0.0:1789708690.280389:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365569152 00000100:00100000:0.0:1789708690.280391:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365569152 00000100:00100000:0.0:1789708690.280408:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789708690.280413:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365569152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708690.280434:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365569152:12345-0@lo:400:kworker.0 Request processed in 22us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708690.280439:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789708690.280447:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789708690.280450:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3617:x1876645365569024:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789708690.280454:0:20386:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789708690.280476:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3617:x1876645365569024:12345-0@lo:400:kworker.0 Request processed in 24us (437us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789708690.280481:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1789708690.280494:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708690.280508:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365568640:0@lo:400:kworker.0 00010000:00080000:0.0:1789708690.280516:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee11040380 x1876645365569152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708690.280525:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365569152:0@lo:400:kworker.0 00000100:00080000:0.0:1789708690.280531:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789708690.280534:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9bed01d73000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789708690.280537:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789708690.280540:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9bed01d73000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708690.280542:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 228 00000100:00080000:0.0:1789708690.280548:0:3617:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bed01d73000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708690.280560:0:3617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622f800 x1876645365570048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708690.280574:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee11043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365569024:0@lo:400:kworker.0 00000100:00100000:0.0:1789708690.280597:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365568768:0@lo:400:kworker.0 00000100:00100000:0.0:1789708690.280609:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365570048:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789708690.280628:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708690.280647:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365570048 00000100:00100000:0.0:1789708690.280650:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365570048 00000100:00100000:0.0:1789708690.280662:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789708690.280665:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365570048:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1789708690.280678:0:17138:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789708690.280700:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365570048:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 33us (71us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789708690.280705:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1789708690.280722:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed01d73000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708690.280725:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789708690.280728:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365570048:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789708690.281029:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365568384 00000100:00100000:3.0:1789708690.281034:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365568384 00000100:00100000:3.0:1789708690.281065:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789708690.281071:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed099cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:3617:x1876645365568384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708690.281105:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed099cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fda82b2e-0d6b-4cb4-a087-54f6744e5277+19:3617:x1876645365568384:12345-0@lo:400:kworker.0 Request processed in 35us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708690.281111:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789708690.281132:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365569792 00000100:00100000:3.0:1789708690.281135:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365569792 00000100:00100000:3.0:1789708690.281148:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365569920 00000100:00100000:3.0:1789708690.281149:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365569920 00000100:00100000:3.0:1789708690.281159:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708690.281163:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365569792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789708690.281180:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708690.281213:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365569792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708690.281218:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708690.281228:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708690.281245:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365569920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789708690.281257:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789708690.281297:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365569920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708690.281302:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708690.281334:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365569920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708690.281342:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3617:1876645365568384:0@lo:400:kworker.0 00000100:00100000:3.0:1789708690.281351:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365569792:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789708690.984839:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789708691.305138:0:19461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789708691.305148:0:19461:0:(genops.c:885:class_export_put()) final put ffff9bed01d44800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789708691.305219:0:19461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000020:00000080:2.0:1789708691.305222:0:19461:0:(genops.c:885:class_export_put()) final put ffff9bee3d936000/fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000001:00100000:3.0:1789708691.305443:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789708691.305448:0:17119:0:(genops.c:885:class_export_put()) final put ffff9bee3fa71000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789708691.305645:0:17871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789708691.305655:0:17871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789708691.305658:0:17871:0:(genops.c:885:class_export_put()) final put ffff9bed018e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789708691.305720:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed01d44800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789708691.305766:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed01d43800 for lustre-OST0001 00000001:00100000:2.0:1789708691.305913:0:19461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f84d004b-f450-4582-bbe2-71415469e27b 00000020:00000080:2.0:1789708691.305917:0:19461:0:(genops.c:885:class_export_put()) final put ffff9bee3d93f800/f84d004b-f450-4582-bbe2-71415469e27b 00000020:00000080:0.0:1789708691.306082:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3d936000/fe38e29e-f16b-40a3-8fce-73b38f0cc7ba for lustre-OST0001 00000020:00000080:0.0:1789708691.306109:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3d93f800/f84d004b-f450-4582-bbe2-71415469e27b for lustre-OST0001 00000020:00000080:0.0:1789708691.306125:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3d932000 for lustre-OST0001 00000020:00000080:0.0:1789708691.306129:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3d93c000 for lustre-OST0001 00000001:00100000:0.0:1789708691.306282:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789708691.306286:0:18640:0:(genops.c:885:class_export_put()) final put ffff9bed04165000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789708691.306308:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000020:00000080:0.0:1789708691.306310:0:18640:0:(genops.c:885:class_export_put()) final put ffff9bee3d9d5000/fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000001:00100000:0.0:1789708691.306316:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f84d004b-f450-4582-bbe2-71415469e27b 00000020:00000080:0.0:1789708691.306317:0:18640:0:(genops.c:885:class_export_put()) final put ffff9bee3d995800/f84d004b-f450-4582-bbe2-71415469e27b 00000020:00000080:2.0:1789708691.306367:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed04165000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789708691.306405:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3d9d5000/fe38e29e-f16b-40a3-8fce-73b38f0cc7ba for lustre-OST0000 00000020:00000080:2.0:1789708691.306418:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3d995800/f84d004b-f450-4582-bbe2-71415469e27b for lustre-OST0000 00000020:00000080:2.0:1789708691.306435:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed04163800 for lustre-OST0000 00000020:00000080:2.0:1789708691.306439:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3d9d1000 for lustre-OST0000 00000020:00000080:2.0:1789708691.306442:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3d993800 for lustre-OST0000 00000001:00100000:3.0:1789708691.306564:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000001:00080000:3.0:1789708691.306571:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934675 is committed 00000020:00000080:3.0:1789708691.306574:0:17119:0:(genops.c:885:class_export_put()) final put ffff9bee3d990800/fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000001:00100000:3.0:1789708691.306580:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f84d004b-f450-4582-bbe2-71415469e27b 00000001:00080000:3.0:1789708691.306584:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934674 is committed 00000020:00000080:3.0:1789708691.306587:0:17119:0:(genops.c:885:class_export_put()) final put ffff9bee3d939800/f84d004b-f450-4582-bbe2-71415469e27b 00000001:00100000:1.0:1789708691.306647:0:17871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000001:00080000:1.0:1789708691.306653:0:17871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789708691.306655:0:17871:0:(genops.c:885:class_export_put()) final put ffff9bee3d931000/fe38e29e-f16b-40a3-8fce-73b38f0cc7ba 00000001:00100000:1.0:1789708691.306660:0:17871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f84d004b-f450-4582-bbe2-71415469e27b 00000001:00080000:1.0:1789708691.306663:0:17871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789708691.306665:0:17871:0:(genops.c:885:class_export_put()) final put ffff9bee3d992000/f84d004b-f450-4582-bbe2-71415469e27b 00000020:00000080:0.0:1789708691.306695:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa71000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1789708691.306884:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3d990800/fe38e29e-f16b-40a3-8fce-73b38f0cc7ba for lustre-MDT0000 00000020:00000080:0.0:1789708691.307006:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3d939800/f84d004b-f450-4582-bbe2-71415469e27b for lustre-MDT0000 00000020:00000080:0.0:1789708691.307115:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed018e6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789708691.307219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3d931000/fe38e29e-f16b-40a3-8fce-73b38f0cc7ba for lustre-MDT0001 00000020:00000080:0.0:1789708691.307391:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3d992000/f84d004b-f450-4582-bbe2-71415469e27b for lustre-MDT0001 00000020:00000080:0.0:1789708691.307515:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee02bf3800 for lustre-MDT0000 00000020:00000080:0.0:1789708691.307522:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3d997000 for lustre-MDT0000 00000020:00000080:0.0:1789708691.307525:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3d93d000 for lustre-MDT0000 00000020:00000080:0.0:1789708691.307528:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed018e1000 for lustre-MDT0001 00000020:00000080:0.0:1789708691.307531:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3d935000 for lustre-MDT0001 00000020:00000080:0.0:1789708691.307534:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3d990000 for lustre-MDT0001 00010000:00010000:2.0:1789708692.006646:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708693.030424:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708694.054504:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789708694.182608:0:20866:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee03127400 - data ffff9bed080dee58/ffff9bee28b1c400 00000020:01000000:2.0:1789708694.182792:0:20866:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bed09b84c80 - data ffff9bee30c6be58/ffff9bee28a62000 00000001:00000004:2.0:1789708694.188622:0:20866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934675 00000100:00080000:1.0:1789708694.223827:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789708694.223835:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789708694.223850:0:20866:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bed09b80700 x1876645365567744/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789708698 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708694.223869:0:20866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789708694.225011:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789708694.225014:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934601 gen 4 00000004:00080000:1.0:1789708694.225028:0:20866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789708694.225029:0:20866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789708694.225341:0:17162:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789708694.225345:0:17162:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 3 count 1 00000040:00080000:0.0:1789708694.225363:0:17162:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1789708694.225984:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789708694.225987:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 4 00000004:00080000:1.0:1789708694.225997:0:20866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789708694.226009:0:20866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789708694.226320:0:17164:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789708694.226324:0:17164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1789708694.226337:0:17164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1789708694.227086:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ddc4 00000020:00000080:1.0:1789708694.227094:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed06013000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789708694.227205:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed06013000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789708694.228577:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ddd9 00000020:00000080:1.0:1789708694.228585:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed06012000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789708694.228622:0:20866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789708694.228628:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708694.228635:0:20866:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789708694.228638:0:20866:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9bed095fcd40) has no exports 00000004:01000000:1.0:1789708694.228826:0:20866:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789708694.228833:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47de3b 00000020:00000080:1.0:1789708694.228837:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bee0685e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789708694.228915:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed06012000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789708694.228969:0:20866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789708694.228973:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708694.228978:0:20866:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789708694.228980:0:20866:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9bed09710000) has no exports 00000020:00000080:1.0:1789708694.228986:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47de34 00000020:00000080:1.0:1789708694.228989:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bee18452800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789708694.229006:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee0685e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1789708694.229410:0:20866:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789708694.229414:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789708694.229418:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 5 00000004:00080000:1.0:1789708694.229423:0:20866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789708694.229425:0:20866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789708694.229467:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18452800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789708694.229553:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708694.229560:0:20866:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708694.229565:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47de26 00000020:00000080:1.0:1789708694.229569:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bee18453000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789708694.229662:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee18455800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789708694.229669:0:8:0:(genops.c:885:class_export_put()) final put ffff9bee0685d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789708694.229671:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee0685d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789708694.229677:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789708694.229843:0:20866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789708694.229847:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708694.229851:0:20866:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789708694.229853:0:20866:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9bed09713380) has no exports 00000020:00000080:1.0:1789708694.229857:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47de1f 00000020:00000080:1.0:1789708694.229860:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bee18455000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789708694.229890:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18453000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1789708694.230308:0:20866:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789708694.230311:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789708694.230314:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934601 gen 5 00000004:00080000:1.0:1789708694.230317:0:20866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789708694.230319:0:20866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789708694.230381:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18455000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789708694.230447:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708694.230453:0:20866:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789708694.230493:0:20866:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789708694.230497:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47de11 00000020:00000080:1.0:1789708694.230502:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bee18457800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789708694.230523:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee18452000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789708694.230528:0:8:0:(genops.c:885:class_export_put()) final put ffff9bee18454000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789708694.230530:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18454000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789708694.230533:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789708694.230615:0:20866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789708694.230619:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708694.230622:0:20866:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789708694.230625:0:20866:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9bed097119c0) has no exports 00000020:00000080:1.0:1789708694.230629:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47de0a 00000020:00000080:1.0:1789708694.230632:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bee06858800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789708694.230702:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18457800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789708694.231591:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee06858800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789708694.235080:0:20866:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789708694.235088:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789708694.235092:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789708694.235099:0:20866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789708694.235180:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708694.235192:0:20866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708694.235283:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708694.235288:0:20866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708694.235293:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed06012800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789708694.235298:0:20866:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed06012800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789708694.235305:0:20866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708694.235441:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47dde0 00000020:00000080:1.0:1789708694.235447:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed06015000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789708694.235506:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee0685d800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789708694.235513:0:8:0:(genops.c:885:class_export_put()) final put ffff9bee0685c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789708694.235515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee0685c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789708694.235520:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789708694.235627:0:20866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789708694.235632:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708694.235643:0:20866:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789708694.235656:0:20866:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9bee3dd7cd40) has no exports 00000020:00000080:1.0:1789708694.235679:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708694.235683:0:20866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789708694.235688:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47dde7 00000020:00000080:1.0:1789708694.235692:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed06011000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789708694.235780:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed06015000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789708694.235784:0:8:0:(genops.c:885:class_export_put()) final put ffff9bed06013800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789708694.235786:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed06013800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789708694.235790:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1789708694.235873:0:20866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bed0a28c800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789708694.235877:0:20866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed0a28c800 3 00000020:01000004:1.0:1789708694.235880:0:20866:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bed0a28c800 from lustre-MDT0000 00000020:00000080:1.0:1789708694.235900:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708694.235913:0:20866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789708694.235916:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed06010800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789708694.235918:0:20866:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed06010800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789708694.235925:0:20866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789708694.235956:0:20866:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789708694.235959:0:20866:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789708694.235966:0:20866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789708694.235970:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708694.235973:0:20866:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789708694.235979:0:20866:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9bee0685a000 fda82b2e-0d6b-4cb4-a087-54f6744e5277 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708694.235984:0:20866:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9bed095f8000) has exports, disconnecting them 00000020:00080000:1.0:1789708694.235988:0:20866:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bee0685a000), last request at 1789708649 00000020:00000080:1.0:1789708694.236001:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47dd8c 00000020:00010000:1.0:1789708694.236005:0:20866:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bee0685a000: total 1 00000100:00080000:1.0:1789708694.236008:0:20866:0:(import.c:65:import_set_state_nolock()) ffff9bee0685e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789708694.236020:0:20866:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bee0685a000): rc 0 00000020:00080000:1.0:1789708694.236023:0:20866:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9bed095f8000) has no exports 00000020:00010000:2.0:1789708694.236084:0:17128:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bee0685a000: total 1 00010000:00010000:2.0:1789708694.236120:0:17128:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bee0685a000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789708694.236146:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bed09bb4a00/0xf45f43947e47deb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47deab expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236164:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e949800/0xf45f43947e47dec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47deb9 expref: 13 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236173:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bed09bb4000/0xf45f43947e47e16e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47e167 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236182:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bed09bb4600/0xf45f43947e47e010 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47e009 expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236190:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebde00/0xf45f43947e47e565 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47e55e expref: 10 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236199:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d1200/0xf45f43947e47dd9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47dd93 expref: 9 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236207:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e948a00/0xf45f43947e47e286 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47e27f expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236216:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d1a00/0xf45f43947e47e573 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47e56c expref: 7 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236224:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee2f7d0400/0xf45f43947e47df68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47df61 expref: 6 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236243:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebc600/0xf45f43947e47e581 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47e57a expref: 5 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236253:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee3e948c00/0xf45f43947e47e144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47e13d expref: 4 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236286:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bed09bb5800/0xf45f43947e47dfe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47dfdf expref: 3 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236296:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01508200/0xf45f43947e47dea4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45f43947e47de9d expref: 2 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.236305:0:17128:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bee0685a000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1789708694.236318:0:17128:0:(genops.c:885:class_export_put()) final put ffff9bee0685a000/fda82b2e-0d6b-4cb4-a087-54f6744e5277 00000100:00100000:1.0:1789708694.236385:0:17134:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bed095c7600:17134] 2 exiting: rc = 0 00000020:00000080:0.0:1789708694.236516:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed06011000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1789708694.236528:0:17132:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bed0a286a00:17132] 0 exiting: rc = 1 00000100:00100000:3.0:1789708694.236592:0:17133:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bee2d915c00:17133] 1 exiting: rc = 0 00010000:00010000:2.0:1789708694.236609:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708694.236612:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708694.236614:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708694.236676:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236684:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236689:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236695:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236711:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236716:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236722:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236729:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236734:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236738:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236743:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236748:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236753:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236757:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236761:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236766:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236770:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236775:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236780:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236785:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236790:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236795:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236800:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236811:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236817:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236822:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236828:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236833:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236838:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236843:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236847:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236852:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236857:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236861:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236865:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236870:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236875:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236879:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236884:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236893:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236899:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236916:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236921:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236926:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236931:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236936:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236941:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236946:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236950:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236955:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236960:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236966:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236970:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236975:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236979:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236984:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236989:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236993:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.236998:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.237004:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.237009:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.237014:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.237019:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708694.237024:0:20866:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789708694.238032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee0685a000/fda82b2e-0d6b-4cb4-a087-54f6744e5277 for MGS 00000020:00000080:0.0:1789708694.238064:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee0685e000 for MGS 00000020:01000000:1.0:1789708694.238137:0:20866:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee09070c00 - data ffff9bee30e70798/ffff9bee28a8ac00 00000020:01000000:1.0:1789708694.238250:0:20866:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee10f9f980 - data ffff9bee30ebd438/ffff9bee3faba000 00000020:00000080:1.0:1789708694.238628:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47dd70 00000020:00000080:1.0:1789708694.238635:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed0a288000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789708694.238642:0:20866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bed0a28c800 from MGS, refs=2 00000020:01000004:1.0:1789708694.238645:0:20866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed0a28c800 2 00000020:01000004:1.0:1789708694.238647:0:20866:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bed0a28c800 from MGS 00000020:00000080:1.0:1789708694.238673:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708694.238678:0:20866:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789708694.238686:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed0a28a000/MGS 00000020:00000080:1.0:1789708694.238688:0:20866:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0a28a000/MGS for MGS 00000020:01000000:1.0:1789708694.238693:0:20866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789708694.238741:0:20866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789708694.238744:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708694.238748:0:20866:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789708694.238752:0:20866:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bee3fa8a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708694.238757:0:20866:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9bed08670000) has exports, disconnecting them 00000020:00080000:1.0:1789708694.238761:0:20866:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bee3fa8a800), last request at 1789708649 00000020:00000080:1.0:1789708694.238764:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47de73 00000020:00080000:1.0:1789708694.238772:0:20866:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bee3fa8a800): rc 0 00000020:00000080:1.0:1789708694.238775:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bee3fa8a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789708694.239437:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0a288000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789708694.239447:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3fa8a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789708694.240323:0:20866:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789708694.240328:0:20866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708694.240331:0:20866:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789708694.240337:0:20866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789708694.240487:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708694.240493:0:20866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789708694.240497:0:20866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed0a28c800 1 00000020:00000080:0.0:1789708694.240502:0:20866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47dd62 00000020:00000080:0.0:1789708694.240508:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed0a289800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789708694.240512:0:20866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789708694.240516:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708694.240519:0:20866:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789708694.240522:0:20866:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9bed095fb380) has no exports 00000020:00000080:2.0:1789708694.240712:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee3fa8e000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789708694.240718:0:8:0:(genops.c:885:class_export_put()) final put ffff9bed08566000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789708694.240720:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08566000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789708694.240725:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789708694.240790:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0a289800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789708694.276664:0:20866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708694.276676:0:20866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789708694.276681:0:20866:0:(genops.c:885:class_export_put()) final put ffff9bed0a28e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789708694.276686:0:20866:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0a28e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789708694.276700:0:20866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789708694.276812:0:20866:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bed0a28a800 00000020:02000400:1.0:1789708694.276885:0:20866:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789708695.079285:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708695.398428:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789708695.398434:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789708695.398444:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708695.398451:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 261 00000100:00080000:2.0:1789708695.398457:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789708695.398468:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bee02bf5000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708695.398494:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fabf480 x1876645365570304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708695.398533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789708695.398536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789708695.398538:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bed08bfe800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708695.398542:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 261 00000100:00080000:2.0:1789708695.398545:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789708695.398549:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bed08bfe800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708695.398560:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fabdf80 x1876645365570688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708695.398569:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789708695.398572:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789708695.398573:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bed01d73000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708695.398576:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 261 00000100:00080000:2.0:1789708695.398578:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789708695.398582:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bed01d73000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708695.398592:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fabc380 x1876645365570816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708695.398607:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789708695.398610:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789708695.398617:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bed0146d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708695.398621:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 261 00000100:00080000:2.0:1789708695.398623:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789708695.398628:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bed0146d000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708695.398641:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fabc000 x1876645365571072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789708695.398675:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365570432:0@lo:400:kworker.0 00000100:00100000:2.0:1789708695.398738:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708695.398798:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789708695.398805:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365570176:0@lo:400:kworker.0 00000400:00000100:2.0:1789708695.398825:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876645365570176 offset 0 length 224: 4 00000100:00100000:2.0:1789708695.398843:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365571200:0@lo:400:kworker.0 00000100:00100000:2.0:1789708695.398865:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708695.398905:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365570304:0@lo:38:kworker.0 00000100:00100000:2.0:1789708695.398931:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708695.398966:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365570688:0@lo:38:kworker.0 00000100:00100000:2.0:1789708695.398988:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708695.399005:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365570816:0@lo:38:kworker.0 00000100:00100000:2.0:1789708695.399025:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708695.399040:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365571072:0@lo:38:kworker.0 00000100:00100000:2.0:1789708695.399059:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708695.399086:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365570944:0@lo:400:kworker.0 00000100:00100000:2.0:1789708695.399109:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708695.399124:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708695.399139:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365570560:0@lo:400:kworker.0 00000100:00100000:2.0:1789708695.399165:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708695.399192:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365571200 00000100:00100000:2.0:1789708695.399200:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365571200 00000100:00100000:2.0:1789708695.399253:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365570688 00000100:00100000:2.0:1789708695.399256:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365570688 00000100:00100000:2.0:1789708695.399302:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365570816 00000100:00100000:2.0:1789708695.399305:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365570816 00000100:00100000:2.0:1789708695.399313:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365571072 00000100:00100000:2.0:1789708695.399315:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365571072 00000100:00100000:2.0:1789708695.399323:0:20386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365570944 00000100:00100000:2.0:1789708695.399325:0:20386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365570944 00000100:00100000:2.0:1789708695.399342:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789708695.399350:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365571200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708695.399401:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365571200:12345-0@lo:400:kworker.0 Request processed in 50us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708695.399407:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789708695.399424:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789708695.399430:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365570944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708695.399457:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365570944:12345-0@lo:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708695.399462:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789708695.399474:0:20386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789708695.399477:0:20386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1876645365570688:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789708695.399493:0:20386:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789708695.399922:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789708695.399929:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365570816:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789708695.399952:0:17138:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789708695.399990:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365570816:12345-0@lo:38:kworker.0 Request processed in 61us (964us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789708695.399996:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789708695.400010:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789708695.400015:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365571072:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789708695.400023:0:17138:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789708695.400053:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365571072:12345-0@lo:38:kworker.0 Request processed in 37us (993us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789708695.400059:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789708695.400084:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365570304 00000100:00100000:1.0:1789708695.400090:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365570304 00000100:00100000:1.0:1789708695.400111:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789708695.400116:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365570304:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789708695.400125:0:17143:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789708695.400150:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365570304:12345-0@lo:38:kworker.0 Request processed in 33us (1218us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789708695.400155:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1789708695.400194:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789708695.400199:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789708695.400202:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365570304:0@lo:38:kworker.0 00000100:00080000:1.0:1789708695.400211:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed01d73000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789708695.400214:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789708695.400217:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365570816:0@lo:38:kworker.0 00000100:00080000:1.0:1789708695.400225:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0146d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789708695.400228:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789708695.400230:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365571072:0@lo:38:kworker.0 00000100:00080000:1.0:1789708695.400290:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789708695.400316:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9bee3fabed80 x1876645365571200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708695.400328:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365571200:0@lo:400:kworker.0 00000100:00100000:3.0:1789708695.400800:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365570432 00000100:00100000:3.0:1789708695.400805:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365570432 00000100:00100000:3.0:1789708695.400847:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365570560 00000100:00100000:3.0:1789708695.400856:0:18838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365570560 00000100:00100000:3.0:1789708695.400895:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708695.400904:0:18838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365570432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708695.401059:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708695.401068:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365571328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708695.401102:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708695.401131:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365571328 00000100:00100000:1.0:1789708695.401134:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365571328 00000100:00100000:1.0:1789708695.401159:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708695.401165:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3615:x1876645365571328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789708695.401184:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789708695.401214:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3615:x1876645365571328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708695.401220:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789708695.401236:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708695.401239:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708695.401280:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365571328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708695.401322:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708695.401329:0:18645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee11041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365570560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708695.401361:0:18645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee11041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365570560:12345-0@lo:400:kworker.0 Request processed in 33us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708695.401367:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708695.401414:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365571456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708695.401437:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708695.401462:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365571456 00000100:00100000:1.0:1789708695.401465:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365571456 00000100:00100000:1.0:1789708695.401481:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708695.401486:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365571456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789708695.401500:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789708695.401536:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365571456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708695.401542:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708695.401569:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365571456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708695.401612:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365570560:0@lo:400:kworker.0 00010000:00080000:1.0:1789708695.401625:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9bee3fabd500 x1876645365570944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708695.401635:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365570944:0@lo:400:kworker.0 00000100:00100000:3.0:1789708695.401727:0:18838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365570432:12345-0@lo:400:kworker.0 Request processed in 823us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708695.401734:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708695.402213:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365570432:0@lo:400:kworker.0 00000100:00100000:2.0:1789708695.428821:0:20386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1876645365570688:12345-0@lo:38:kworker.0 Request processed in 29334us (29823us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789708695.428836:0:20386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1789708695.429702:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08bfe800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708695.429708:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789708695.429713:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365570688:0@lo:38:kworker.0 00010000:00010000:2.0:1789708696.102358:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789708696.488544:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1789708696.775503:0:21068:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789708696.794452:0:21068:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789708696.794509:0:21068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.794523:0:21068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.794529:0:21068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.794536:0:21068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.794594:0:21068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789708696.794609:0:21068:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789708696.794638:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789708696.794643:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789708696.794663:0:21068:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789708696.794669:0:21068:0:(import.c:65:import_set_state_nolock()) ffff9bed08bfe800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789708696.794674:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789708696.794677:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789708696.794680:0:21068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789708696.795781:0:21068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.795795:0:21068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.795802:0:21068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.795809:0:21068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.795989:0:20169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708696.795997:0:20169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.796005:0:20169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949200 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708696.796018:0:20169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.796026:0:20169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708696.796034:0:20169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708696.796040:0:20169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708696.796043:0:20169:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789708696.796046:0:20169:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789708696.796081:0:20169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.796087:0:20169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789708696.796154:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365571584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708696.796222:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708696.796342:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365571584 00000100:00100000:3.0:1789708696.796351:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365571584 00000100:00100000:3.0:1789708696.796394:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708696.796401:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3618:x1876645365571584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789708696.796408:0:17125:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789708696 with bad export cookie 17608867373094788492 00010000:00010000:0.0:1789708696.797931:0:20169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.797946:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee3e949200/0xf45f43947e47df61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47df68 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.797964:0:20169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708696.797968:0:20169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.797974:0:20169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509000 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708696.797978:0:20169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.797987:0:20169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708696.798007:0:20169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708696.798012:0:20169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708696.798015:0:20169:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789708696.798044:0:20169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.798050:0:20169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708696.798070:0:20169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.798077:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708696.798079:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708696.798082:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708696.798111:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365571712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708696.798162:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708696.798225:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365571712 00000100:00100000:0.0:1789708696.798232:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365571712 00000100:00100000:0.0:1789708696.798279:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708696.798286:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3615:x1876645365571712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789708696.798292:0:17124:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789708696 with bad export cookie 17608867373094788492 00000100:00100000:0.0:1789708696.798333:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3615:x1876645365571712:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (171us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789708696.798340:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789708696.798375:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789708696.798379:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9bee06859000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789708696.798382:0:3615:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1789708696.798450:0:21068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789708696.798456:0:21068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee01509000/0xf45f43947e47deb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47dec0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798468:0:21068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798475:0:21068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798483:0:21068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798498:0:21068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798509:0:21068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708696.798515:0:21068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798522:0:21068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798527:0:21068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798532:0:21068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798540:0:21068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789708696.798545:0:21068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798550:0:21068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798554:0:21068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798559:0:21068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.798576:0:21068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1789708696.798579:0:21068:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1789708696.798584:0:21068:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1789708696.798635:0:21068:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1789708696.798639:0:21068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1789708696.798642:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708696.798648:0:21068:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789708696.798653:0:21068:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9bed0146b800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708696.798659:0:21068:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9bed018e5800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708696.798663:0:21068:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9bed08673380) has exports, disconnecting them 00000020:00080000:1.0:1789708696.798667:0:21068:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9bed0146b800), last request at 1789708695 00000020:00000080:1.0:1789708696.798674:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e198 00000100:00080000:1.0:1789708696.798688:0:21068:0:(import.c:65:import_set_state_nolock()) ffff9bed0146f800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789708696.798730:0:21068:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed0146b800): rc 0 00000020:00000080:1.0:1789708696.798733:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bed0146b800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1789708696.798744:0:21068:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9bed018e5800), last request at 1789708695 00000020:00000080:1.0:1789708696.798747:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e041 00000100:00080000:1.0:1789708696.798752:0:21068:0:(import.c:65:import_set_state_nolock()) ffff9bed018e4000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789708696.798763:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0146b800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789708696.798798:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed0146f800 for lustre-MDT0001 00000020:00080000:1.0:1789708696.798814:0:21068:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed018e5800): rc 0 00000020:00000080:1.0:1789708696.798816:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bed018e5800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1789708696.798825:0:21068:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbde281cb3ad8 00000020:00000080:1.0:1789708696.798835:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed018e5800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789708696.798874:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed018e4000 for lustre-MDT0001 00000100:00080000:1.0:1789708696.798897:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789708696.798904:0:21068:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9bed098d4a80 x1876645365568128/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789708705 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708696.798919:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789708696.799710:0:21068:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789708696.799716:0:21068:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf5000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789708696.799845:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789708696.799848:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1789708696.801040:0:21068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789708696.801116:0:21068:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789708696.801139:0:21068:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf6000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789708696.801158:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789708696.801160:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1789708696.801170:0:21068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789708696.801236:0:21068:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789708696.801246:0:21068:0:(import.c:65:import_set_state_nolock()) ffff9bed0a0a4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789708696.801299:0:21068:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9bed08673380) has no exports 00010000:00010000:2.0:1789708696.801451:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789708696.801459:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.801469:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a200 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708696.801472:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.801480:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708696.801486:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708696.801493:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789708696.801496:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789708696.801499:0:17128:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789708696.802686:0:20169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708696.802695:0:20169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.802704:0:20169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b200 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:1.0:1789708696.802707:0:20169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.802715:0:20169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708696.802722:0:20169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708696.802743:0:20169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789708696.802746:0:20169:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789708696.802748:0:20169:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:3.0:1789708696.804584:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365571840:0@lo:9:umount.0 00000100:00100000:3.0:1789708696.804664:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708696.804706:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365571968:0@lo:9:umount.0 00000100:00100000:3.0:1789708696.804730:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708696.804821:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365571840 00000100:00100000:3.0:1789708696.804829:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365571840 00000100:00100000:3.0:1789708696.805040:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365571968 00000100:00100000:3.0:1789708696.805044:0:18644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365571968 00000100:00100000:3.0:1789708696.805072:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708696.805082:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09b80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876645365571840:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789708696.805109:0:18644:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e1a6 00000100:00080000:3.0:1789708696.805120:0:18644:0:(import.c:65:import_set_state_nolock()) ffff9bee0446c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708696.805170:0:18644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:3.0:1789708696.805350:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09b80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3614:x1876645365571840:12345-0@lo:9:umount.0 Request processed in 268us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708696.805358:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708696.805373:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789708696.805381:0:18644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876645365571968:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789708696.805393:0:18644:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e1b4 00000100:00080000:3.0:1789708696.805399:0:18644:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708696.805414:0:18644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789708696.805491:0:18644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3614:x1876645365571968:12345-0@lo:9:umount.0 Request processed in 111us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708696.805497:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1789708696.805692:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee02bf6000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789708696.805706:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789708696.805708:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789708696.805711:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365571840:0@lo:9:umount.0 00000100:00080000:3.0:1789708696.805724:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0a0a4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789708696.805733:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789708696.805735:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789708696.805738:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365571968:0@lo:9:umount.0 00000100:00100000:3.0:1789708696.805810:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3618:x1876645365571584:12345-0@lo:103:ldlm_bl.0 Request processed in 9407us (9588us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789708696.805818:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1789708696.807015:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708696.807026:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708696.807037:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0600 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708696.807052:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708696.807061:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708696.807068:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708696.807074:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789708696.807077:0:17127:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789708696.807080:0:17127:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1789708696.814773:0:3615:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.152@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789708696.814778:0:3615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789708696.814787:0:3615:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bee3fabc700 x1876645365570176/t0(0) o400->MGC192.168.201.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789708711 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708696.814813:0:3615:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bee3622f800 x1876645365571584/t0(0) o103->MGC192.168.201.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789708712 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708696.814822:0:3615:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bee3622fb80 x1876645365571712/t0(0) o103->MGC192.168.201.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789708712 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789708696.814832:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789708696.814835:0:3615:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789708696.814836:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1789708696.814898:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.814909:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708696.814935:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.814943:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47e27f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e286 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.814963:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708696.814980:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708696.814983:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708696.815002:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708696.816610:0:20169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.816622:0:20169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708696.816654:0:20169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.816662:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47e57a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47e581 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708696.816675:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708696.816677:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708696.816679:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708696.816809:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:0:1876645365572224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708696.817011:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708696.817019:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789708696.817056:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789708696.817074:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708696.817083:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d0600/0xf45f43947e47deab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45f43947e47deb2 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708696.817096:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708696.817098:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708696.817099:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708696.817163:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fda82b2e-0d6b-4cb4-a087-54f6744e5277:0:1876645365572352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708696.817316:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3618:1876645365571584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708696.817316:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:0:1876645365572096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708696.817326:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3616:1876645365570176:0@lo:400:kworker.0 00000100:00080000:0.0:1789708696.819833:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9bee06859000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708696.819848:0:3615:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 219 00000100:00080000:0.0:1789708696.819872:0:3615:0:(import.c:666:import_select_connection()) MGC192.168.201.152@tcp: import ffff9bee06859000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708696.819959:0:3615:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622c700 x1876645365572480/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708696.819998:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365568128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708696.820019:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3615:1876645365571712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708696.820112:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3614:1876645365572480:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1789708696.820158:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876645365572480 offset 0 length 520: 4 00000020:00080000:1.0:1789708696.827108:0:21068:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9bed08673380) has no exports 00000020:01000000:0.0:1789708696.868718:0:21068:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bed09b4af80 - data ffff9bee30e95d80/ffff9bee28b63400 00000020:01000000:0.0:1789708696.868892:0:21068:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bed09b84400 - data ffff9bee18f390d8/ffff9bee28a61c00 00000001:00000004:0.0:1789708696.880413:0:21068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1789708696.906359:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789708696.906367:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789708696.906373:0:21068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789708696.907710:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789708696.907714:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1789708696.907760:0:21068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789708696.907763:0:21068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789708696.908512:0:17879:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789708696.908517:0:17879:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1789708696.908532:0:17879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789708696.909387:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789708696.909392:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789708696.909436:0:21068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789708696.909439:0:21068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789708696.909679:0:17881:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789708696.909683:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789708696.909695:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789708696.910785:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47dece 00000020:00000080:2.0:1789708696.910794:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bed08565000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789708696.911313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08565000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789708696.911519:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47dee3 00000020:00000080:2.0:1789708696.911524:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee06592800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789708696.911565:0:21068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789708696.911571:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708696.911579:0:21068:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789708696.911582:0:21068:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9bed086719c0) has no exports 00000004:01000000:2.0:1789708696.911742:0:21068:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789708696.911749:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47df3e 00000020:00000080:2.0:1789708696.911752:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee36274800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789708696.912089:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee06592800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789708696.912142:0:21068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789708696.912151:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708696.912156:0:21068:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789708696.912158:0:21068:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9bee3dc399c0) has no exports 00000020:00000080:2.0:1789708696.912165:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47df37 00000020:00000080:2.0:1789708696.912168:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee04ebb000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789708696.912299:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee36274800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789708696.912306:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee04ebb000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789708696.912658:0:21068:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789708696.912663:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789708696.912667:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789708696.912671:0:21068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789708696.912673:0:21068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789708696.912712:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708696.912719:0:21068:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789708696.912724:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47df29 00000020:00000080:2.0:1789708696.912728:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee2f56c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789708696.912731:0:21068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789708696.912735:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708696.912738:0:21068:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789708696.912740:0:21068:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9bee3dd7b380) has no exports 00000020:00000080:2.0:1789708696.912744:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47df1b 00000020:00000080:2.0:1789708696.912746:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee02bf1000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789708696.912880:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed0a0a4800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789708696.912886:0:37:0:(genops.c:885:class_export_put()) final put ffff9bee2f56a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789708696.912887:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f56a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789708696.912892:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789708696.912985:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f56c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789708696.912990:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee02bf1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789708696.913688:0:21068:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789708696.913692:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789708696.913694:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1789708696.913698:0:21068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789708696.913700:0:21068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789708696.913767:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708696.913773:0:21068:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789708696.913784:0:21068:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789708696.913790:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47df06 00000020:00000080:2.0:1789708696.913795:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee2f56f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789708696.914085:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee02bf6000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789708696.914091:0:37:0:(genops.c:885:class_export_put()) final put ffff9bee2f568000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789708696.914094:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f568000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789708696.914100:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789708696.914203:0:21068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789708696.914207:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708696.914216:0:21068:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789708696.914219:0:21068:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9bee3dc3cd40) has no exports 00000020:00000080:2.0:1789708696.914225:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47deff 00000020:00000080:2.0:1789708696.914229:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee02bf2800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789708696.915159:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee2f56f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789708696.915167:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee02bf2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789708696.916310:0:21068:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1789708696.916315:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789708696.916319:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789708696.916325:0:21068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789708696.916372:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708696.916380:0:21068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789708696.916408:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708696.916418:0:21068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789708696.916423:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee3f91e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789708696.916427:0:21068:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3f91e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789708696.916436:0:21068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789708696.916586:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47deea 00000020:00000080:3.0:1789708696.916592:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee06594000/lustre-MDD0001_UUID 00000020:01000000:3.0:1789708696.916609:0:21068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1789708696.916612:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708696.916616:0:21068:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789708696.916619:0:21068:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9bed08674d40) has no exports 00000020:00000080:3.0:1789708696.916638:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708696.916641:0:21068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1789708696.916644:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47def1 00000020:00000080:3.0:1789708696.916647:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee06596800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1789708696.916654:0:21068:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee0446d000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1789708696.916657:0:21068:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee0446d000 2 00000020:01000004:3.0:1789708696.916660:0:21068:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bee0446d000 from lustre-MDT0001 00000020:00000080:3.0:1789708696.916687:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708696.916691:0:21068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1789708696.916693:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bed08561800/lustre-MDT0001_UUID 00000020:00000080:3.0:1789708696.916695:0:21068:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08561800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1789708696.916700:0:21068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1789708696.916728:0:21068:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1789708696.916731:0:21068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1789708696.916734:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708696.916737:0:21068:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789708696.916742:0:21068:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9bed08bfb800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789708696.916747:0:21068:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9bee2d98cd40) has exports, disconnecting them 00000020:00080000:3.0:1789708696.916752:0:21068:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9bed08bfb800), last request at 1789708653 00000020:00000080:3.0:1789708696.916755:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47df76 00000020:00080000:3.0:1789708696.916766:0:21068:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed08bfb800): rc 0 00000020:00000080:3.0:1789708696.916777:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bed08bfb800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789708696.917528:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee02bf5000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789708696.917535:0:37:0:(genops.c:885:class_export_put()) final put ffff9bee02bf3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789708696.917538:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee02bf3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789708696.917543:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789708696.917641:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee06594000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789708696.917645:0:37:0:(genops.c:885:class_export_put()) final put ffff9bee3f918000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789708696.917647:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee3f918000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789708696.917650:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789708696.917815:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee06596800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789708696.917824:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed08bfb800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1789708696.934802:0:21068:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1789708696.934811:0:21068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789708696.934816:0:21068:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789708696.934822:0:21068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789708696.935052:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708696.935060:0:21068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1789708696.935068:0:21068:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee0446d000 1 00000020:00000080:3.0:1789708696.935075:0:21068:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47de96 00000020:00000080:3.0:1789708696.935083:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee083c0800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789708696.935185:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed08bfe800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789708696.935199:0:37:0:(genops.c:885:class_export_put()) final put ffff9bee083c4000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789708696.935201:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee083c4000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789708696.935210:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:3.0:1789708696.935388:0:21068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1789708696.935392:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708696.935398:0:21068:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789708696.935401:0:21068:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9bee2d9899c0) has no exports 00000020:00000080:1.0:1789708696.937686:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee083c0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789708696.969504:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708696.969517:0:21068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1789708696.969522:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bee18450800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789708696.969527:0:21068:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee18450800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789708696.969537:0:21068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1789708696.969710:0:21068:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bee06859800 00000020:01000000:3.0:1789708696.969731:0:21068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789708696.969735:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708696.969739:0:21068:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789708696.969743:0:21068:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9bee3dc38000) has no exports 00000100:00100000:1.0:1789708696.969972:0:17138:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9bee056d8000:17138] 0 exiting: rc = 1 00000100:00100000:1.0:1789708696.970063:0:17140:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9bee361adc00:17140] 2 exiting: rc = 0 00000100:00100000:1.0:1789708696.970141:0:18837:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9bed01f4e000:18837] 3 exiting: rc = 0 00000100:00100000:0.0:1789708696.970221:0:19935:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9bee30694c00:19935] 4 exiting: rc = 0 00000100:00100000:0.0:1789708696.970322:0:20386:0:(service.c:3188:ptlrpc_main()) mdt00_005: service thread [ffff9bee28b48c00:20386] 5 exiting: rc = 0 00000100:00100000:2.0:1789708696.970487:0:17139:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9bee056d8400:17139] 1 exiting: rc = 0 00000100:00100000:3.0:1789708696.970591:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970655:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970661:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970667:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970672:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970677:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970683:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970689:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970694:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970709:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970714:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970719:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970725:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970730:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970736:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970740:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970745:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970751:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970756:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970762:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970768:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970773:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970778:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970783:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970790:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970796:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970800:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970806:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970811:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970817:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970822:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970828:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970833:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970838:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970843:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970848:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970865:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970871:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970876:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970881:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970888:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970894:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970900:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970905:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970920:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970925:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970931:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970936:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970941:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970946:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970952:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970957:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970963:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970968:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970972:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970978:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970984:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970990:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.970996:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.971000:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.971005:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.971011:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.971016:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.971021:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708696.977472:0:20282:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9bee30508a00:20282] 2 exiting: rc = 0 00000100:00100000:2.0:1789708696.977583:0:17141:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bee361ac200:17141] 0 exiting: rc = 1 00000100:00100000:0.0:1789708696.977761:0:17142:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bee361acc00:17142] 1 exiting: rc = 0 00000100:00100000:3.0:1789708696.977881:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977888:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977893:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977899:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977906:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977911:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977917:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977922:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977927:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977932:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977939:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977945:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977951:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977957:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977963:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977981:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977987:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977993:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.977999:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978004:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978010:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978015:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978020:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978024:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978029:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978035:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978040:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978044:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978048:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978053:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978059:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978063:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978067:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978073:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978078:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978083:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978088:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978092:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978096:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978101:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978106:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978111:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978116:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978121:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978126:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978131:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978135:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978141:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978146:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978151:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978162:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978167:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978172:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978177:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978181:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978186:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978191:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978196:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978201:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978206:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978211:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978216:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978220:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708696.978225:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980448:0:18670:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9bed019e8400:18670] 2 exiting: rc = 0 00000100:00100000:0.0:1789708696.980537:0:17144:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9bee361ac800:17144] 1 exiting: rc = 0 00000100:00100000:2.0:1789708696.980655:0:17143:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9bee361ace00:17143] 0 exiting: rc = 1 00000100:00100000:0.0:1789708696.980788:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980795:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980801:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980807:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980819:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980826:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980832:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980837:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980843:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980849:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980867:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980875:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980880:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980886:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980892:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980897:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980916:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980923:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980929:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980934:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980941:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980946:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980952:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980959:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980965:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980972:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980978:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.980984:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981003:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981010:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981016:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981022:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981027:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981033:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981039:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981050:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981056:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981062:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981066:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981072:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981089:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981094:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981100:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981106:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981111:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981116:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981121:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981127:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981132:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981138:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981143:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981149:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981165:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981172:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981177:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981183:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981188:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981194:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981200:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981206:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981213:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981219:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981224:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708696.981229:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708697.034386:0:17145:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bee361aca00:17145] 0 exiting: rc = 1 00000100:00100000:1.0:1789708697.034529:0:17146:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bee361ad800:17146] 1 exiting: rc = 0 00000100:00100000:3.0:1789708697.034632:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034640:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034646:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034651:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034657:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034662:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034667:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034672:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034677:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034682:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034687:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034692:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034697:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034702:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034708:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034712:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034718:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034723:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034727:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034732:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034737:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034752:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034758:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034763:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034767:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034772:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034779:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034784:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034788:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034793:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034799:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034803:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034809:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034814:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034819:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034824:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034829:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034834:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034840:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034845:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034913:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034921:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034925:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034930:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034935:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034941:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034945:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034951:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034956:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034962:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034967:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034972:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034977:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034982:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034987:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.034992:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035003:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035009:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035014:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035019:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035024:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035029:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035034:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035039:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708697.035546:0:17148:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bee361ad600:17148] 1 exiting: rc = 0 00000100:00100000:2.0:1789708697.035548:0:17147:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bee361ada00:17147] 0 exiting: rc = 1 00000100:00100000:3.0:1789708697.035703:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035710:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035715:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035720:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035725:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035730:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035735:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035740:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035744:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035749:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035754:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035759:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035764:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035770:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035774:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035779:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035784:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035788:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035793:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035797:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035802:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035807:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035811:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035816:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035820:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035824:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035829:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035842:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035846:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035866:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035872:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035876:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035881:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035886:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035891:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035895:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035900:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035906:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035910:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035915:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035920:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035924:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035929:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035934:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035938:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035943:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035949:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035954:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035959:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035964:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035969:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035974:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035978:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035984:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035989:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035993:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.035998:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036003:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036008:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036013:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036018:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036022:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036033:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036038:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708697.036616:0:17149:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bee361ac000:17149] 0 exiting: rc = 1 00000100:00100000:2.0:1789708697.036627:0:19637:0:(service.c:3188:ptlrpc_main()) mdt_fld_0002: service thread [ffff9bed07f38600:19637] 2 exiting: rc = 0 00000100:00100000:1.0:1789708697.036747:0:17150:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bee36e43400:17150] 1 exiting: rc = 0 00000100:00100000:3.0:1789708697.036807:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036813:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036818:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036822:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036827:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036831:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036835:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036839:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036843:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036848:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036862:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036867:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036871:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036876:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036881:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036886:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036891:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036895:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036900:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036904:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036919:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036924:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036929:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036933:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036938:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036942:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036947:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036951:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036956:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036961:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036966:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036971:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036976:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036988:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036993:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.036998:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037003:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037009:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037014:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037020:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037025:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037030:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037035:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037040:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037045:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037050:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037055:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037060:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037065:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037069:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037074:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037079:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037084:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037089:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037094:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037099:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037104:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037108:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037113:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037118:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037123:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037128:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037133:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.037139:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708697.038082:0:17151:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9bee36e42000:17151] 0 exiting: rc = 1 00000100:00100000:2.0:1789708697.038499:0:17153:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9bee36e43a00:17153] 2 exiting: rc = 0 00000100:00100000:1.0:1789708697.038846:0:17152:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9bee36e43600:17152] 1 exiting: rc = 0 00000100:00100000:3.0:1789708697.039015:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039022:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039027:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039033:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039047:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039052:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039058:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039064:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039070:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039075:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039080:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039086:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039091:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039097:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039104:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039108:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039114:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039120:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039130:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039136:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039142:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039147:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039153:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039158:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039164:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039170:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039176:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039183:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039189:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039194:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039200:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039205:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039210:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039216:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039221:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039227:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039233:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039239:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039244:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039256:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039509:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039516:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039522:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039528:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039534:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039539:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039544:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039550:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039557:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039562:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039568:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039573:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039579:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039584:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039590:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039595:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039600:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039606:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039611:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039616:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039622:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039627:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039633:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708697.039639:0:21068:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789708697.046898:0:21068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708697.046966:0:21068:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789708697.046972:0:21068:0:(genops.c:885:class_export_put()) final put ffff9bed0a0a4000/MDS_uuid 00000020:00000080:3.0:1789708697.046977:0:21068:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0a0a4000/MDS_uuid for MDS 00000020:01000000:3.0:1789708697.046986:0:21068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789708697.047120:0:21068:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789708697.127451:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708698.150743:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708699.174826:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708700.297583:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708700.522410:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708700.522421:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708700.522431:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708700.522434:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789708700.522438:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bed01d73000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708700.522446:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 266 00000100:00080000:3.0:1789708700.522452:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789708700.522464:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bed01d73000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708700.522497:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cc700 x1876645365572608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708700.522548:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708700.522551:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789708700.522553:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bed0146d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708700.522556:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 266 00000100:00080000:3.0:1789708700.522558:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789708700.522562:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bed0146d000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708700.522573:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cdf80 x1876645365572864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789708700.522635:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365572608:0@lo:38:kworker.0 00000400:00000100:1.0:1789708700.522679:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365572608 offset 0 length 520: 4 00000100:00100000:1.0:1789708700.522716:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365572864:0@lo:38:kworker.0 00000400:00000100:1.0:1789708700.522730:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365572864 offset 0 length 520: 4 00000100:00100000:1.0:1789708700.522762:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365572992:0@lo:400:kworker.0 00000400:00000100:1.0:1789708700.522781:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365572992 offset 0 length 224: 4 00000100:00100000:1.0:1789708700.522809:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708700.522815:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365572736:0@lo:400:kworker.0 00000400:00000100:1.0:1789708700.522830:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365572736 offset 0 length 224: 4 00000020:01000004:2.0:1789708700.686319:0:21268:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789708700.704484:0:21268:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789708700.704560:0:21268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.704577:0:21268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.704584:0:21268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.704591:0:21268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.704616:0:21268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789708700.704623:0:21268:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789708700.704648:0:21268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789708700.704660:0:21268:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a2cc700 x1876645365572608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789708720 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708700.704704:0:21268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789708700.704711:0:21268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789708700.704717:0:21268:0:(import.c:65:import_set_state_nolock()) ffff9bed01d73000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789708700.704722:0:21268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789708700.704726:0:21268:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a2cc700 x1876645365572608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789708720 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708700.704732:0:21268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789708700.704734:0:21268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:1.0:1789708700.705052:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365572608:0@lo:38:kworker.0 00000100:00080000:2.0:1789708700.706116:0:21268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789708700.706126:0:21268:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a2ce300 x1876645365572736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708716 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708700.706152:0:21268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789708700.706157:0:21268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789708700.706178:0:21268:0:(import.c:65:import_set_state_nolock()) ffff9bed01d71800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789708700.706234:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876645365573120:0@lo:39:umount.0 00000400:00000100:3.0:1789708700.706301:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365573120 offset 0 length 224: 4 00000100:00100000:1.0:1789708700.706444:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365572736:0@lo:400:kworker.0 00010000:00010000:0.0:1789708700.706608:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708700.706626:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.706634:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4400 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708700.706637:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.706646:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708700.706653:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708700.706658:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708700.706661:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789708700.706663:0:17128:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789708700.706677:0:17128:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee06859000 00010000:00010000:0.0:1789708700.706681:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.706688:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4400/0xf45f43947e47e009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47e010 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.706699:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708700.706701:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708700.706703:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708701.351121:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708701.542829:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789708701.542840:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789708701.542843:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789708701.542862:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789708701.542998:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365573248:0@lo:400:kworker.0 00000400:00000100:2.0:1789708701.543053:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365573248 offset 0 length 224: 4 00000001:00100000:2.0:1789708702.058240:0:19461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789708702.058249:0:19461:0:(genops.c:885:class_export_put()) final put ffff9bee0446b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789708702.058493:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee0446b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789708702.058560:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee04469000 for lustre-OST0001 00000001:00100000:0.0:1789708702.059083:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789708702.059088:0:18640:0:(genops.c:885:class_export_put()) final put ffff9bee04468000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789708702.059216:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee04468000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789708702.059249:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee0446c000 for lustre-OST0000 00010000:00010000:1.0:1789708702.374603:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708703.398694:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708704.422780:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708705.447764:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789708705.575239:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789708705.575254:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789708705.575286:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789708705.575291:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789708705.576806:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365573376:0@lo:400:kworker.0 00000400:00000100:2.0:1789708705.576898:0:3618:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365573376 offset 0 length 224: 4 00010000:00010000:1.0:1789708706.470577:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708706.855772:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708696/real 1789708696] req@ffff9bee3622c700 x1876645365572480/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789708706 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708706.855830:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3622c700 x1876645365572480/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789708706 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789708706.855851:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee06859000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708706.855882:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789708706.855886:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3614:1876645365572480:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1789708706.856481:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789708706.856486:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789708706.856489:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee06859000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708706.856494:0:37:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 267 00000100:00080000:1.0:1789708706.856499:0:37:0:(import.c:630:import_select_connection()) MGC192.168.201.152@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789708706.856510:0:37:0:(import.c:666:import_select_connection()) MGC192.168.201.152@tcp: import ffff9bee06859000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708706.856539:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed098d6680 x1876645365573504/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708706.856565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789708706.856569:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789708706.856643:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365573632:0@lo:400:kworker.0 00000400:00000100:0.0:1789708706.856706:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365573632 offset 0 length 224: 4 00000100:00100000:3.0:1789708706.857841:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3614:1876645365573504:0@lo:250:kworker.0 00000400:00000100:3.0:1789708706.857885:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876645365573504 offset 0 length 520: 4 00010000:00010000:3.0:1789708707.494534:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708708.518499:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708709.543079:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708710.566706:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708710.950374:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708700/real 1789708700] req@ffff9bee3fac0700 x1876645365573120/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708710 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708710.950414:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3fac0700 x1876645365573120/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708710 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789708710.950436:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed01d71800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789708710.950455:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876645365573120:0@lo:39:umount.0 00000100:00080000:2.0:1789708710.950565:0:21268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789708710.950575:0:21268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789708710.950583:0:21268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789708710.951795:0:21268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.951899:0:21268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.951907:0:21268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.951914:0:21268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.952014:0:21268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708710.952024:0:21268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.952032:0:21268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.952039:0:21268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.952045:0:21268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708710.952075:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789708710.952083:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708710.952090:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee3e949c00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708710.952094:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708710.952103:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708710.952121:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708710.952126:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789708710.952129:0:17127:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1789708710.952139:0:17127:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee06859000 00010000:00010000:3.0:1789708710.952143:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708710.952150:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee3e949c00/0xf45f43947e47dfdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47dfe6 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708710.952165:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708710.952168:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708710.952173:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a800 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708710.952176:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708710.952182:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708710.952188:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708710.952194:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789708710.952196:0:17127:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789708710.952200:0:17127:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee06859000 00010000:00010000:3.0:1789708710.952209:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708710.952216:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708710.952218:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708710.952220:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708710.952312:0:21268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789708710.952317:0:21268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47e56c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47e573 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708710.952328:0:21268:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1789708710.952333:0:21268:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789708710.952348:0:21268:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789708710.952382:0:21268:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789708710.952387:0:21268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789708710.952392:0:21268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708710.952398:0:21268:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789708710.952402:0:21268:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9bee3dd78000) has no exports 00000020:00080000:2.0:1789708710.952427:0:21268:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9bee3dd78000) has no exports 00010000:00010000:0.0:1789708710.952637:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789708710.956167:0:21268:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bed09b4ac00 - data ffff9bee18f7d000/ffff9bee28b60400 00000020:01000000:2.0:1789708710.956456:0:21268:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee0539b400 - data ffff9bed080b06c0/ffff9bee30768800 00100000:10000000:2.0:1789708710.963962:0:21268:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789708710.970128:0:21268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47dff4 00000020:00000080:2.0:1789708710.970145:0:21268:0:(genops.c:885:class_export_put()) final put ffff9bed01d42000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789708710.970217:0:21268:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bed0a047000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789708710.970223:0:21268:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed0a047000 2 00000020:01000004:2.0:1789708710.970227:0:21268:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bed0a047000 from lustre-OST0000 00000020:00000080:2.0:1789708710.970297:0:21268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708710.970309:0:21268:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789708710.970313:0:21268:0:(genops.c:885:class_export_put()) final put ffff9bed01d40000/lustre-OST0000_UUID 00000020:00000080:2.0:1789708710.970316:0:21268:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed01d40000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789708710.970324:0:21268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789708710.970393:0:21268:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789708710.970398:0:21268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789708710.970402:0:21268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708710.970407:0:21268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789708710.970415:0:21268:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bed01d70800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789708710.970421:0:21268:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9bee3dc3b380) has exports, disconnecting them 00000020:00080000:2.0:1789708710.970426:0:21268:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bed01d70800), last request at 1789708658 00000020:00000080:2.0:1789708710.970431:0:21268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e01e 00000020:00080000:2.0:1789708710.970440:0:21268:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed01d70800): rc 0 00000020:00000080:2.0:1789708710.970444:0:21268:0:(genops.c:885:class_export_put()) final put ffff9bed01d70800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789708710.970661:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed01d42000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789708710.971632:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed01d70800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789708710.971659:0:21268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789708710.971665:0:21268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789708710.971670:0:21268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789708710.971677:0:21268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789708710.971928:0:21268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708710.971939:0:21268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789708710.971945:0:21268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789708710.971949:0:21268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708710.971953:0:21268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789708710.971959:0:21268:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9bed01d77000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789708710.971965:0:21268:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9bee2f48cd40) has exports, disconnecting them 00000020:00080000:3.0:1789708710.971969:0:21268:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9bed01d77000), last request at 1789708658 00000020:00000080:3.0:1789708710.971973:0:21268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e03a 00000020:00080000:3.0:1789708710.971987:0:21268:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed01d77000): rc 0 00000020:00000080:3.0:1789708710.971994:0:21268:0:(genops.c:885:class_export_put()) final put ffff9bed01d77000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789708710.972027:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed01d73000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789708710.972033:0:8:0:(genops.c:885:class_export_put()) final put ffff9bed01d75000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789708710.972035:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed01d75000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789708710.972040:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789708710.973388:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed01d77000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789708710.977326:0:21268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789708710.977346:0:21268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789708710.977352:0:21268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789708710.977360:0:21268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789708710.977410:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed01d71800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789708710.977772:0:21268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708710.977783:0:21268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789708710.977791:0:21268:0:(genops.c:885:class_export_put()) final put ffff9bed01d71000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789708710.977796:0:21268:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed01d71000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789708710.977802:0:21268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789708710.977897:0:21268:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed0a047000 1 00000020:00000080:1.0:1789708710.977903:0:21268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47dfd1 00000020:00000080:1.0:1789708710.977910:0:21268:0:(genops.c:885:class_export_put()) final put ffff9bee083c4800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789708710.977918:0:21268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789708710.977926:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee083c4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789708710.977940:0:21268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708710.977945:0:21268:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789708710.977950:0:21268:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9bee2d98b380) has no exports 00000020:00000080:1.0:1789708711.006478:0:21268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708711.006500:0:21268:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789708711.006508:0:21268:0:(genops.c:885:class_export_put()) final put ffff9bed0a045000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789708711.006514:0:21268:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0a045000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789708711.006528:0:21268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789708711.006704:0:21268:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bed0a042000 00000020:02000400:1.0:1789708711.006769:0:21268:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789708711.591315:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708712.299067:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708712.299077:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708712.299081:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789708712.299084:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789708712.299173:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708712.299191:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365573760:0@lo:400:kworker.0 00000400:00000100:3.0:1789708712.299240:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365573760 offset 0 length 224: 4 00010000:00010000:1.0:1789708712.616395:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789708713.229770:0:21471:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789708713.242995:0:21471:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789708713.243078:0:21471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708713.243094:0:21471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708713.243101:0:21471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708713.243107:0:21471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708713.243135:0:21471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789708713.243141:0:21471:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789708713.243169:0:21471:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708713.243182:0:21471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a2cdf80 x1876645365572864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789708720 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708713.243209:0:21471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789708713.243216:0:21471:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789708713.243223:0:21471:0:(import.c:65:import_set_state_nolock()) ffff9bed0146d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789708713.243227:0:21471:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708713.243232:0:21471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a2cdf80 x1876645365572864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789708720 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708713.243238:0:21471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789708713.243241:0:21471:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:1.0:1789708713.243328:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708713.243337:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708713.243345:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493e00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:1.0:1789708713.243348:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708713.243356:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708713.243369:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708713.243374:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789708713.243377:0:17127:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789708713.243379:0:17127:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789708713.243392:0:17127:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee06859000 00010000:00010000:1.0:1789708713.243396:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708713.243402:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47e167 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47e16e expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708713.243412:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708713.243414:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708713.243415:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708713.243494:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365572864:0@lo:38:kworker.0 00000100:00080000:0.0:1789708713.245203:0:21471:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789708713.245215:0:21471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a2cd500 x1876645365572992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708716 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708713.245448:0:21471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bee3622ce00 x1876645365573248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708717 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708713.245477:0:21471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed098d5880 x1876645365573376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708721 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708713.245493:0:21471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed098d4e00 x1876645365573632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708722 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708713.245508:0:21471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bed0a2ce680 x1876645365573760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708728 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708713.245515:0:21471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789708713.245520:0:21471:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789708713.245544:0:21471:0:(import.c:65:import_set_state_nolock()) ffff9bed04161000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789708713.245721:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876645365573888:0@lo:39:umount.0 00000400:00000100:3.0:1789708713.245769:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645365573888 offset 0 length 224: 4 00000100:00100000:3.0:1789708713.245831:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365573760:0@lo:400:kworker.0 00000100:00100000:3.0:1789708713.245841:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365573632:0@lo:400:kworker.0 00000100:00100000:1.0:1789708713.245958:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365573248:0@lo:400:kworker.0 00000100:00100000:2.0:1789708713.246003:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365572992:0@lo:400:kworker.0 00000100:00100000:2.0:1789708713.246039:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365573376:0@lo:400:kworker.0 00010000:00010000:0.0:1789708713.638521:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708714.662610:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708715.687991:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708716.710540:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708717.414955:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789708717.414974:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789708717.734550:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708718.759087:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708719.782462:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708720.806493:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708721.446468:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708706/real 1789708706] req@ffff9bed098d6680 x1876645365573504/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789708721 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708721.446521:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bed098d6680 x1876645365573504/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789708721 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789708721.446549:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee06859000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708721.446578:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789708721.446583:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3614:1876645365573504:0@lo:250:kworker.0 00000100:00080000:2.0:1789708721.446672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789708721.446683:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789708721.446688:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bee06859000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708721.446696:0:8:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 277 00000100:00080000:2.0:1789708721.446702:0:8:0:(import.c:630:import_select_connection()) MGC192.168.201.152@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789708721.446715:0:8:0:(import.c:666:import_select_connection()) MGC192.168.201.152@tcp: import ffff9bee06859000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708721.446752:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fac0000 x1876645365574016/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789708721.446875:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3614:1876645365574016:0@lo:250:kworker.0 00000400:00000100:3.0:1789708721.446923:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876645365574016 offset 0 length 520: 4 00010000:00010000:1.0:1789708721.830610:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708722.854531:0:18292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708723.494392:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708713/real 1789708713] req@ffff9bee3622fb80 x1876645365573888/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708723 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708723.494436:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3622fb80 x1876645365573888/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708723 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789708723.494569:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed04161000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789708723.494645:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876645365573888:0@lo:39:umount.0 00000100:00080000:0.0:1789708723.494723:0:21471:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789708723.494730:0:21471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789708723.494737:0:21471:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789708723.496091:0:21471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708723.496236:0:21471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708723.496245:0:21471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708723.496253:0:21471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708723.496406:0:21471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708723.496419:0:21471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708723.496428:0:21471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708723.496434:0:21471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708723.496440:0:21471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.496654:0:20169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708723.496666:0:20169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.496675:0:20169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492800 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:1.0:1789708723.496679:0:20169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.496708:0:20169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708723.496715:0:20169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708723.496722:0:20169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789708723.496725:0:20169:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789708723.496741:0:20169:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee06859000 00010000:00010000:1.0:1789708723.496746:0:20169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.496753:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee30492800/0xf45f43947e47e13d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47e144 expref: -99 pid: 19460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.496776:0:20169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708723.496780:0:20169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.496786:0:20169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9600 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:1.0:1789708723.496789:0:20169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.496796:0:20169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708723.496804:0:20169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708723.496820:0:20169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789708723.496823:0:20169:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789708723.496829:0:20169:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee06859000 00010000:00010000:1.0:1789708723.496832:0:20169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.496840:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708723.496842:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708723.496844:0:20169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708723.496925:0:21471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789708723.496937:0:21471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee029c9600/0xf45f43947e47e55e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47e565 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708723.496954:0:21471:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789708723.496960:0:21471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789708723.496978:0:21471:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789708723.497025:0:21471:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789708723.497030:0:21471:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789708723.497037:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708723.497046:0:21471:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789708723.497051:0:21471:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9bed042019c0) has no exports 00000020:00080000:0.0:1789708723.497088:0:21471:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9bed042019c0) has no exports 00010000:00010000:1.0:1789708723.502042:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789708723.503746:0:21471:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bee03127880 - data ffff9bed080b36c0/ffff9bee28b1e000 00000020:01000000:0.0:1789708723.503924:0:21471:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bed09b4a580 - data ffff9bee18f14d80/ffff9bed01a66000 00100000:10000000:0.0:1789708723.511075:0:21471:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789708723.519672:0:21471:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e152 00000020:00000080:2.0:1789708723.519684:0:21471:0:(genops.c:885:class_export_put()) final put ffff9bed04225800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789708723.519839:0:21471:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee30700000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789708723.519844:0:21471:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee30700000 2 00000020:01000004:2.0:1789708723.519848:0:21471:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bee30700000 from lustre-OST0001 00000020:00000080:2.0:1789708723.519886:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708723.519897:0:21471:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789708723.519901:0:21471:0:(genops.c:885:class_export_put()) final put ffff9bed04222000/lustre-OST0001_UUID 00000020:00000080:2.0:1789708723.519904:0:21471:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed04222000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789708723.519911:0:21471:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789708723.520023:0:21471:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import fda82b2e-0d6b-4cb4-a087-54f6744e5277->MGS 00010000:00010000:2.0:1789708723.520037:0:21471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1e00/0xf45f43947e47de9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47dea4 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708723.520050:0:21471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1e00/0xf45f43947e47de9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47dea4 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708723.520073:0:21471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789708723.520076:0:21471:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789708723.520079:0:21471:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789708723.520094:0:21471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee06859000 00010000:00010000:2.0:1789708723.520097:0:21471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1e00/0xf45f43947e47de9d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47dea4 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.520126:0:21471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708723.520134:0:21471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708723.520139:0:21471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789708723.520141:0:21471:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789708723.520143:0:21471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789708723.520153:0:21471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bee06859000 00010000:00010000:2.0:1789708723.520156:0:21471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee3e949600/0xf45f43947e47dd93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45f43947e47dd9a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789708723.520171:0:21471:0:(import.c:65:import_set_state_nolock()) ffff9bee06859000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789708723.520175:0:21471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789708723.520177:0:21471:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789708723.520179:0:21471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789708723.520184:0:21471:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789708723.520195:0:21471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bee3fac0000 x1876645365574016/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789708741 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789708723.520217:0:21471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789708723.520221:0:21471:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:3.0:1789708723.520386:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fda82b2e-0d6b-4cb4-a087-54f6744e5277:3614:1876645365574016:0@lo:250:kworker.0 10000000:01000000:2.0:1789708723.520448:0:21471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789708723.520461:0:21471:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47dd7e 00000020:00000080:2.0:1789708723.520466:0:21471:0:(genops.c:885:class_export_put()) final put ffff9bed0a0a2800/fda82b2e-0d6b-4cb4-a087-54f6744e5277 00000020:00000080:1.0:1789708723.520502:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed04225800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789708723.520565:0:21471:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.152@tcp (flags='') 00000020:00000080:2.0:1789708723.520570:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708723.520575:0:21471:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789708723.520578:0:21471:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9bed09714d40) has no exports 10000000:01000000:3.0:1789708723.520631:0:17136:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789708723.520699:0:21471:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.152@tcp: client import never connected 00000100:00080000:2.0:1789708723.520703:0:21471:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789708723.520704:0:21471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789708723.520707:0:21471:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789708723.520708:0:21471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789708723.520734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0a0a2800/fda82b2e-0d6b-4cb4-a087-54f6744e5277 for MGC192.168.201.152@tcp 00000020:00000080:2.0:1789708723.520811:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708723.520817:0:21471:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.152@tcp (uuid fda82b2e-0d6b-4cb4-a087-54f6744e5277) 00000020:01000000:2.0:1789708723.520822:0:21471:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789708723.520825:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708723.520829:0:21471:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789708723.520833:0:21471:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bed01469000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789708723.520839:0:21471:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9bee2f48b380) has exports, disconnecting them 00000020:00080000:2.0:1789708723.520844:0:21471:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bed01469000), last request at 1789708663 00000020:00000080:2.0:1789708723.520848:0:21471:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e17c 00000020:00080000:2.0:1789708723.520856:0:21471:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed01469000): rc 0 00000020:00000080:2.0:1789708723.520861:0:21471:0:(genops.c:885:class_export_put()) final put ffff9bed01469000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789708723.520879:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bee06859000 for MGC192.168.201.152@tcp 00000020:00000080:1.0:1789708723.520885:0:8:0:(genops.c:885:class_export_put()) final put ffff9bee0685b800/fda82b2e-0d6b-4cb4-a087-54f6744e5277 00000020:00000080:1.0:1789708723.520887:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee0685b800/fda82b2e-0d6b-4cb4-a087-54f6744e5277 for MGC192.168.201.152@tcp 00000020:01000000:1.0:1789708723.520892:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.152@tcp (fda82b2e-0d6b-4cb4-a087-54f6744e5277) 00000020:00000080:1.0:1789708723.522068:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed01469000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789708723.522310:0:21471:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789708723.522314:0:21471:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789708723.522318:0:21471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789708723.522323:0:21471:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789708723.522494:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708723.522501:0:21471:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789708723.522507:0:21471:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789708723.522512:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708723.522516:0:21471:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789708723.522522:0:21471:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9bed04164800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789708723.522527:0:21471:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9bed015c99c0) has exports, disconnecting them 00000020:00080000:3.0:1789708723.522531:0:21471:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9bed04164800), last request at 1789708663 00000020:00000080:3.0:1789708723.522535:0:21471:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e191 00000020:00080000:3.0:1789708723.522548:0:21471:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bed04164800): rc 0 00000020:00000080:3.0:1789708723.522552:0:21471:0:(genops.c:885:class_export_put()) final put ffff9bed04164800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789708723.523427:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed0146d000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789708723.523437:0:8:0:(genops.c:885:class_export_put()) final put ffff9bed0146c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789708723.523439:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0146c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789708723.523445:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789708723.523509:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed04164800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789708723.527350:0:21471:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789708723.527372:0:21471:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789708723.527377:0:21471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789708723.527385:0:21471:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789708723.527439:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bed04161000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789708723.527493:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789708723.531419:0:18292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789708723.531574:0:20169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1789708723.531683:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1789708723.531806:0:17174:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9bee34085600:17174] 2 exiting: rc = 0 00000100:00100000:3.0:1789708723.532017:0:17123:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bee1800a200:17123] 1 exiting: rc = 0 00000100:00100000:2.0:1789708723.552972:0:18672:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_003: service thread [ffff9bed01f8e600:18672] 3 exiting: rc = 0 00000100:00100000:3.0:1789708723.560179:0:17122:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bee1800a400:17122] 0 exiting: rc = 1 00000100:00100000:1.0:1789708723.560408:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.560418:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708723.560764:0:17124:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bee1800a000:17124] 0 exiting: rc = 1 00000100:00100000:2.0:1789708723.560836:0:17125:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bee1800b400:17125] 1 exiting: rc = 0 00000100:00100000:1.0:1789708723.560933:0:17126:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bee1800b000:17126] 2 exiting: rc = 0 00000100:00100000:3.0:1789708723.561038:0:17891:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bee306bce00:17891] 3 exiting: rc = 0 00000100:00100000:1.0:1789708723.561214:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561221:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561226:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561232:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561237:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561249:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561256:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561348:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561355:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561372:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561378:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561383:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561388:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561394:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561399:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561404:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561409:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561415:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561421:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561427:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561432:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561438:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561443:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561447:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561453:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561471:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561477:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561482:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561487:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561492:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561499:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561505:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561510:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561515:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561520:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561525:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561530:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561535:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561540:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561546:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561551:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561556:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561561:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561566:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561572:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561576:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561581:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561587:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561593:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561600:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561605:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561610:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561617:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561623:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561628:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561633:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561639:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561644:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561649:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561654:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561668:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561673:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561679:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.561685:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789708723.562710:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708723.562720:0:21471:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789708723.562726:0:21471:0:(genops.c:885:class_export_put()) final put ffff9bed04162800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789708723.562730:0:21471:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed04162800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789708723.562735:0:21471:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789708723.562786:0:21471:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee30700000 1 00000020:00000080:1.0:1789708723.562792:0:21471:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47e136 00000020:00000080:1.0:1789708723.562798:0:21471:0:(genops.c:885:class_export_put()) final put ffff9bed01d72800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789708723.562848:0:21471:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789708723.562853:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708723.562858:0:21471:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789708723.562862:0:21471:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9bed04204d40) has no exports 00000020:00000080:2.0:1789708723.565202:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed01d72800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789708723.579823:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708723.579837:0:21471:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789708723.579842:0:21471:0:(genops.c:885:class_export_put()) final put ffff9bee30701800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789708723.579847:0:21471:0:(genops.c:844:class_export_destroy()) destroying export ffff9bee30701800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789708723.579853:0:21471:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789708723.580315:0:21471:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bee30706800 00000020:01000000:1.0:1789708723.580342:0:21471:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789708723.580347:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708723.580352:0:21471:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789708723.580356:0:21471:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9bee2d988000) has no exports 00000020:00000080:1.0:1789708723.580392:0:21471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708723.580397:0:21471:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789708723.580400:0:21471:0:(genops.c:885:class_export_put()) final put ffff9bed0a046000/OSS_uuid 00000020:00000080:1.0:1789708723.580402:0:21471:0:(genops.c:844:class_export_destroy()) destroying export ffff9bed0a046000/OSS_uuid for OSS 00000020:01000000:1.0:1789708723.580406:0:21471:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789708723.580499:0:18646:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9bee203fda00:18646] 2 exiting: rc = 0 00000100:00100000:1.0:1789708723.580599:0:19635:0:(service.c:3188:ptlrpc_main()) ll_ost00_005: service thread [ffff9bed0414a800:19635] 5 exiting: rc = 0 00000100:00100000:3.0:1789708723.580669:0:18838:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9bed01f4fa00:18838] 3 exiting: rc = 0 00000100:00100000:3.0:1789708723.580746:0:19636:0:(service.c:3188:ptlrpc_main()) ll_ost00_006: service thread [ffff9bee28af3c00:19636] 6 exiting: rc = 0 00000100:00100000:3.0:1789708723.580822:0:18644:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9bee3e869a00:18644] 0 exiting: rc = 1 00000100:00100000:3.0:1789708723.580873:0:19634:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff9bed01d53a00:19634] 4 exiting: rc = 0 00000100:00100000:3.0:1789708723.580949:0:18645:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9bee0a9ce800:18645] 1 exiting: rc = 0 00000100:00100000:1.0:1789708723.581028:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:2.0:1789708723.581031:0:17135:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789708723.581039:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581048:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581057:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581066:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581076:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581083:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581091:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581112:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581122:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581131:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581139:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581147:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581153:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581159:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581167:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581172:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581177:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581181:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581186:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581191:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581196:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581201:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581206:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581212:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581216:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581222:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581227:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581232:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581328:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581337:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581342:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581347:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581353:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581369:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581383:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581389:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581393:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581398:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581403:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581408:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581413:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581417:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581422:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581426:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581431:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581436:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581441:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581446:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581450:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581455:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581460:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581466:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581471:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581477:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581482:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581488:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581493:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581499:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581504:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581509:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581514:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581520:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.581533:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708723.582825:0:18648:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bee0904a600:18648] 1 exiting: rc = 0 00000100:00100000:2.0:1789708723.582959:0:18647:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bee0904ae00:18647] 0 exiting: rc = 1 00000100:00100000:1.0:1789708723.583021:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583028:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583032:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583037:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583043:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583049:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583062:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583067:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583072:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583077:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583082:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583088:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583093:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583098:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583169:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583175:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583179:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583185:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583189:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583195:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583200:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583205:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583209:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583218:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583228:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583254:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583310:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583318:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583326:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583333:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583337:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583342:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583350:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583369:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583378:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583384:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583390:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583395:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583400:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583407:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583415:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583432:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583439:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583445:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583450:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583461:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583468:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583474:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583479:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583485:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583490:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583495:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583500:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583505:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583510:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583515:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583520:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583525:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583530:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583535:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583540:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583545:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583549:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.583555:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708723.585004:0:18650:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bee0904be00:18650] 1 exiting: rc = 0 00000100:00100000:3.0:1789708723.585257:0:18649:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bee0904b400:18649] 0 exiting: rc = 1 00000100:00100000:2.0:1789708723.585621:0:18651:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bee0904a800:18651] 2 exiting: rc = 0 00000100:00100000:1.0:1789708723.585874:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585882:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585888:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585902:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585908:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585914:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585920:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585925:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585931:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585936:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585942:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585947:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585965:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585970:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585976:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585982:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585987:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585992:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.585997:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586003:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586009:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586014:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586019:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586025:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586030:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586035:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586041:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586061:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586069:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586075:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586080:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586086:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586090:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586096:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586112:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586119:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586124:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586129:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586135:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586140:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586146:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586151:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586157:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586162:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586169:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586173:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586178:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586192:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586197:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586202:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586208:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586227:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586234:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586335:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586341:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586347:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586352:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586369:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586376:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586382:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586388:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586393:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586403:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.586419:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.593698:0:18653:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bee28bf2a00:18653] 1 exiting: rc = 0 00000100:00100000:2.0:1789708723.593844:0:18652:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bee28bf2400:18652] 0 exiting: rc = 1 00000100:00100000:1.0:1789708723.593997:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594005:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594010:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594015:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594019:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594023:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594028:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594034:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594039:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594044:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594049:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594054:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594059:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594063:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594068:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594073:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594079:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594084:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594096:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594101:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594106:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594111:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594116:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594122:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594127:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594132:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594137:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594143:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594148:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594153:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594158:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594164:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594169:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594175:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594180:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594185:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594191:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594196:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594201:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594205:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594210:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594215:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594221:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594227:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594232:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594237:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594241:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594246:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594251:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594255:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594484:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594493:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594498:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594510:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594515:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594520:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594525:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594530:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594535:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594540:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594545:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594551:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594556:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708723.594561:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708723.595746:0:18655:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bed01cae200:18655] 1 exiting: rc = 0 00000100:00100000:2.0:1789708723.595900:0:18654:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bee28bf3e00:18654] 0 exiting: rc = 1 00000100:00100000:0.0:1789708723.595995:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596006:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596013:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596021:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596027:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596051:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596059:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596066:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596073:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596082:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596090:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596097:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596104:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596111:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596118:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596124:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596131:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596164:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596173:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596181:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596188:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596196:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596208:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596221:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596230:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596237:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596244:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596252:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596294:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596334:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596343:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596351:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596376:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596394:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596416:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596433:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596448:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596475:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596498:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596519:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596544:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596627:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596650:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596677:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596703:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596723:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596750:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596769:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596788:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596809:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596821:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596831:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596855:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596914:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596936:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596949:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596970:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.596987:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.597008:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.597031:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.597057:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.597076:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.597094:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708723.597139:0:21471:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789708723.654599:0:21471:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789708737.169954:0:22235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789708755.476785:0:22836:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789708755.476790:0:22836:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789708755.476792:0:22836:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789708755.476905:0:22836:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bed0343c000 00000020:01000004:3.0:1789708755.476920:0:22836:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789708755.476927:0:22836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789708755.476941:0:22836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bed04203380) 00000020:00000080:3.0:1789708755.476953:0:22836:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789708755.534035:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789708755.535884:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789708755.537068:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789708755.538812:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789708755.539211:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789708755.539517:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1789708755.539742:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789708755.539983:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1789708755.540188:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789708755.540399:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1789708755.541904:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789708755.543930:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789708755.544238:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1789708755.544676:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1789708755.545155:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789708755.549427:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789708755.551157:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789708755.553726:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789708755.554189:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789708755.555355:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789708755.556035:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789708755.561016:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789708755.561878:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789708755.563861:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789708755.564506:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789708755.565060:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1789708755.565323:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789708755.565778:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789708755.566234:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789708755.566719:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789708755.566938:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789708755.567139:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1789708755.568779:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1789708755.569214:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789708755.569637:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789708755.569954:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1789708755.570207:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789708755.570698:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789708755.570944:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789708755.571382:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1789708755.571814:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789708755.572032:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789708755.572230:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789708755.572802:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789708755.573707:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1789708755.573948:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789708755.575919:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1789708755.577927:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1789708755.578490:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789708755.579045:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1789708755.580649:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1789708755.580881:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1789708755.581063:0:22836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1789708755.583370:0:22836:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789708755.583889:0:22836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789708755.583897:0:22836:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789708755.583911:0:22836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47e98d 00000020:01000004:1.0:1789708755.583918:0:22836:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789708755.583924:0:22836:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789708755.583929:0:22836:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bed0343c000 from MGS 00000020:01000004:1.0:1789708755.583933:0:22836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789708755.583944:0:22836:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bee2f48b380) 00000020:00000080:1.0:1789708755.583953:0:22836:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789708755.584011:0:22836:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed0343c000 from MGS, refs=2 00080000:01000000:1.0:1789708755.584016:0:22836:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789708755.584020:0:22836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47e99b 00000100:00100000:1.0:1789708755.584118:0:22836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789708755.584244:0:22836:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789708755.584249:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789708755.588446:0:22836:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789708755.588460:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789708755.589748:0:22836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789708755.589928:0:22836:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789708755.589933:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789708755.595715:0:22836:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789708755.595735:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789708755.598477:0:22836:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789708755.598491:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789708755.600020:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708755.600024:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708755.600026:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708755.601025:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708755.601028:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708755.601030:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708755.601681:0:22836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789708755.603447:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789708755.610127:0:22836:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789708755.612164:0:22848:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789708755.612380:0:22836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789708755.612423:0:22836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789708755.613824:0:22836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789708755.614451:0:22836:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789708755.614730:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789708755.614736:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789708755.615199:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789708755.615207:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789708755.617423:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789708755.618348:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789708755.624731:0:22836:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789708755.624756:0:22836:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.152@tcp' 00000020:01000004:3.0:1789708755.624759:0:22836:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789708755.624798:0:22836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.152@tcp (typ=mgc) 00000020:00000080:3.0:1789708755.624812:0:22836:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.152@tcp (ffff9bed04200000) 00000020:00000080:3.0:1789708755.624827:0:22836:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789708755.624915:0:22836:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee22838800@MGC192.168.201.152@tcp: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789708755.625055:0:22836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.152@tcp-0 is initialized 00000040:01000000:3.0:1789708755.625067:0:22836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789708755.627165:0:22853:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789708755.638308:0:22855:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789708755.642708:0:22836:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.152@tcp (uuid 49ba98ed-5d0d-46d3-aa10-fc006dc67b25) 00000020:00000080:3.0:1789708755.642735:0:22836:0:(genops.c:1384:class_connect()) connect: client 49ba98ed-5d0d-46d3-aa10-fc006dc67b25, cookie 0xf45f43947e47e9a9 00000100:00080000:3.0:1789708755.642746:0:22836:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708755.642758:0:22836:0:(import.c:666:import_select_connection()) MGC192.168.201.152@tcp: import ffff9bee22838800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708755.642806:0:22836:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2ce680 x1876645365574144/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708755.642842:0:22836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 49ba98ed-5d0d-46d3-aa10-fc006dc67b25->MGS 00000020:01000004:3.0:1789708755.642864:0:22836:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789708755.642870:0:22836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789708755.642893:0:22836:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bed04204d40) 00000020:00000080:3.0:1789708755.642908:0:22836:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789708755.648109:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3614:1876645365574144:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789708755.648184:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708755.649394:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365574144 00000100:00100000:2.0:1789708755.649404:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365574144 00000100:00100000:2.0:1789708755.649445:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708755.649451:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee061a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3614:x1876645365574144:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789708755.649477:0:22849:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 49ba98ed-5d0d-46d3-aa10-fc006dc67b25@0@lo t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:2.0:1789708755.649503:0:22849:0:(genops.c:1384:class_connect()) connect: client 49ba98ed-5d0d-46d3-aa10-fc006dc67b25, cookie 0xf45f43947e47e9b7 00000100:00080000:2.0:1789708755.649634:0:22849:0:(import.c:65:import_set_state_nolock()) ffff9bee3da0c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708755.649699:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee061a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+5:3614:x1876645365574144:12345-0@lo:250:mount.lustre.0 Request processed in 246us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708755.649707:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708755.649749:0:3614:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789708755.649756:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.152@tcp: connect to target with instance 0 00000100:00080000:2.0:1789708755.649776:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789708755.649781:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789708755.649784:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee22838800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789708755.649787:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789708755.649794:0:3614:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789708755.649799:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3614:1876645365574144:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789708755.731617:0:22836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708755.731835:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789708755.731841:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789708755.743468:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789708755.743482:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789708755.744184:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789708755.744192:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789708755.751441:0:22836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708755.751636:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789708755.751645:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789708755.753172:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789708755.753182:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789708755.868078:0:22836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708755.868625:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789708755.868632:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789708755.879170:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789708755.879188:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789708755.882015:0:22836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708755.882198:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789708755.882204:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789708755.883604:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789708755.883615:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789708755.884478:0:22836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708755.884632:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789708755.884637:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789708755.885121:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789708755.885127:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789708755.886021:0:22836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708755.886153:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789708755.886158:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789708755.886819:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789708755.886825:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789708755.924996:0:22836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708755.925458:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789708755.925465:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789708755.927024:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789708755.927036:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789708755.928527:0:22836:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789708755.928535:0:22836:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789708755.930145:0:22836:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789708755.930473:0:22836:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789708755.930484:0:22836:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789708755.930625:0:22836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789708755.930656:0:22836:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789708755.930661:0:22836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789708755.930668:0:22836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708755.930669:0:22836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708755.930670:0:22836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708755.930672:0:22836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708755.930673:0:22836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708755.930674:0:22836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708755.930676:0:22836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708755.930680:0:22836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708755.930688:0:22836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789708755.930691:0:22836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789708755.930693:0:22836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789708755.930694:0:22836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708755.930695:0:22836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708755.930696:0:22836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708755.930697:0:22836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708755.930701:0:22836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708755.930702:0:22836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708755.930703:0:22836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708755.930704:0:22836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708755.930708:0:22836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789708755.930767:0:22836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789708755.930787:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574272:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789708755.930872:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708755.931065:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0910a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789708755.931151:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365574272 00000100:00100000:3.0:1789708755.931167:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365574272 00000100:00100000:0.0:1789708755.933631:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708755.933644:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+5:22836:x1876645365574272:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789708755.933714:0:22852:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789708755.933717:0:22852:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789708755.933721:0:22852:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789708755.934187:0:22873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789708755.943023:0:22852:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1789708755.944592:0:22874:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789708755.944597:0:22874:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789708755.944601:0:22874:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789708755.944603:0:22874:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789708755.944838:0:22874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789708755.945033:0:22852:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789708755.945042:0:22852:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789708755.946382:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+5:22836:x1876645365574272:12345-0@lo:253:mount.lustre.0 Request processed in 12735us (15504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708755.946394:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708755.946641:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789708755.946656:0:22836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789708755.946659:0:22836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708755.946661:0:22836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708755.946662:0:22836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708755.946663:0:22836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708755.946664:0:22836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708755.946666:0:22836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708755.946667:0:22836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708755.946668:0:22836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708755.946670:0:22836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708755.946671:0:22836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789708755.946698:0:22836:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bed0343c000 from lustre-MDT0000 10000000:01000000:0.0:1789708755.946729:0:22836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789708755.946732:0:22836:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789708755.946736:0:22836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bed04200000 10000000:01000000:0.0:1789708755.946739:0:22836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789708755.946748:0:22836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bed04200000 from 1 10000000:01000000:0.0:1789708755.946751:0:22836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789708755.946802:0:22836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708755.946812:0:22836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708755.946821:0:22836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708755.946840:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708755.946875:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708755.946949:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0910a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789708755.951064:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365574400 00000100:00100000:0.0:1789708755.951078:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365574400 00000100:00100000:0.0:1789708755.951135:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708755.951144:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+5:22836:x1876645365574400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708755.951159:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708755.951181:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee30492400/0xf45f43947e47e9c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e9be expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708755.951208:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee30492400/0xf45f43947e47e9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e9be expref: 6 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708755.951220:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee30492400/0xf45f43947e47e9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e9be expref: 6 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708755.951244:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30492400, rc 0) 00000100:00100000:0.0:1789708755.951341:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+6:22836:x1876645365574400:12345-0@lo:101:mount.lustre.0 Request processed in 196us (4464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708755.951348:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708755.951457:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708755.951474:0:22836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708755.951483:0:22836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708755.951698:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708755.951732:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708755.951778:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708755.951833:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365574528 00000100:00100000:2.0:1789708755.951838:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365574528 00000100:00100000:2.0:1789708755.951874:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708755.951881:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+6:22836:x1876645365574528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708755.951967:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+6:22836:x1876645365574528:12345-0@lo:501:mount.lustre.0 Request processed in 86us (234us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708755.951974:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708755.952044:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574528:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789708755.952078:0:22836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789708755.952101:0:22836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708755.952110:0:22836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708755.952117:0:22836:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bed0343c000 10000000:01000000:3.0:1789708755.952122:0:22836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789708755.952127:0:22836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bed0343c000 10000000:01000000:3.0:1789708755.952130:0:22836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789708755.952133:0:22836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bed0343c000 from 1 10000000:01000000:3.0:1789708755.952135:0:22836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789708755.952155:0:22836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e9cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708755.952172:0:22836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e9cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708755.952180:0:22836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e9cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708755.952192:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708755.952217:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708755.952228:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc673c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708755.952298:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365574656 00000100:00100000:2.0:1789708755.952303:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365574656 00000100:00100000:2.0:1789708755.952319:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708755.952324:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+6:22836:x1876645365574656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708755.952330:0:22849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708755.952341:0:22849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47e9d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e9cc expref: -99 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708755.952353:0:22849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47e9d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e9cc expref: 7 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708755.952361:0:22849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebcc00/0xf45f43947e47e9d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e9cc expref: 7 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708755.952378:0:22849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebcc00, rc 0) 00000100:00100000:2.0:1789708755.952418:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+7:22836:x1876645365574656:12345-0@lo:101:mount.lustre.0 Request processed in 92us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708755.952424:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708755.952488:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708755.952511:0:22836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e9cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9d3 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708755.952520:0:22836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e9cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e9d3 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708755.952531:0:22836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789708755.952545:0:22836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e9cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9d3 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708755.952560:0:22836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103aa00/0xf45f43947e47e9cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9d3 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708755.952565:0:22836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789708755.952569:0:22836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708755.952573:0:22836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bed0343c000 10000000:01000000:3.0:1789708755.952576:0:22836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789708755.952584:0:22836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789708755.952586:0:22836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789708755.952600:0:22836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103bc00/0xf45f43947e47e9da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708755.952607:0:22836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103bc00/0xf45f43947e47e9da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708755.952615:0:22836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103bc00/0xf45f43947e47e9da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708755.952626:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708755.952650:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708755.952665:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc673c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708755.952844:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365574784 00000100:00100000:1.0:1789708755.952849:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365574784 00000100:00100000:1.0:1789708755.952868:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708755.952874:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+7:22836:x1876645365574784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708755.952880:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708755.952889:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee029c9c00/0xf45f43947e47e9e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47e9da expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708755.952904:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c9c00/0xf45f43947e47e9e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47e9da expref: 8 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708755.952912:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee029c9c00/0xf45f43947e47e9e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47e9da expref: 8 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708755.952931:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9c00, rc 0) 00000100:00100000:1.0:1789708755.952959:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+8:22836:x1876645365574784:12345-0@lo:101:mount.lustre.0 Request processed in 85us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708755.952965:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708755.953318:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708755.953330:0:22836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103bc00/0xf45f43947e47e9da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9e1 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708755.953338:0:22836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103bc00/0xf45f43947e47e9da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47e9e1 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708755.953382:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708755.953406:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708755.953428:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc673c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708755.953734:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365574912 00000100:00100000:1.0:1789708755.953739:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365574912 00000100:00100000:1.0:1789708755.953778:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708755.953785:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+8:22836:x1876645365574912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708755.953906:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+9:22836:x1876645365574912:12345-0@lo:501:mount.lustre.0 Request processed in 121us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708755.953914:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708755.954011:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365574912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708755.954054:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365575040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708755.954095:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708755.954119:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0910a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708755.954409:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365575040 00000100:00100000:1.0:1789708755.954414:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365575040 00000100:00100000:1.0:1789708755.954445:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708755.954452:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+9:22836:x1876645365575040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708755.955233:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+9:22836:x1876645365575040:12345-0@lo:503:mount.lustre.0 Request processed in 779us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708755.955240:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708755.955350:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365575040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708755.957298:0:22875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22875:1876645365575168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708755.957357:0:22875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708755.957398:0:22875:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0910a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708755.957486:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365575168 00000100:00100000:3.0:1789708755.957493:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365575168 00000100:00100000:3.0:1789708755.957546:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708755.957563:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+9:22875:x1876645365575168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708755.958460:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+9:22875:x1876645365575168:12345-0@lo:502:llog_process_th.0 Request processed in 896us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708755.958475:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708755.958665:0:22875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22875:1876645365575168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789708755.958696:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708755.958708:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708755.958710:0:22875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789708755.958716:0:22875:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789708755.958719:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789708755.958733:0:22875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bed015cb380) 00000020:00000080:0.0:1789708755.958747:0:22875:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789708755.958752:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789708755.958858:0:22875:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789708755.958866:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47e9ef 00000020:00000080:0.0:1789708755.959067:0:22875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789708755.959072:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708755.959080:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708755.959082:0:22875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789708755.959086:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708755.959089:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708755.959091:0:22875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789708755.959094:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789708755.959102:0:22875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bed015c8000) 00000020:00000080:0.0:1789708755.959113:0:22875:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789708755.959117:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789708755.959119:0:22875:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789708755.959122:0:22875:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789708755.959128:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789708755.959181:0:22875:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed0343c000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789708755.959196:0:22875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bed015ccd40) 00000020:00000080:0.0:1789708755.959206:0:22875:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789708755.959252:0:22875:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789708755.959257:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ea04 00000020:00000080:0.0:1789708755.959425:0:22875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789708755.959431:0:22875:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789708755.959436:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf45f43947e47ea0b 00080000:01000000:0.0:1789708755.959441:0:22875:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789708755.959444:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47ea12 00010000:00010000:2.0:1789708756.039441:0:22875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789708756.040079:0:22875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934675 00000001:00080000:2.0:1789708756.040403:0:22875:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789708756.040892:0:22875:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bee3dd78000) 00000020:00000080:2.0:1789708756.040912:0:22875:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789708756.040983:0:22875:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789708756.040991:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47ea20 00000020:00000080:2.0:1789708756.042452:0:22875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789708756.050421:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf45f43947e47ea27 00000020:00000080:1.0:1789708756.052103:0:22875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789708756.052115:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708756.052122:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708756.052124:0:22875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789708756.052127:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789708756.052130:0:22875:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1789708756.052131:0:22875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708756.052133:0:22875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708756.052134:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789708756.052143:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708756.052145:0:22875:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789708756.052147:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708756.052151:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708756.052153:0:22875:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789708756.052157:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789708756.052205:0:22875:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789708756.052226:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708756.052228:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708756.052229:0:22875:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789708756.052231:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708756.052234:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708756.052236:0:22875:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789708756.052238:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789708756.052243:0:22875:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:00000080:1.0:1789708756.052294:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708756.052314:0:22875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9bee2f48cd40) 00000020:00000080:1.0:1789708756.052329:0:22875:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789708756.052333:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789708756.052388:0:22875:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789708756.052395:0:22875:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789708756.052401:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47ea35 00010000:00080000:1.0:1789708756.052434:0:22875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee30744000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1789708756.056622:0:22875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789708756.059035:0:22875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708756.059050:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789708756.059084:0:22875:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789708756.059106:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ea3c 00000100:00080000:1.0:1789708756.059116:0:22875:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708756.059126:0:22875:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee30744000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708756.059198:0:22875:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed098d7b80 x1876645365575296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708756.059240:0:22875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789708756.059338:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708756.059343:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708756.059344:0:22875:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789708756.059347:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789708756.059350:0:22875:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789708756.059352:0:22875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708756.059354:0:22875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708756.059355:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789708756.059357:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708756.059358:0:22875:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789708756.059361:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789708756.059365:0:22875:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789708756.059368:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708756.059369:0:22875:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789708756.059372:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789708756.059375:0:22875:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:1.0:1789708756.059398:0:22875:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789708756.059400:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708756.059412:0:22875:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bee2f4899c0) 00000020:00000080:1.0:1789708756.059426:0:22875:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789708756.059431:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789708756.059497:0:22875:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789708756.059502:0:22875:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789708756.059508:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47ea4a 00010000:00080000:1.0:1789708756.059537:0:22875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed0aa71000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789708756.059719:0:22875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1789708756.059816:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365575296:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789708756.059877:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708756.060825:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365575296 00000100:00100000:0.0:1789708756.060834:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365575296 00000100:00100000:0.0:1789708756.061859:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708756.061870:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365575296:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789708756.061890:0:22862:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1789708756.074352:0:22875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789708756.080097:0:22875:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789708756.098892:0:22875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708756.101729:0:22875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:0.0:1789708756.102239:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365575296:12345-0@lo:38:llog_process_th.0 Request processed in 40362us (42354us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789708756.102253:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789708756.107880:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708756.107892:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708756.107897:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365575296:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789708756.186005:0:22875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1789708756.194643:0:22881:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789708756.194651:0:22881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789708756.198192:0:22875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789708756.198225:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789708756.198651:0:22875:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789708756.198696:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ea51 00000100:00080000:0.0:1789708756.198722:0:22875:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708756.198737:0:22875:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bed0aa71000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708756.198824:0:22875:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622ea00 x1876645365575424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789708756.198955:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365575424:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789708756.199046:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365575424 offset 0 length 520: 4 00000100:00080000:0.0:1789708756.199108:0:22875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789708756.199195:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708756.199201:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708756.199203:0:22875:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789708756.199207:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789708756.199211:0:22875:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1789708756.199213:0:22875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708756.199215:0:22875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708756.199218:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789708756.199221:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708756.199223:0:22875:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789708756.199226:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789708756.199230:0:22875:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789708756.199234:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708756.199235:0:22875:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789708756.199238:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789708756.199242:0:22875:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:0.0:1789708756.199291:0:22875:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789708756.199294:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789708756.199310:0:22875:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bed015c99c0) 00000020:00000080:0.0:1789708756.199324:0:22875:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789708756.199328:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789708756.199418:0:22875:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789708756.199425:0:22875:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789708756.199432:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45f43947e47ea5f 00010000:00080000:0.0:1789708756.199475:0:22875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed08562000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1789708756.199727:0:22875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000100:00080000:1.0:1789708756.201948:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789708756.201955:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789708756.201959:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708756.201968:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 326 00000100:00080000:1.0:1789708756.201975:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789708756.201987:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee30744000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708756.202011:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed098d4700 x1876645365575680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789708756.202148:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365575552:0@lo:400:kworker.0 00000100:00100000:2.0:1789708756.202243:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708756.202365:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365575552 00000100:00100000:2.0:1789708756.202374:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365575552 00000100:00100000:2.0:1789708756.202424:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789708756.202433:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+9:3617:x1876645365575552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708756.202487:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+9:3617:x1876645365575552:12345-0@lo:400:kworker.0 Request processed in 54us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708756.202503:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789708756.202565:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365575552:0@lo:400:kworker.0 00000040:01000000:0.0:1789708756.202786:0:22875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789708756.202807:0:22875:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1789708756.203647:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365575680:0@lo:38:kworker.0 00000100:00100000:2.0:1789708756.203786:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708756.204317:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365575680 00000100:00100000:1.0:1789708756.204328:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365575680 00000100:00100000:1.0:1789708756.204392:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708756.204400:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365575680:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789708756.204431:0:22863:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789708756.204538:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365575680:12345-0@lo:38:kworker.0 Request processed in 136us (751us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789708756.204577:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789708756.204856:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708756.204862:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708756.204867:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365575680:0@lo:38:kworker.0 00000040:00080000:1.0:1789708756.206008:0:22875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708756.206337:0:22875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789708756.206631:0:22875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1789708756.207177:0:22883:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789708756.207182:0:22883:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789708756.207991:0:22875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789708756.208004:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789708756.208038:0:22875:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789708756.208057:0:22875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ea66 00000100:00080000:0.0:1789708756.208066:0:22875:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708756.208077:0:22875:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bed08562000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708756.208110:0:22875:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622c000 x1876645365575808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708756.208140:0:22875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789708756.208250:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708756.208254:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708756.208256:0:22875:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789708756.208278:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708756.208283:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708756.208285:0:22875:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789708756.208288:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789708756.208289:0:22875:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789708756.208292:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708756.208294:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708756.208295:0:22875:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789708756.208297:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708756.208300:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708756.208301:0:22875:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789708756.208304:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789708756.208342:0:22875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22875:1876645365575936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708756.208422:0:22875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708756.208513:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365575808:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789708756.208544:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365575808 offset 0 length 520: 4 00000100:00100000:0.0:1789708756.208673:0:22875:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f00cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708756.212929:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365575936 00000100:00100000:0.0:1789708756.212944:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365575936 00000100:00100000:0.0:1789708756.213072:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708756.213083:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+9:22875:x1876645365575936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708756.213311:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+9:22875:x1876645365575936:12345-0@lo:502:llog_process_th.0 Request processed in 230us (4888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708756.213320:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708756.213413:0:22875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22875:1876645365575936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789708756.213459:0:22875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708756.213467:0:22875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708756.213469:0:22875:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789708756.213474:0:22875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789708756.213680:0:22836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789708756.213712:0:22836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789708756.213738:0:22836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103bc00/0xf45f43947e47e9da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9e1 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.213751:0:22836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103bc00/0xf45f43947e47e9da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9e1 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708756.213769:0:22836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bed0343c000 from 1 10000000:01000000:3.0:1789708756.213772:0:22836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708756.213803:0:22836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.213811:0:22836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.213821:0:22836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708756.213840:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708756.213885:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708756.223992:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708756.225313:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365576064 00000100:00100000:2.0:1789708756.225325:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365576064 00000100:00100000:0.0:1789708756.225456:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708756.225469:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+9:22836:x1876645365576064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708756.225487:0:22849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708756.225744:0:22849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee30493c00/0xf45f43947e47ea74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ea6d expref: -99 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708756.225785:0:22849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee30493c00/0xf45f43947e47ea74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ea6d expref: 10 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708756.225796:0:22849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee30493c00/0xf45f43947e47ea74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ea6d expref: 10 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708756.225805:0:22849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30493c00, rc 0) 00000100:00100000:0.0:1789708756.225878:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+10:22836:x1876645365576064:12345-0@lo:101:mount.lustre.0 Request processed in 412us (11992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708756.225885:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789708756.226038:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708756.226067:0:22836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.226076:0:22836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708756.226681:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576192:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789708756.226735:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708756.226780:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923780 going to sleep for 11 seconds 00000100:00100000:1.0:1789708756.228858:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365576192 00000100:00100000:1.0:1789708756.228872:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365576192 00000100:00100000:1.0:1789708756.228920:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708756.228942:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+10:22836:x1876645365576192:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789708756.228966:0:22851:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789708756.228972:0:22851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789708756.229091:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+10:22836:x1876645365576192:12345-0@lo:256:mount.lustre.0 Request processed in 151us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708756.229100:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789708756.229348:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576192:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789708756.230258:0:22836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708756.230297:0:22836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.230310:0:22836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708756.230318:0:22836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed0343c000 from 1 10000000:01000000:3.0:1789708756.230321:0:22836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708756.230356:0:22836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.230363:0:22836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.230372:0:22836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708756.230390:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708756.230637:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708756.230658:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923780 going to sleep for 11 seconds 00000100:00100000:1.0:1789708756.230813:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365576320 00000100:00100000:1.0:1789708756.230820:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365576320 00000100:00100000:1.0:1789708756.230854:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708756.230861:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+10:22836:x1876645365576320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708756.230873:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708756.230885:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ea82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ea7b expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708756.230904:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ea82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ea7b expref: 11 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708756.230914:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ea82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ea7b expref: 11 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708756.230922:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8600, rc 0) 00000100:00100000:1.0:1789708756.230969:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22836:x1876645365576320:12345-0@lo:101:mount.lustre.0 Request processed in 107us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708756.230976:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708756.231357:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708756.231371:0:22836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.231379:0:22836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708756.231569:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708756.231600:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708756.231653:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708756.232950:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365576448 00000100:00100000:2.0:1789708756.232961:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365576448 00000100:00100000:2.0:1789708756.232999:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708756.233008:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22836:x1876645365576448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708756.233164:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22836:x1876645365576448:12345-0@lo:501:mount.lustre.0 Request processed in 156us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708756.233172:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708756.233312:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708756.233365:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708756.233413:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708756.233450:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708756.233590:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365576576 00000100:00100000:2.0:1789708756.233595:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365576576 00000100:00100000:2.0:1789708756.233612:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708756.233618:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22836:x1876645365576576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708756.233725:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22836:x1876645365576576:12345-0@lo:503:mount.lustre.0 Request processed in 107us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708756.233733:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708756.234841:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708756.235359:0:22885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22885:1876645365576704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708756.235432:0:22885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708756.235469:0:22885:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20cf0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708756.235716:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365576704 00000100:00100000:3.0:1789708756.235723:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365576704 00000100:00100000:3.0:1789708756.235764:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708756.235773:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22885:x1876645365576704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708756.236685:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22885:x1876645365576704:12345-0@lo:502:llog_process_th.0 Request processed in 911us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708756.236693:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708756.236829:0:22885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22885:1876645365576704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708756.236861:0:22885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708756.236871:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708756.236873:0:22885:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789708756.236881:0:22885:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bed0343c000 00000020:00000080:2.0:1789708756.236884:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708756.236892:0:22885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708756.236896:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708756.236897:0:22885:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789708756.236899:0:22885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708756.236902:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708756.236903:0:22885:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789708756.236907:0:22885:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bed0343c000 00000020:00000080:2.0:1789708756.236909:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708756.236970:0:22885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708756.236974:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708756.236975:0:22885:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789708756.236978:0:22885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708756.236981:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708756.236982:0:22885:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708756.236986:0:22885:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bed0343c000 00000020:00000080:2.0:1789708756.236988:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708756.237004:0:22885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708756.237007:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708756.237015:0:22885:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708756.237018:0:22885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708756.237020:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708756.237021:0:22885:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789708756.237025:0:22885:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bed0343c000 00000020:00000080:2.0:1789708756.237027:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789708756.237067:0:22885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22885:1876645365576832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708756.237114:0:22885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708756.237187:0:22885:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20cf0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789708756.246819:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365576832 00000100:00100000:0.0:1789708756.246834:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365576832 00000100:00100000:0.0:1789708756.246896:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708756.246906:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22885:x1876645365576832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708756.247084:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22885:x1876645365576832:12345-0@lo:502:llog_process_th.0 Request processed in 178us (9967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708756.247092:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708756.247155:0:22885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22885:1876645365576832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789708756.247188:0:22885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708756.247196:0:22885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708756.247198:0:22885:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789708756.247202:0:22885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789708756.247801:0:22836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789708756.247838:0:22836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708756.247867:0:22836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.247880:0:22836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708756.247932:0:22836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789708756.247936:0:22836:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bed0343c000 10000000:01000000:3.0:1789708756.247940:0:22836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bed0343c000 10000000:01000000:3.0:1789708756.247943:0:22836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708756.247949:0:22836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bed0343c000 from 1 10000000:01000000:3.0:1789708756.247952:0:22836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789708756.247981:0:22836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103be00/0xf45f43947e47ea89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.247990:0:22836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103be00/0xf45f43947e47ea89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.247998:0:22836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103be00/0xf45f43947e47ea89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708756.248019:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708756.248063:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708756.248092:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708756.248593:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365576960 00000100:00100000:0.0:1789708756.248599:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365576960 00000100:00100000:0.0:1789708756.248629:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708756.248636:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22836:x1876645365576960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708756.248646:0:22849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708756.248657:0:22849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee30493800/0xf45f43947e47ea90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ea89 expref: -99 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708756.248677:0:22849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee30493800/0xf45f43947e47ea90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ea89 expref: 12 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708756.248687:0:22849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee30493800/0xf45f43947e47ea90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ea89 expref: 12 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708756.248695:0:22849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30493800, rc 0) 00000100:00100000:0.0:1789708756.248734:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22836:x1876645365576960:12345-0@lo:101:mount.lustre.0 Request processed in 98us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708756.248740:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708756.250724:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365576960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708756.250744:0:22836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103be00/0xf45f43947e47ea89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ea90 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.251787:0:22836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103be00/0xf45f43947e47ea89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ea90 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708756.251894:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365577088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708756.251949:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708756.252663:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708756.252833:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365577088 00000100:00100000:0.0:1789708756.252841:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365577088 00000100:00100000:0.0:1789708756.252892:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708756.252901:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22836:x1876645365577088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708756.253034:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22836:x1876645365577088:12345-0@lo:501:mount.lustre.0 Request processed in 135us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708756.253042:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789708756.253399:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365577088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708756.253798:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365577216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708756.253845:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708756.253876:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708756.255042:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365577216 00000100:00100000:1.0:1789708756.255050:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365577216 00000100:00100000:1.0:1789708756.255105:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789708756.255113:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22836:x1876645365577216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708756.255250:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22836:x1876645365577216:12345-0@lo:503:mount.lustre.0 Request processed in 137us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708756.255275:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789708756.256846:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365577216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708756.258984:0:22888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22888:1876645365577344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708756.259077:0:22888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708756.259117:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365577344 00000100:00100000:1.0:1789708756.259123:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365577344 00000100:00100000:1.0:1789708756.259165:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708756.259173:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22888:x1876645365577344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708756.259328:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22888:x1876645365577344:12345-0@lo:502:llog_process_th.0 Request processed in 154us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708756.259336:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708756.259386:0:22888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee18004600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708756.259406:0:22888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22888:1876645365577344:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789708756.262599:0:22888:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789708756.262617:0:22888:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bee2f488000) 00000020:00000080:1.0:1789708756.262638:0:22888:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789708756.262732:0:22888:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bed0343c000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789708756.262736:0:22888:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bed0343c000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789708756.262739:0:22888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bed0343c000 4 00010000:00080000:1.0:1789708756.263376:0:22888:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed0a807800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789708756.268671:0:22888:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789708756.278987:0:22888:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789708756.279042:0:22888:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789708756.279056:0:22888:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf45f43947e47ea9e 00000100:00080000:1.0:1789708756.279065:0:22888:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708756.279086:0:22888:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bed0a807800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708756.279122:0:22888:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed098d4700 x1876645365577472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708756.279148:0:22888:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789708756.281941:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365577472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789708756.282021:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708756.287351:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365577472 00000100:00100000:0.0:1789708756.287364:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365577472 00000100:00100000:0.0:1789708756.287412:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708756.287433:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365577472:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789708756.287631:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365577472:12345-0@lo:38:llog_process_th.0 Request processed in 198us (5609us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789708756.287639:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708756.287695:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708756.287703:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0a807800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708756.287707:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789708756.287711:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365577472:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789708756.290743:0:22888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22888:1876645365577600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708756.290839:0:22888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708756.290878:0:22888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708756.291631:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365577600 00000100:00100000:0.0:1789708756.291639:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365577600 00000100:00100000:0.0:1789708756.291685:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708756.291694:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22888:x1876645365577600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708756.292189:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22888:x1876645365577600:12345-0@lo:502:llog_process_th.0 Request processed in 495us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708756.292198:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708756.293349:0:22888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22888:1876645365577600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708756.293410:0:22888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22888:1876645365577728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708756.293628:0:22888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708756.293976:0:22888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04eea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708756.294628:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365577728 00000100:00100000:3.0:1789708756.294636:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365577728 00000100:00100000:3.0:1789708756.294722:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708756.294732:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22888:x1876645365577728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708756.294867:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22888:x1876645365577728:12345-0@lo:502:llog_process_th.0 Request processed in 137us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708756.294875:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789708756.294958:0:22888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22888:1876645365577728:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789708756.294982:0:22888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789708756.295175:0:22836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789708756.295205:0:22836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708756.295225:0:22836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103be00/0xf45f43947e47ea89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ea90 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708756.295237:0:22836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103be00/0xf45f43947e47ea89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ea90 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789708756.295314:0:22836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789708756.295316:0:22836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708756.295318:0:22836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708756.295319:0:22836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708756.295320:0:22836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708756.295321:0:22836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708756.295323:0:22836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708756.295324:0:22836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708756.295326:0:22836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708756.295327:0:22836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789708756.295332:0:22836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789708756.295334:0:22836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789708756.295335:0:22836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708756.295336:0:22836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708756.295338:0:22836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708756.295339:0:22836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708756.295340:0:22836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708756.295341:0:22836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708756.295342:0:22836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708756.295343:0:22836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708756.295344:0:22836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789708756.295367:0:22836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789708756.295379:0:22836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365577856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789708756.295433:0:22836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708756.301840:0:22836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0910a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789708756.309621:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365577856 00000100:00100000:1.0:1789708756.309635:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365577856 00000100:00100000:1.0:1789708756.309683:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789708756.309692:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22836:x1876645365577856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789708756.309722:0:22849:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789708756.309735:0:22849:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789708756.313937:0:22849:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789708756.313954:0:22849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789708756.313969:0:22873:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789708756.313973:0:22873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789708756.313995:0:22873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708756.314014:0:22873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee30493c00/0xf45f43947e47ea74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ea6d expref: 12 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708756.314025:0:22873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708756.314060:0:22873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee30493c00/0xf45f43947e47ea74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ea6d expref: 12 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708756.314074:0:22873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee30493c00/0xf45f43947e47ea74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ea6d expref: 12 pid: 22849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708756.314095:0:22873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365577984:0@lo:104: 00000100:00100000:1.0:1789708756.314153:0:22873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708756.314193:0:22873:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708756.317345:0:22840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365577984 00000100:00100000:3.0:1789708756.317358:0:22840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365577984 00000100:00100000:3.0:1789708756.317404:0:22840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708756.317413:0:22840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:22873:x1876645365577984:12345-0@lo:104: 00010000:00010000:3.0:1789708756.317443:0:22840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.317528:0:22840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789708756.317534:0:22840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:22873:x1876645365577984:12345-0@lo:104: Request processed in 123us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708756.317550:0:22840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789708756.317590:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708756.317596:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.317605:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b400 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708756.317610:0:22846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.317619:0:22846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708756.317625:0:22846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708756.317631:0:22846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708756.317666:0:22846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.317673:0:22846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708756.317691:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.317698:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47ea6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ea74 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.317713:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708756.317715:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708756.317717:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708756.318366:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22836:x1876645365577856:12345-0@lo:253:mount.lustre.0 Request processed in 8673us (22931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708756.318376:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789708756.318435:0:22836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22836:1876645365577856:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789708756.318456:0:22836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789708756.318459:0:22836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708756.318461:0:22836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708756.318463:0:22836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708756.318464:0:22836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708756.318465:0:22836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708756.318466:0:22836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708756.318468:0:22836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708756.318469:0:22836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708756.318471:0:22836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708756.318472:0:22836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789708756.318497:0:22836:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789708756.320849:0:22873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365577984:0@lo:104: 00010000:00010000:1.0:1789708756.320874:0:22873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708756.321321:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365578112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789708756.321384:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708756.321469:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365578112 00000100:00100000:3.0:1789708756.321476:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365578112 00010000:00010000:3.0:1789708756.321502:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee30493c00/0xf45f43947e47ea74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ea6d expref: 12 pid: 22849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708756.321531:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708756.321539:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:3618:x1876645365578112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708756.321551:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708756.321557:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee30493c00/0xf45f43947e47ea74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ea6d expref: 12 pid: 22849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321568:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee30493c00/0xf45f43947e47ea74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ea6d expref: 12 pid: 22849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321584:0:22842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee30493c00/0xf45f43947e47ea74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ea6d expref: 12 pid: 22849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321598:0:22842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321607:0:22842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789708756.321620:0:22842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007648230s 00010000:00010000:3.0:1789708756.321625:0:22842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321632:0:22842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321647:0:22842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321654:0:22842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321660:0:22842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708756.321664:0:22842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321673:0:22842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321694:0:22842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708756.321699:0:22873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708756.321703:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708756.321706:0:22873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708756.321712:0:22873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee029c9200/0xf45f43947e47eaa5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708756.321733:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:3618:x1876645365578112:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708756.321741:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708756.321846:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365578112:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789708756.349396:0:22836:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967514 00000040:01000000:2.0:1789708756.349846:0:22836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789708756.352374:0:22898:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789708756.352497:0:22836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789708756.357003:0:22898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1789708756.359848:0:22897:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967514 00000020:00080000:3.0:1789708756.359859:0:22897:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967514 00000100:00080000:0.0:1789708756.363581:0:22899:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9bee3622e680 x1876645365578240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708756.363594:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00000040:01000000:2.0:1789708756.363966:0:22836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789708756.364016:0:22836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708756.365007:0:22898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789708756.365079:0:22898:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:2.0:1789708756.365745:0:22836:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789708756.365764:0:22836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789708756.365831:0:22836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708756.367906:0:22836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789708756.369554:0:22836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789708756.369609:0:22836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789708756.373779:0:22836:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1789708756.374366:0:22836:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1789708756.380390:0:22836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1789708756.381970:0:22836:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789708756.382005:0:22836:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbde281943988 00100000:10000000:2.0:1789708756.382013:0:22836:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789708756.383338:0:22836:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789708756.383357:0:22836:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789708756.383385:0:22836:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789708756.383409:0:22836:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789708756.384208:0:22836:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708756.384444:0:22836:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789708756.652585:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789708757.350950:0:22893:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789708757.350960:0:22893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 10000000:01000000:2.0:1789708757.352649:0:22855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789708757.352655:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bed0343c000 from 11 10000000:01000000:2.0:1789708757.352660:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789708757.352706:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708757.352718:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708757.352730:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708757.352767:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365578368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708757.352843:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708757.352884:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708757.352905:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365578368 00000100:00100000:2.0:1789708757.352912:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365578368 00000100:00100000:2.0:1789708757.352956:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789708757.352964:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+11:22855:x1876645365578368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708757.352979:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708757.352991:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47eab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47eaac expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708757.353013:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47eab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47eaac expref: 12 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708757.353035:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47eab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eaac expref: 12 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708757.353045:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd600, rc 0) 00000100:00100000:2.0:1789708757.353083:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22855:x1876645365578368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708757.353090:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789708757.353137:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365578368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708757.353151:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708757.353160:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708757.353206:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365578496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789708757.353238:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708757.353252:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708757.353282:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365578496 00000100:00100000:2.0:1789708757.353286:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365578496 00000100:00100000:2.0:1789708757.353309:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708757.353315:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22855:x1876645365578496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789708757.353326:0:22849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789708757.353342:0:22849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789708757.353345:0:22849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789708757.353417:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:22855:x1876645365578496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708757.353431:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708757.353462:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365578496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789708757.353882:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789708757.353890:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708757.353899:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789708757.377104:0:22893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1789708757.377129:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789708757.415836:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:3.0:1789708757.671354:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708758.438452:0:22893:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789708758.438464:0:22893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708758.438619:0:22893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 1 00000040:00080000:1.0:1789708758.438662:0:22893:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708758.438821:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1789708758.439620:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:1.0:1789708758.701239:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708759.469497:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:3.0:1789708759.718738:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708760.486481:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:1.0:1789708760.842531:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708761.463131:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789708761.463139:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789708761.463143:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708761.463151:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 327 00000100:00080000:0.0:1789708761.463156:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789708761.463167:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee30744000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708761.463190:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622e300 x1876645365578752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708761.463207:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708761.463210:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789708761.463213:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708761.463223:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789708761.463226:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789708761.463228:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789708761.463230:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bed0a807800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708761.463237:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bed0a807800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708761.463250:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622d180 x1876645365578880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708761.463312:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708761.463326:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365578624:0@lo:400:kworker.0 00000100:00100000:0.0:1789708761.463430:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708761.463495:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365578752:0@lo:38:kworker.0 00000100:00100000:0.0:1789708761.463552:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708761.463570:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365578880:0@lo:38:kworker.0 00000100:00100000:0.0:1789708761.463592:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708761.463625:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365578624 00000100:00100000:0.0:1789708761.463632:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365578624 00000100:00100000:0.0:1789708761.463688:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708761.463698:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:3616:x1876645365578624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708761.463748:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:3616:x1876645365578624:12345-0@lo:400:kworker.0 Request processed in 51us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708761.463755:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708761.463788:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365578752 00000100:00100000:0.0:1789708761.463792:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365578752 00000100:00100000:0.0:1789708761.463824:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708761.463829:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365578752:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789708761.463849:0:22863:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789708761.464819:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365578880 00000100:00100000:2.0:1789708761.464825:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365578880 00000100:00100000:2.0:1789708761.464846:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708761.464851:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876645365578880:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789708761.464868:0:22859:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:2.0:1789708761.464897:0:22859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf45f43947e47eaba 00000004:00100000:2.0:1789708761.464910:0:22859:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789708761.465030:0:22859:0:(import.c:65:import_set_state_nolock()) ffff9bed0a040000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708761.465076:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876645365578880:12345-0@lo:38:kworker.0 Request processed in 224us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708761.465084:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708761.465812:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365578624:0@lo:400:kworker.0 00000100:00100000:0.0:1789708761.496352:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365578752:12345-0@lo:38:kworker.0 Request processed in 32514us (32792us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789708761.496367:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789708761.496639:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708761.496645:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789708761.496649:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365578752:0@lo:38:kworker.0 00010000:00080000:0.0:1789708761.496681:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bee3622d180 x1876645365578880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708761.496697:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789708761.496705:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789708761.496710:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789708761.496713:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0a807800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789708761.496719:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876645365578880:0@lo:38:kworker.0 00000100:00100000:3.0:1789708761.513125:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:3.0:1789708761.894354:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708762.504786:0:23142:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789708762.539129:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:1.0:1789708762.920316:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708763.561664:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00000020:00000004:1.0:1789708763.603765:0:23195:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708763.603986:0:23195:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789708763.943055:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708764.589692:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:1.0:1789708764.970865:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789708765.026224:0:23245:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708765.026473:0:23245:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789708765.606730:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:0.0:1789708765.990822:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708766.571951:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789708766.571959:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789708766.571963:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708766.571970:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 332 00000100:00080000:0.0:1789708766.571977:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789708766.571989:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee30744000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708766.572010:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622e300 x1876645365579136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708766.572037:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708766.572040:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789708766.572043:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708766.572047:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789708766.572091:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365579008:0@lo:400:kworker.0 00000100:00100000:0.0:1789708766.572158:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708766.572213:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365579264:0@lo:400:kworker.0 00000100:00100000:0.0:1789708766.572237:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708766.572296:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365579008 00000100:00100000:0.0:1789708766.572307:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365579008 00000100:00100000:0.0:1789708766.573959:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789708766.573971:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:3616:x1876645365579008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708766.574033:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:3616:x1876645365579008:12345-0@lo:400:kworker.0 Request processed in 65us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708766.574041:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789708766.574082:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365579264 00000100:00100000:0.0:1789708766.574087:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365579264 00000100:00100000:0.0:1789708766.574110:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708766.574115:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365579264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708766.574148:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365579264:12345-0@lo:400:kworker.0 Request processed in 32us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708766.574154:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789708766.574193:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bee3622c380 x1876645365579264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708766.574223:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365579264:0@lo:400:kworker.0 00000100:00100000:0.0:1789708766.574250:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365579008:0@lo:400:kworker.0 00000100:00100000:3.0:1789708766.575579:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708756/real 1789708756] req@ffff9bee3622c000 x1876645365575808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708766.576754:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3622c000 x1876645365575808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708766.576769:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708756/real 1789708756] req@ffff9bee3622ea00 x1876645365575424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708766.576786:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3622ea00 x1876645365575424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708766.576802:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365579136:0@lo:38:kworker.0 00000100:00100000:3.0:1789708766.576855:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789708766.576880:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708766.576893:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789708766.576897:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365575808:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789708766.576902:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa71000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708766.576907:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789708766.576910:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365575424:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789708766.576943:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365579136 00000100:00100000:3.0:1789708766.576953:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365579136 00000100:00100000:3.0:1789708766.576983:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708766.576989:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365579136:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789708766.577005:0:22862:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789708766.581487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708766.581497:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789708766.581501:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa71000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708766.581508:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 327 00000100:00080000:2.0:1789708766.581514:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789708766.581524:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bed0aa71000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708766.581576:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fac2300 x1876645365579392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708766.581603:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708766.581607:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789708766.581608:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708766.581611:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 327 00000100:00080000:2.0:1789708766.581614:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789708766.581628:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bed08562000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708766.581642:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fac1180 x1876645365579520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708766.594424:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365579392:0@lo:8:kworker.0 00000400:00000100:0.0:1789708766.594489:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365579392 offset 0 length 520: 4 00000100:00100000:0.0:1789708766.594530:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365579520:0@lo:8:kworker.0 00000400:00000100:0.0:1789708766.594551:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365579520 offset 0 length 520: 4 00000100:00100000:3.0:1789708766.604052:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876645365579136:12345-0@lo:38:kworker.0 Request processed in 27051us (27186us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789708766.604068:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789708766.604500:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708766.604506:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789708766.604511:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365579136:0@lo:38:kworker.0 00000100:00100000:3.0:1789708766.631789:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:0.0:1789708767.020390:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708767.655011:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:0.0:1789708768.047703:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708769.977349:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:0.0:1789708769.977635:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708769.979089:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789708770.982318:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:0.0:1789708770.983462:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708771.695447:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789708771.695455:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789708771.695459:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708771.695477:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 337 00000100:00080000:0.0:1789708771.695482:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789708771.695492:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee30744000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708771.695517:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622d180 x1876645365579776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708771.695546:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708771.695549:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789708771.695551:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708771.695554:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789708771.695590:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365579776:0@lo:38:kworker.0 00000100:00100000:0.0:1789708771.695655:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708771.695710:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365579904:0@lo:400:kworker.0 00000100:00100000:0.0:1789708771.695738:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708771.695771:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365579776 00000100:00100000:0.0:1789708771.695777:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365579776 00000100:00100000:0.0:1789708771.695806:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708771.695813:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365579776:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789708771.695828:0:22863:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789708771.695866:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365579776:12345-0@lo:38:kworker.0 Request processed in 51us (211us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789708771.695873:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789708771.695910:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708771.695915:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789708771.695919:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365579776:0@lo:38:kworker.0 00000100:00100000:3.0:1789708771.695972:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365579648:0@lo:400:kworker.0 00000100:00100000:3.0:1789708771.696013:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708771.696288:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365579904 00000100:00100000:1.0:1789708771.696293:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365579904 00000100:00100000:1.0:1789708771.696330:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708771.696338:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365579904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708771.696386:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365579904:12345-0@lo:400:kworker.0 Request processed in 49us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708771.696392:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789708771.696424:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bee3622c380 x1876645365579904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708771.696435:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365579904:0@lo:400:kworker.0 00000100:00100000:0.0:1789708771.699184:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365579648 00000100:00100000:0.0:1789708771.699193:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365579648 00000100:00100000:0.0:1789708771.699240:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789708771.699249:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:3618:x1876645365579648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708771.699345:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:3618:x1876645365579648:12345-0@lo:400:kworker.0 Request processed in 97us (3330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708771.699351:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789708771.699396:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365579648:0@lo:400:kworker.0 00010000:00010000:3.0:1789708772.009663:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708772.010747:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00000100:00100000:1.0:1789708773.032135:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:0.0:1789708773.032287:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708774.055026:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708774.055365:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00000100:00100000:2.0:1789708775.082728:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:0.0:1789708775.091586:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708776.102829:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708776.103308:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00000100:00080000:3.0:1789708776.806731:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789708776.806739:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789708776.806743:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708776.806751:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 342 00000100:00080000:3.0:1789708776.806755:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789708776.806767:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee30744000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708776.806791:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cdc00 x1876645365580160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708776.806871:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708776.806876:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708776.806879:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708776.806890:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789708776.807238:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708776.807253:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365580032:0@lo:400:kworker.0 00000100:00100000:1.0:1789708776.807337:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708776.807400:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365580160:0@lo:38:kworker.0 00000100:00100000:1.0:1789708776.807434:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708776.807542:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708776.807552:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365580288:0@lo:400:kworker.0 00000100:00100000:0.0:1789708776.807582:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708776.807624:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365580032 00000100:00100000:0.0:1789708776.807630:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365580032 00000100:00100000:0.0:1789708776.808795:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789708776.808806:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:3615:x1876645365580032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708776.809312:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:3615:x1876645365580032:12345-0@lo:400:kworker.0 Request processed in 507us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708776.809320:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789708776.809359:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365580160 00000100:00100000:0.0:1789708776.809365:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365580160 00000100:00100000:0.0:1789708776.809401:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708776.809407:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365580160:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789708776.809424:0:22863:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789708776.809914:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365580288 00000100:00100000:1.0:1789708776.809920:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365580288 00000100:00100000:1.0:1789708776.809955:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708776.809962:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365580288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708776.810013:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365580288:12345-0@lo:400:kworker.0 Request processed in 52us (2430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708776.810019:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708776.836839:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365580032:0@lo:400:kworker.0 00010000:00080000:1.0:1789708776.860847:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bed0a2cdf80 x1876645365580288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708776.860869:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365580288:0@lo:400:kworker.0 00000100:00100000:1.0:1789708776.878399:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365580160:12345-0@lo:38:kworker.0 Request processed in 68984us (70957us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789708776.878414:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789708776.878470:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789708776.878476:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789708776.878480:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365580160:0@lo:38:kworker.0 00010000:00010000:0.0:1789708777.128928:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708777.135458:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00000020:01000004:3.0:1789708777.225229:0:23593:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789708777.225234:0:23593:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789708777.225235:0:23593:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789708777.225385:0:23593:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bee2d93d800 00000020:01000004:3.0:1789708777.225400:0:23593:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1789708777.225413:0:23593:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789708777.225613:0:23593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9bed042019c0) 00000020:00000080:3.0:1789708777.225631:0:23593:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789708777.395451:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789708777.399255:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.412989:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.413333:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.413600:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.413927:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.414202:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.414541:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.414725:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.414971:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.416736:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.418564:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.420902:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.421321:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.422204:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.422711:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.422984:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.425527:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.426370:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.427002:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.427788:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.428961:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.429200:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.429516:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.430025:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789708777.437615:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789708777.438291:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789708777.438599:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789708777.438910:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789708777.443090:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.447302:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.447826:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789708777.448039:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789708777.448614:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789708777.463779:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789708777.464402:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789708777.465999:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789708777.466919:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789708777.467243:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789708777.467608:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789708777.467875:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789708777.468191:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789708777.468398:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789708777.469014:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789708777.473687:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789708777.481089:0:23593:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1789708777.482038:0:23593:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789708777.482653:0:23593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789708777.482666:0:23593:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789708777.482680:0:23593:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47eac8 00000020:01000004:3.0:1789708777.482687:0:23593:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789708777.482709:0:23593:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789708777.482712:0:23593:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789708777.482729:0:23593:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789708777.482762:0:23593:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789708777.482767:0:23593:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789708777.502148:0:23593:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789708777.502212:0:23593:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.152@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789708777.502216:0:23593:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789708777.502218:0:23593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789708777.502220:0:23593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708777.502221:0:23593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708777.502221:0:23593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708777.502223:0:23593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708777.502224:0:23593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708777.502226:0:23593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708777.502227:0:23593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789708777.502231:0:23593:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789708777.502234:0:23593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789708777.502235:0:23593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789708777.502236:0:23593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708777.502237:0:23593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708777.502244:0:23593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708777.502245:0:23593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708777.502246:0:23593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708777.502247:0:23593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708777.502248:0:23593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789708777.502323:0:23593:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789708777.502346:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365580416:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789708777.502437:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.502485:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708777.502512:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365580416 00000100:00100000:3.0:1789708777.502521:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365580416 00000100:00100000:3.0:1789708777.502572:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789708777.502581:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:23593:x1876645365580416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789708777.502625:0:22851:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789708777.502628:0:22851:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789708777.502636:0:22851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789708777.504122:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:23593:x1876645365580416:12345-0@lo:253:mount.lustre.0 Request processed in 1536us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.504134:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789708777.507537:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365580416:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789708777.507559:0:23593:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789708777.507563:0:23593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789708777.507564:0:23593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789708777.507566:0:23593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708777.507567:0:23593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708777.507568:0:23593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708777.507569:0:23593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708777.507571:0:23593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708777.507573:0:23593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708777.507574:0:23593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789708777.507617:0:23593:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bee2d93d800 from lustre-MDT0001 10000000:01000000:2.0:1789708777.507652:0:23593:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789708777.507655:0:23593:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789708777.507662:0:23593:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bed04200000 local copy 00010000:00010000:2.0:1789708777.507673:0:23593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708777.507790:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365580544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708777.507867:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.507925:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708777.508138:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365580544 00000100:00100000:0.0:1789708777.508146:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365580544 00000100:00100000:0.0:1789708777.508209:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789708777.508220:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:23593:x1876645365580544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708777.508333:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:23593:x1876645365580544:12345-0@lo:501:mount.lustre.0 Request processed in 114us (465us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708777.508341:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789708777.508372:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365580544:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789708777.508385:0:23593:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789708777.508406:0:23593:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789708777.508412:0:23593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.508432:0:23593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708777.508460:0:23593:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bee2d93d800 10000000:01000000:3.0:1789708777.508465:0:23593:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789708777.508470:0:23593:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bed04200000 10000000:01000000:3.0:1789708777.508473:0:23593:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789708777.508476:0:23593:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bed04200000 from 1 10000000:01000000:3.0:1789708777.508479:0:23593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789708777.508503:0:23593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a400/0xf45f43947e47eacf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.508519:0:23593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103a400/0xf45f43947e47eacf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.508529:0:23593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103a400/0xf45f43947e47eacf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708777.508542:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365580672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708777.508572:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.508592:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365580672 00000100:00100000:2.0:1789708777.508596:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365580672 00000100:00100000:3.0:1789708777.508600:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee066cad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708777.508632:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789708777.508648:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+12:23593:x1876645365580672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708777.508658:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708777.508671:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ead6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47eacf expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.508692:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ead6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47eacf expref: 13 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.508702:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc000/0xf45f43947e47ead6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eacf expref: 13 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.508710:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc000, rc 0) 00000100:00100000:2.0:1789708777.508747:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+13:23593:x1876645365580672:12345-0@lo:101:mount.lustre.0 Request processed in 101us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708777.508753:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789708777.508809:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365580672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708777.508821:0:23593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103a400/0xf45f43947e47eacf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ead6 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.508829:0:23593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a400/0xf45f43947e47eacf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ead6 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708777.508843:0:23593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789708777.508861:0:23593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a400/0xf45f43947e47eacf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ead6 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.508868:0:23593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103a400/0xf45f43947e47eacf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ead6 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708777.508874:0:23593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bee2d93d800 10000000:01000000:3.0:1789708777.508878:0:23593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789708777.508892:0:23593:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bee2d93d800 from 1 10000000:01000000:3.0:1789708777.508895:0:23593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789708777.508914:0:23593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47eadd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.508921:0:23593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47eadd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.508929:0:23593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47eadd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708777.508940:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365580800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708777.508963:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.508973:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee066cad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708777.509118:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365580800 00000100:00100000:2.0:1789708777.509122:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365580800 00000100:00100000:2.0:1789708777.509139:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789708777.509144:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+13:23593:x1876645365580800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708777.509151:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708777.509158:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47eae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47eadd expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.509171:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47eae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47eadd expref: 14 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.509179:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebd800/0xf45f43947e47eae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eadd expref: 14 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.509197:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd800, rc 0) 00000100:00100000:2.0:1789708777.509236:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+14:23593:x1876645365580800:12345-0@lo:101:mount.lustre.0 Request processed in 91us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708777.509242:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789708777.509675:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365580800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708777.509687:0:23593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47eadd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eae4 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.509695:0:23593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47eadd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47eae4 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708777.509706:0:23593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789708777.509712:0:23593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47eadd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eae4 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.509719:0:23593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103b400/0xf45f43947e47eadd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eae4 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708777.509726:0:23593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789708777.509730:0:23593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708777.509734:0:23593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bee2d93d800 10000000:01000000:3.0:1789708777.509742:0:23593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789708777.509745:0:23593:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789708777.509747:0:23593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789708777.509761:0:23593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a600/0xf45f43947e47eaeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.509769:0:23593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103a600/0xf45f43947e47eaeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.509777:0:23593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103a600/0xf45f43947e47eaeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708777.509788:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365580928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708777.509816:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.509836:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee066cad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708777.509991:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365580928 00000100:00100000:2.0:1789708777.509997:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365580928 00000100:00100000:2.0:1789708777.510020:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789708777.510027:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+14:23593:x1876645365580928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708777.510035:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708777.510043:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebd200/0xf45f43947e47eaf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47eaeb expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.510056:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebd200/0xf45f43947e47eaf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47eaeb expref: 15 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.510065:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebd200/0xf45f43947e47eaf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eaeb expref: 15 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.510071:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd200, rc 0) 00000100:00100000:2.0:1789708777.510124:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+15:23593:x1876645365580928:12345-0@lo:101:mount.lustre.0 Request processed in 97us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708777.510130:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789708777.510243:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365580928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708777.510292:0:23593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103a600/0xf45f43947e47eaeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eaf2 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.510300:0:23593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a600/0xf45f43947e47eaeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47eaf2 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708777.517068:0:23593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1789708777.519505:0:23593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708777.537043:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789708777.537123:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1789708777.537139:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1789708777.537153:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1789708777.537177:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1789708777.537192:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1789708777.537207:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1789708777.537220:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1789708777.537235:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1789708777.537636:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1789708777.537660:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1789708777.537675:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1789708777.537688:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1789708777.537703:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1789708777.537716:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1789708777.537731:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1789708777.537743:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1789708777.537757:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1789708777.537770:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1789708777.537784:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1789708777.537798:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1789708777.537812:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1789708777.537824:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1789708777.537837:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1789708777.537850:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1789708777.537862:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1789708777.537873:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1789708777.537885:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1789708777.537897:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1789708777.537908:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1789708777.537921:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1789708777.537933:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1789708777.537945:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1789708777.537956:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1789708777.537967:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1789708777.537978:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1789708777.537990:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1789708777.538015:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1789708777.538028:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1789708777.538043:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1789708777.538055:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1789708777.538068:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1789708777.538079:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1789708777.538110:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1789708777.538140:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1789708777.538146:0:23593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1789708777.539394:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365581056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708777.539680:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.539737:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708777.540300:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365581056 00000100:00100000:0.0:1789708777.540310:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365581056 00000100:00100000:0.0:1789708777.540379:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708777.540389:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+15:23593:x1876645365581056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708777.540568:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+15:23593:x1876645365581056:12345-0@lo:501:mount.lustre.0 Request processed in 180us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708777.540576:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789708777.541013:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365581056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708777.541071:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365581184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708777.541135:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.541172:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708777.541297:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365581184 00000100:00100000:1.0:1789708777.541303:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365581184 00000100:00100000:1.0:1789708777.541345:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789708777.541353:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+15:23593:x1876645365581184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708777.543371:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+15:23593:x1876645365581184:12345-0@lo:503:mount.lustre.0 Request processed in 1998us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708777.543383:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789708777.543582:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365581184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789708777.544054:0:23593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708777.544173:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365581312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708777.544232:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.544313:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20cf0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708777.544595:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365581312 00000100:00100000:3.0:1789708777.544603:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365581312 00000100:00100000:3.0:1789708777.544641:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789708777.544650:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+15:23593:x1876645365581312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708777.545787:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+15:23593:x1876645365581312:12345-0@lo:502:mount.lustre.0 Request processed in 1134us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.545808:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708777.545907:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365581312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789708777.546181:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789708777.546211:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1789708777.546226:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1789708777.546242:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1789708777.546291:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1789708777.546304:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1789708777.546315:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1789708777.546326:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1789708777.546336:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1789708777.546347:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1789708777.546368:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1789708777.546382:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1789708777.546401:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1789708777.546412:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1789708777.546433:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1789708777.546446:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1789708777.546456:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1789708777.546467:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1789708777.546478:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1789708777.546488:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1789708777.546498:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1789708777.546509:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1789708777.546519:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1789708777.546530:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1789708777.546540:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1789708777.546550:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1789708777.546560:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1789708777.546571:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1789708777.546581:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1789708777.546591:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1789708777.546601:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1789708777.546612:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1789708777.546623:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1789708777.546633:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1789708777.546644:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1789708777.546655:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1789708777.546666:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1789708777.546676:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1789708777.546687:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1789708777.546697:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1789708777.546708:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1789708777.546718:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1789708777.546729:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1789708777.546739:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1789708777.546774:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365581440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708777.546836:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708777.546878:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708777.547293:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365581440 00000100:00100000:1.0:1789708777.547303:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365581440 00000100:00100000:1.0:1789708777.547366:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789708777.547376:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+15:23593:x1876645365581440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708777.547535:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+15:23593:x1876645365581440:12345-0@lo:502:mount.lustre.0 Request processed in 160us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708777.547543:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789708777.547749:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365581440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708777.547814:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1789708777.547824:0:23593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789708777.549535:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708777.549551:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.549553:0:23597:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789708777.549561:0:23597:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789708777.549564:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708777.549579:0:23597:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9bee2d988000) 00000020:00000080:1.0:1789708777.549599:0:23597:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789708777.549605:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789708777.549687:0:23597:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789708777.549694:0:23597:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47eb00 00000020:00000080:1.0:1789708777.549927:0:23597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789708777.549932:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708777.549936:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.549937:0:23597:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789708777.549940:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708777.549944:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.549945:0:23597:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789708777.549955:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708777.549962:0:23597:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9bee2d98b380) 00000020:00000080:1.0:1789708777.549973:0:23597:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789708777.549977:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789708777.549979:0:23597:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789708777.549982:0:23597:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789708777.549988:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789708777.550034:0:23597:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee2d93d800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789708777.550046:0:23597:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9bee2d9899c0) 00000020:00000080:1.0:1789708777.550055:0:23597:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789708777.550135:0:23597:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789708777.550140:0:23597:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47eb15 00000020:00000080:1.0:1789708777.550236:0:23597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789708777.550244:0:23597:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789708777.550295:0:23597:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf45f43947e47eb1c 00080000:01000000:1.0:1789708777.550302:0:23597:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789708777.550305:0:23597:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47eb23 00010000:00010000:3.0:1789708777.696567:0:23597:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789708777.704861:0:23597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1789708777.705447:0:23597:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789708777.710346:0:23597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789708777.710372:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708777.710379:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.710381:0:23597:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789708777.710385:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708777.710390:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.710392:0:23597:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789708777.710395:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789708777.710401:0:23597:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:00000080:1.0:1789708777.710439:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708777.710454:0:23597:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9bee2d98cd40) 00000020:00000080:1.0:1789708777.710476:0:23597:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789708777.710481:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789708777.710555:0:23597:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789708777.710576:0:23597:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789708777.710583:0:23597:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47eb31 00010000:00080000:1.0:1789708777.710626:0:23597:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee0446f800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789708777.724823:0:23597:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789708777.736793:0:23597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789708777.736812:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789708777.736859:0:23597:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789708777.736884:0:23597:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47eb38 00000100:00080000:1.0:1789708777.736895:0:23597:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708777.736907:0:23597:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bee0446f800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789708777.736946:0:23597:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed098d6680 x1876645365581568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708777.736979:0:23597:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789708777.737043:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708777.737047:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.737049:0:23597:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789708777.737053:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789708777.737056:0:23597:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789708777.737057:0:23597:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708777.737059:0:23597:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708777.737060:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789708777.737062:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.737064:0:23597:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789708777.737066:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708777.737070:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.737071:0:23597:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789708777.737075:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789708777.737127:0:23597:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789708777.737143:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708777.737147:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.737149:0:23597:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789708777.737151:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789708777.737153:0:23597:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789708777.737168:0:23597:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708777.737170:0:23597:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708777.737172:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789708777.737175:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.737176:0:23597:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789708777.737179:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789708777.737182:0:23597:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789708777.737185:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708777.737187:0:23597:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789708777.737189:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789708777.737193:0:23597:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:1.0:1789708777.737215:0:23597:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789708777.737218:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708777.737232:0:23597:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9bee3dc3b380) 00000020:00000080:1.0:1789708777.737245:0:23597:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789708777.737252:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789708777.737345:0:23597:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789708777.737352:0:23597:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789708777.737370:0:23597:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47eb46 00010000:00080000:1.0:1789708777.737397:0:23597:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed0aa0d800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789708777.737826:0:23597:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1789708777.738278:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789708777.738284:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789708777.738287:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708777.738293:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 347 00000100:00080000:3.0:1789708777.738297:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789708777.738305:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee30744000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708777.738332:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2ce680 x1876645365581696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708777.738346:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708777.738349:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708777.738352:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708777.738365:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789708777.738659:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365581568:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789708777.738749:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.738807:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365581696:0@lo:38:kworker.0 00000100:00100000:2.0:1789708777.738846:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.738879:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789708777.738887:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365581824:0@lo:400:kworker.0 00000100:00100000:2.0:1789708777.738915:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.738954:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365581568 00000100:00100000:2.0:1789708777.738963:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365581568 00000100:00100000:2.0:1789708777.738988:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365581696 00000100:00100000:2.0:1789708777.738991:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365581696 00000100:00100000:2.0:1789708777.739002:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708777.739009:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365581568:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789708777.739035:0:22863:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:2.0:1789708777.739068:0:22863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47eb4d 00000004:00100000:2.0:1789708777.739093:0:22863:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789708777.739103:0:22863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1789708777.739177:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365581824 00000100:00100000:2.0:1789708777.739181:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365581824 00000100:00100000:2.0:1789708777.739212:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708777.739219:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365581824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708777.739312:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365581824:12345-0@lo:400:kworker.0 Request processed in 93us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708777.739320:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789708777.739387:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bed0a2cea00 x1876645365581824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708777.739400:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365581824:0@lo:400:kworker.0 00000040:01000000:2.0:1789708777.743152:0:23597:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789708777.743539:0:23597:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789708777.752782:0:23597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708777.754146:0:23597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1789708777.754368:0:23597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:2.0:1789708777.756014:0:22863:0:(import.c:65:import_set_state_nolock()) ffff9bee36276800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708777.756162:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3614:x1876645365581568:12345-0@lo:38:llog_process_th.0 Request processed in 17150us (17411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708777.756175:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708777.756203:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708777.756209:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365581696:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789708777.756281:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365581696:12345-0@lo:38:kworker.0 Request processed in 71us (17434us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789708777.756287:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708777.756331:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789708777.756341:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789708777.756349:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789708777.756367:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789708777.756370:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee0446f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789708777.756382:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365581568:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789708777.756394:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789708777.756397:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708777.756401:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789708777.756404:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365581696:0@lo:38:kworker.0 00000100:00100000:1.0:1789708777.756918:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708777.756934:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365581952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708777.757001:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.757987:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365581952 00000100:00100000:3.0:1789708777.757998:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365581952 00000100:00100000:3.0:1789708777.758052:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708777.758062:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1876645365581952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789708777.758106:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789708777.758167:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1876645365581952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.758183:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708777.758228:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365581952:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789708777.760364:0:23602:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789708777.760371:0:23602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789708777.763212:0:23597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789708777.763228:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789708777.763320:0:23597:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789708777.763345:0:23597:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47eb54 00000100:00080000:2.0:1789708777.763368:0:23597:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708777.763380:0:23597:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bed0aa0d800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708777.763587:0:23597:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fac3480 x1876645365582080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708777.763627:0:23597:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789708777.763740:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708777.763746:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708777.763748:0:23597:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789708777.763750:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789708777.763753:0:23597:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789708777.763754:0:23597:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789708777.763756:0:23597:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789708777.763757:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789708777.763759:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708777.763761:0:23597:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789708777.763763:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789708777.763768:0:23597:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789708777.763771:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708777.763772:0:23597:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789708777.763775:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789708777.763779:0:23597:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:2.0:1789708777.763802:0:23597:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789708777.763805:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708777.763817:0:23597:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9bee3dd799c0) 00000020:00000080:2.0:1789708777.763831:0:23597:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789708777.763837:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789708777.763906:0:23597:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789708777.763914:0:23597:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789708777.763920:0:23597:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45f43947e47eb62 00010000:00080000:2.0:1789708777.763950:0:23597:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee04469000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.152@tcp at head 00000100:00080000:3.0:1789708777.764367:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708777.764372:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708777.764375:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708777.764377:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789708777.766142:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365582080:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789708777.766221:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365582080 offset 0 length 520: 4 00010000:00010000:2.0:1789708777.768034:0:23597:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789708777.768826:0:23597:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789708777.768846:0:23597:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789708777.791119:0:23597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708777.792779:0:23597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789708777.792969:0:23597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1789708777.793585:0:23604:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789708777.793592:0:23604:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789708777.794485:0:23597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789708777.794502:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789708777.794553:0:23597:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789708777.794579:0:23597:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47eb69 00000100:00080000:0.0:1789708777.794590:0:23597:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708777.794604:0:23597:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bee04469000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708777.794646:0:23597:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622f480 x1876645365582208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708777.794674:0:23597:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789708777.794746:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708777.794750:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708777.794753:0:23597:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789708777.794756:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708777.794761:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708777.794762:0:23597:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789708777.794765:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789708777.794767:0:23597:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789708777.794770:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708777.794781:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708777.794782:0:23597:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789708777.794786:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708777.794788:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708777.794790:0:23597:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789708777.794794:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789708777.794818:0:23597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708777.794821:0:23597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708777.794822:0:23597:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789708777.794826:0:23597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:3.0:1789708777.794924:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708777.794931:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708777.794934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708777.794936:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1789708777.794957:0:23593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789708777.795000:0:23593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789708777.795026:0:23593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a600/0xf45f43947e47eaeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eaf2 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.795038:0:23593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103a600/0xf45f43947e47eaeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eaf2 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708777.795046:0:23593:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee2d93d800 from 1 10000000:01000000:3.0:1789708777.795049:0:23593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708777.795077:0:23593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.795097:0:23593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.795119:0:23593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708777.795139:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708777.795217:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.795279:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee304643c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708777.795306:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365582336 00000100:00100000:3.0:1789708777.795313:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365582336 00000100:00100000:3.0:1789708777.795368:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708777.795378:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+15:23593:x1876645365582336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708777.795392:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708777.795404:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee1103a200/0xf45f43947e47eb77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47eb70 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708777.795427:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365582208:0@lo:8:llog_process_th.0 00010000:00010000:3.0:1789708777.795439:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee1103a200/0xf45f43947e47eb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47eb70 expref: 16 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.795448:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee1103a200/0xf45f43947e47eb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eb70 expref: 16 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.795458:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103a200, rc 0) 00000400:00000100:2.0:1789708777.795466:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365582208 offset 0 length 520: 4 00000100:00100000:3.0:1789708777.803450:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+16:23593:x1876645365582336:12345-0@lo:101:mount.lustre.0 Request processed in 8063us (8222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.803465:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789708777.804852:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708777.804880:0:23593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.804894:0:23593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708777.805454:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582464:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789708777.805526:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708777.805561:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708777.805994:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365582464 00000100:00100000:1.0:1789708777.806002:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365582464 00000100:00100000:1.0:1789708777.806059:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789708777.806069:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+16:23593:x1876645365582464:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789708777.806119:0:22849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789708777.806139:0:22849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789708777.806142:0:22849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789708777.806249:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+16:23593:x1876645365582464:12345-0@lo:256:mount.lustre.0 Request processed in 181us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708777.806283:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789708777.806633:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582464:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789708777.807364:0:23593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789708777.807621:0:23593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.807634:0:23593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708777.808186:0:23593:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee2d93d800 from 1 10000000:01000000:1.0:1789708777.808191:0:23593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708777.808236:0:23593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708777.808246:0:23593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708777.808285:0:23593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708777.808312:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789708777.808389:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708777.808439:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708777.808507:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365582592 00000100:00100000:3.0:1789708777.808515:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365582592 00000100:00100000:3.0:1789708777.808569:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789708777.808579:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+16:23593:x1876645365582592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708777.808606:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708777.808620:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee1103b200/0xf45f43947e47eb85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47eb7e expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.808645:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee1103b200/0xf45f43947e47eb85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47eb7e expref: 17 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.808656:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee1103b200/0xf45f43947e47eb85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eb7e expref: 17 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.808664:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103b200, rc 0) 00000100:00100000:3.0:1789708777.808712:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365582592:12345-0@lo:101:mount.lustre.0 Request processed in 134us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.808719:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789708777.809490:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708777.809526:0:23593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.809539:0:23593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708777.812336:0:23593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1789708777.812729:0:23593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708777.812951:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789708777.812979:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1789708777.812996:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1789708777.813008:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1789708777.813037:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1789708777.813050:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1789708777.813063:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1789708777.813074:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1789708777.813086:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789708777.823824:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1789708777.823887:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1789708777.823922:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1789708777.823928:0:23593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1789708777.824087:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708777.824181:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708777.824294:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee20c5b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708777.828762:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365582720 00000100:00100000:2.0:1789708777.828780:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365582720 00000100:00100000:2.0:1789708777.828844:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789708777.828856:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365582720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708777.829052:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365582720:12345-0@lo:501:mount.lustre.0 Request processed in 198us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708777.829061:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789708777.829324:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708777.829425:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708777.829480:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708777.829510:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708777.829652:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365582848 00000100:00100000:2.0:1789708777.829657:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365582848 00000100:00100000:2.0:1789708777.829692:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789708777.829699:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365582848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708777.829801:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365582848:12345-0@lo:503:mount.lustre.0 Request processed in 101us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708777.829809:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789708777.829898:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789708777.830530:0:23593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708777.830625:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708777.830672:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708777.830707:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365582976 00000100:00100000:0.0:1789708777.830712:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365582976 00000100:00100000:0.0:1789708777.830741:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789708777.830757:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365582976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708777.830861:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365582976:12345-0@lo:502:mount.lustre.0 Request processed in 104us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708777.830868:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789708777.830914:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708777.830930:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365582976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789708777.831110:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789708777.831137:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1789708777.831153:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1789708777.831166:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1789708777.831179:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1789708777.831207:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1789708777.831223:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1789708777.831235:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1789708777.831248:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789708777.831289:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1789708777.831306:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1789708777.831328:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708777.831378:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708777.831414:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708777.831515:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365583104 00000100:00100000:3.0:1789708777.831520:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365583104 00000100:00100000:3.0:1789708777.831558:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708777.831565:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365583104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708777.831655:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365583104:12345-0@lo:502:mount.lustre.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.831662:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708777.831704:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708777.831744:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1789708777.831752:0:23593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789708777.834636:0:23606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708777.834651:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708777.834653:0:23606:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789708777.834663:0:23606:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee2d93d800 00000020:00000080:3.0:1789708777.834672:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789708777.834681:0:23606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708777.834683:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708777.834685:0:23606:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789708777.834688:0:23606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708777.834691:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708777.834692:0:23606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789708777.834696:0:23606:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee2d93d800 00000020:00000080:3.0:1789708777.834697:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789708777.834766:0:23606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708777.834769:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708777.834771:0:23606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789708777.834773:0:23606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708777.834776:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708777.834777:0:23606:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789708777.834780:0:23606:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee2d93d800 00000020:00000080:3.0:1789708777.834783:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789708777.834799:0:23606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708777.834802:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708777.834803:0:23606:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789708777.834805:0:23606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708777.834807:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708777.834808:0:23606:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789708777.834812:0:23606:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee2d93d800 00000020:00000080:3.0:1789708777.834813:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789708777.834835:0:23606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708777.834839:0:23606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708777.834840:0:23606:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789708777.834843:0:23606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1789708777.836636:0:23593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789708777.836698:0:23593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708777.836730:0:23593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708777.836745:0:23593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708777.836820:0:23593:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789708777.836823:0:23593:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bee2d93d800 10000000:01000000:1.0:1789708777.836827:0:23593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bee2d93d800 10000000:01000000:1.0:1789708777.836832:0:23593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789708777.836839:0:23593:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee2d93d800 from 1 10000000:01000000:1.0:1789708777.836842:0:23593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789708777.836882:0:23593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9200/0xf45f43947e47eb8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708777.836891:0:23593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee029c9200/0xf45f43947e47eb8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708777.836901:0:23593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee029c9200/0xf45f43947e47eb8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708777.836926:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789708777.836995:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708777.837043:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708777.837065:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365583232 00000100:00100000:3.0:1789708777.837074:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365583232 00000100:00100000:3.0:1789708777.837135:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789708777.837145:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365583232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708777.837167:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708777.837178:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee1103a000/0xf45f43947e47eb93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47eb8c expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.837204:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee1103a000/0xf45f43947e47eb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47eb8c expref: 18 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.837213:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee1103a000/0xf45f43947e47eb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eb8c expref: 18 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.837223:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103a000, rc 0) 00000100:00100000:3.0:1789708777.837301:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:23593:x1876645365583232:12345-0@lo:101:mount.lustre.0 Request processed in 158us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.837309:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789708777.837367:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708777.837381:0:23593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee029c9200/0xf45f43947e47eb8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eb93 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708777.837390:0:23593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee029c9200/0xf45f43947e47eb8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47eb93 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708777.841558:0:23593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1789708777.841886:0:23593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708777.842132:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789708777.842158:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1789708777.845790:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1789708777.845811:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1789708777.845828:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1789708777.845843:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1789708777.845876:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1789708777.845893:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1789708777.845910:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1789708777.845924:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1789708777.845940:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1789708777.845954:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1789708777.845968:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1789708777.845982:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1789708777.846021:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1789708777.846039:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1789708777.846054:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1789708777.846067:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1789708777.846082:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1789708777.846112:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1789708777.846130:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1789708777.846145:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1789708777.849539:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1789708777.849621:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1789708777.849638:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1789708777.849651:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1789708777.849664:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1789708777.849676:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1789708777.849689:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1789708777.849702:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1789708777.849742:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1789708777.849756:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1789708777.849769:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1789708777.849782:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1789708777.849795:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1789708777.849809:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1789708777.849824:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1789708777.849839:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1789708777.849855:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1789708777.849881:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1789708777.849895:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1789708777.849908:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1789708777.849920:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1789708777.849932:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1789708777.849945:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1789708777.849961:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1789708777.849989:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1789708777.850004:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1789708777.853647:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1789708777.853707:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1789708777.853731:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1789708777.853736:0:23593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1789708777.853867:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708777.853933:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.853971:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee30464cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708777.855696:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365583360 00000100:00100000:0.0:1789708777.855708:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365583360 00000100:00100000:0.0:1789708777.855759:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789708777.855770:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:23593:x1876645365583360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708777.856591:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708777.856666:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708777.856729:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.856766:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365583488 00000100:00100000:3.0:1789708777.856772:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365583488 00000100:00100000:3.0:1789708777.856798:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789708777.856804:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:23593:x1876645365583488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708777.856901:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:23593:x1876645365583488:12345-0@lo:503:mount.lustre.0 Request processed in 95us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.856910:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789708777.856959:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee30464cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708777.856973:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708777.857147:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:23593:x1876645365583360:12345-0@lo:501:mount.lustre.0 Request processed in 162us (1996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708777.857155:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000040:00080000:3.0:1789708777.867434:0:23593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789708777.867535:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708777.867610:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.867646:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee30464180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708777.870419:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365583616 00000100:00100000:2.0:1789708777.870433:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365583616 00000100:00100000:2.0:1789708777.870482:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789708777.870491:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:23593:x1876645365583616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708777.870653:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:23593:x1876645365583616:12345-0@lo:502:mount.lustre.0 Request processed in 163us (3042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708777.870661:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789708777.878663:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708777.878927:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1789708777.878961:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1789708777.878978:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1789708777.878993:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1789708777.879006:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1789708777.879036:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1789708777.879050:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1789708777.879063:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1789708777.879076:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1789708777.879089:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1789708777.883995:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1789708777.884031:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1789708777.884046:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1789708777.884059:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1789708777.884072:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1789708777.884087:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1789708777.884235:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1789708777.884339:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1789708777.884366:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1789708777.884381:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1789708777.884395:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1789708777.885290:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1789708777.885320:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1789708777.885336:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1789708777.885362:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1789708777.885388:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1789708777.885401:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1789708777.887733:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1789708777.887751:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1789708777.887764:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1789708777.887776:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1789708777.887789:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1789708777.887801:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1789708777.887812:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1789708777.887824:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1789708777.887836:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1789708777.887848:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1789708777.887882:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1789708777.887898:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1789708777.887910:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1789708777.887923:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1789708777.887937:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1789708777.887950:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1789708777.887964:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1789708777.887976:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1789708777.887988:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1789708777.888001:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1789708777.888015:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1789708777.888077:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708777.890547:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.890590:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee30464180 going to sleep for 11 seconds 00000100:00100000:3.0:1789708777.890638:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365583744 00000100:00100000:3.0:1789708777.890647:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365583744 00000100:00100000:3.0:1789708777.890693:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789708777.890703:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:23593:x1876645365583744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708777.890848:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:23593:x1876645365583744:12345-0@lo:502:mount.lustre.0 Request processed in 145us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.890861:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789708777.890915:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708777.904787:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1789708777.904856:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1789708777.904911:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708777.905004:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.905106:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee053c0000 going to sleep for 11 seconds 00000100:00100000:0.0:1789708777.910703:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365583872 00000100:00100000:0.0:1789708777.910717:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365583872 00000100:00100000:0.0:1789708777.910775:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789708777.910784:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:23593:x1876645365583872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708777.910949:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:23593:x1876645365583872:12345-0@lo:502:mount.lustre.0 Request processed in 166us (5945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708777.910957:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789708777.911304:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365583872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708777.911567:0:23593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1789708777.911582:0:23593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789708777.912762:0:23611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789708777.912780:0:23611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9bed095fb380) 00000020:00000080:3.0:1789708777.912804:0:23611:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789708777.912890:0:23611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee2d93d800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789708777.912895:0:23611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee2d93d800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789708777.912898:0:23611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee2d93d800 3 00010000:00080000:3.0:1789708777.912927:0:23611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bee2f446000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789708777.920843:0:23611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789708777.921088:0:23611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789708777.921149:0:23611:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789708777.921173:0:23611:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf45f43947e47eba1 00000100:00080000:3.0:1789708777.921184:0:23611:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708777.921195:0:23611:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bee2f446000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708777.921232:0:23611:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2ce300 x1876645365584000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789708777.921309:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365584000:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708777.921391:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.922699:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365584000 00000100:00100000:3.0:1789708777.922710:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365584000 00000100:00100000:3.0:1789708777.925303:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708777.925316:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365584000:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789708777.925360:0:22857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:3.0:1789708777.925438:0:22857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf45f43947e47eba8 00000004:00100000:3.0:1789708777.925457:0:22857:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789708777.925496:0:22857:0:(import.c:65:import_set_state_nolock()) ffff9bee2f56e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708777.925581:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876645365584000:12345-0@lo:38:llog_process_th.0 Request processed in 265us (4189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.925589:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789708777.925643:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bed0a2ce300 x1876645365584000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708777.925656:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789708777.925663:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789708777.925669:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789708777.925674:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789708777.925676:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee2f446000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789708777.925681:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876645365584000:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789708777.925704:0:23611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789708777.925725:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708777.925729:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708777.925732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708777.925743:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789708777.929433:0:23611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1789708777.932427:0:23593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789708777.932489:0:23593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789708777.932512:0:23593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9200/0xf45f43947e47eb8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eb93 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.932533:0:23593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee029c9200/0xf45f43947e47eb8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47eb93 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789708777.932590:0:23593:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789708777.932593:0:23593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789708777.932594:0:23593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708777.932595:0:23593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708777.932597:0:23593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708777.932598:0:23593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708777.932600:0:23593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708777.932602:0:23593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708777.932603:0:23593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789708777.932606:0:23593:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789708777.932608:0:23593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789708777.932610:0:23593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789708777.932611:0:23593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708777.932612:0:23593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708777.932613:0:23593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708777.932614:0:23593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708777.932615:0:23593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708777.932617:0:23593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708777.932618:0:23593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789708777.932653:0:23593:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789708777.932673:0:23593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365584128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789708777.932745:0:23593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.932788:0:23593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee340fd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708777.938428:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365584128 00000100:00100000:3.0:1789708777.938445:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365584128 00000100:00100000:3.0:1789708777.938508:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789708777.938517:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:23593:x1876645365584128:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789708777.938549:0:22849:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789708777.938563:0:22849:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789708777.945724:0:22837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789708777.945803:0:22849:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789708777.945822:0:22849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789708777.945927:0:22873:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789708777.945933:0:22873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789708777.945957:0:22873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.945975:0:22873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47eab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eaac expref: 18 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.945996:0:22873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee1103a200/0xf45f43947e47eb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eb70 expref: 18 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.946004:0:22873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.946043:0:22873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee1103a200/0xf45f43947e47eb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47eb70 expref: 18 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.946057:0:22873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee1103a200/0xf45f43947e47eb77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47eb70 expref: 18 pid: 22851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708777.946072:0:22873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365584256:0@lo:104: 00000100:00100000:2.0:1789708777.946133:0:22873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708777.946252:0:22873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47eab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47eaac expref: 18 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708777.946289:0:22873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47eab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47eaac expref: 18 pid: 22851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708777.946299:0:22873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365584384:0@lo:104: 00000100:00100000:2.0:1789708777.946323:0:22873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.946346:0:22873:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee340fd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789708777.946586:0:22841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365584256 00000100:00100000:0.0:1789708777.946594:0:22841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365584256 00000100:00100000:0.0:1789708777.946625:0:22841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365584384 00000100:00100000:0.0:1789708777.946628:0:22841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365584384 00000100:00100000:0.0:1789708777.946641:0:22841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708777.946649:0:22841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+4:22873:x1876645365584256:12345-0@lo:104: 00010000:00010000:0.0:1789708777.946662:0:22841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.946716:0:22841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708777.946722:0:22841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+4:22873:x1876645365584256:12345-0@lo:104: Request processed in 73us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708777.946729:0:22841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708777.946745:0:22841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708777.946751:0:22841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:22873:x1876645365584384:12345-0@lo:104: 00010000:00010000:0.0:1789708777.946758:0:22841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.946787:0:22841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708777.946799:0:22841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:22873:x1876645365584384:12345-0@lo:104: Request processed in 48us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708777.946805:0:22841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708777.946837:0:22873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365584256:0@lo:104: 00000100:00100000:0.0:1789708777.946845:0:22873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365584384:0@lo:104: 00010000:00010000:0.0:1789708777.946863:0:22873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.946879:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708777.946884:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.946891:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a800 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708777.946894:0:22845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.946902:0:22845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708777.946910:0:22845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708777.946916:0:22845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708777.946944:0:22845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.946949:0:22845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708777.946969:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.946987:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103a800/0xf45f43947e47eb70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47eb77 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.947000:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708777.947003:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.947009:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebce00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708777.947012:0:22845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.947020:0:22845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708777.947026:0:22845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708777.947031:0:22845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708777.947045:0:22845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.947050:0:22845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708777.947066:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.947072:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebce00/0xf45f43947e47eaac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47eab3 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.947084:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708777.947092:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708777.947094:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708777.947100:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708777.947120:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365584512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708777.947150:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708777.959299:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365584640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708777.968641:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365584512 00000100:00100000:0.0:1789708777.968656:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365584512 00010000:00010000:0.0:1789708777.968699:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee1103a200/0xf45f43947e47eb77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47eb70 expref: 19 pid: 22851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708777.968735:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708777.968743:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:3616:x1876645365584512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708777.968758:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708777.968763:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee1103a200/0xf45f43947e47eb77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47eb70 expref: 19 pid: 22851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.968776:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee1103a200/0xf45f43947e47eb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47eb70 expref: 19 pid: 22851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.968793:0:22842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee1103a200/0xf45f43947e47eb77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47eb70 expref: 19 pid: 22851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.968807:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708777.968856:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:3616:x1876645365584512:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (21705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708777.968863:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708777.968924:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708777.968983:0:22843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365584640 00000100:00100000:0.0:1789708777.968987:0:22843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365584640 00010000:00010000:0.0:1789708777.969000:0:22843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47eab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47eaac expref: 18 pid: 22851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708777.969030:0:22843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708777.969037:0:22843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:3617:x1876645365584640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708777.969046:0:22843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708777.969050:0:22843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47eab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47eaac expref: 18 pid: 22851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.969059:0:22843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47eab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47eaac expref: 18 pid: 22851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.969070:0:22843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebd600/0xf45f43947e47eab3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47eaac expref: 18 pid: 22851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.969083:0:22843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708777.969224:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:23593:x1876645365584128:12345-0@lo:253:mount.lustre.0 Request processed in 30707us (36477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.969233:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789708777.969302:0:23593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:23593:1876645365584128:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789708777.969315:0:23593:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789708777.969318:0:23593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708777.969319:0:23593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789708777.969321:0:23593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708777.969323:0:23593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708777.969324:0:23593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708777.969325:0:23593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708777.969327:0:23593:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789708777.969328:0:23593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708777.969330:0:23593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789708777.969377:0:23593:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789708777.970274:0:22843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789708777.970298:0:22843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024365707s 00010000:00010000:0.0:1789708777.970304:0:22843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.970313:0:22843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.970320:0:22843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.970328:0:22843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.970340:0:22843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708777.970345:0:22843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.970364:0:22843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.970381:0:22843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.970390:0:22843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708777.971291:0:22843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+16:3617:x1876645365584640:12345-0@lo:103:ldlm_bl.0 Request processed in 2248us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708777.971302:0:22843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708777.971369:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365584640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708777.971394:0:22873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.971403:0:22873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708777.974145:0:22873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebd400/0xf45f43947e47ebaf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708777.974301:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365584512:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1789708777.980003:0:23593:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1789708777.980369:0:23618:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789708777.980837:0:23593:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1789708777.981047:0:23618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1789708777.982378:0:23617:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789708777.982386:0:23617:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789708777.983291:0:23619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23619:1876645365584768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789708777.983399:0:23619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1789708777.983816:0:23593:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789708777.983860:0:23593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789708777.984344:0:23593:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789708777.984361:0:23593:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789708777.984611:0:23593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708777.985361:0:23619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78b480 going to sleep for 11 seconds 00000040:00080000:1.0:1789708777.988925:0:23593:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789708777.989387:0:23618:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789708777.990198:0:23618:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1789708777.990365:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365584768 00000100:00100000:3.0:1789708777.990376:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365584768 00000100:00100000:3.0:1789708777.990663:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708777.990673:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23619:x1876645365584768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789708777.990797:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23619:x1876645365584768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 126us (7399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.990812:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708777.990879:0:23619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23619:1876645365584768:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789708777.990921:0:23619:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789708777.990970:0:23619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23619:1876645365584896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789708777.991021:0:23619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.991045:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365584896 00000100:00100000:3.0:1789708777.991049:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365584896 00000100:00100000:3.0:1789708777.991066:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708777.991071:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23619:x1876645365584896:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789708777.991893:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23619:x1876645365584896:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 819us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.991901:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708777.991920:0:23619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708777.991934:0:23619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23619:1876645365584896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789708777.992006:0:23619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23619:1876645365585024:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789708777.992033:0:23619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.992071:0:22868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365585024 00000100:00100000:3.0:1789708777.992076:0:22868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365585024 00000100:00100000:3.0:1789708777.992212:0:22868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708777.992221:0:22868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23619:x1876645365585024:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789708777.992282:0:22868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23619:x1876645365585024:12345-0@lo:900:lod0001_rec0000.0 Request processed in 39us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708777.992290:0:22868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708777.992309:0:23619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc70300 going to sleep for 11 seconds 00010000:00080000:3.0:1789708777.992335:0:23619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bed0a2ce300 x1876645365585024/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789708793 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708777.992345:0:23619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23619:1876645365585024:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789708777.992689:0:23619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23619:1876645365585152:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789708777.992725:0:23619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708777.992744:0:23619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3dc706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708777.992818:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365585152 00000100:00100000:1.0:1789708777.992823:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365585152 00000100:00100000:1.0:1789708777.992861:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708777.992869:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23619:x1876645365585152:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789708777.992935:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23619:x1876645365585152:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708777.992941:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789708777.993005:0:23619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23619:1876645365585152:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789708777.993059:0:23619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708777.995011:0:23593:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789708777.995076:0:23593:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789708777.995401:0:23593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789708777.997016:0:23593:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:3.0:1789708777.998728:0:23619:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789708777.998813:0:23619:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789708777.998819:0:23619:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1789708778.009645:0:23593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1789708778.012172:0:23593:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789708778.012215:0:23593:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbde281963988 00100000:10000000:2.0:1789708778.012223:0:23593:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789708778.013313:0:23593:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789708778.013365:0:23593:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789708778.013383:0:23593:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789708778.013568:0:23593:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789708778.015044:0:23593:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708778.015423:0:23593:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789708778.151655:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:3.0:1789708778.153626:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789708778.985928:0:23614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789708779.174409:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00000040:00080000:2.0:1789708779.176039:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789708779.176425:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789708779.814366:0:22855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789708779.814374:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee2d93d800 from 12 10000000:01000000:0.0:1789708779.814379:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789708779.814425:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708779.814438:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708779.814450:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708779.814476:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365585280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708779.814539:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708779.814601:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f6e8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708779.815484:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365585280 00000100:00100000:1.0:1789708779.815496:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365585280 00000100:00100000:1.0:1789708779.815589:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789708779.815599:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+16:22855:x1876645365585280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708779.815614:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708779.815629:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47ebbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ebb6 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708779.815653:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47ebbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ebb6 expref: 17 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708779.815665:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47ebbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ebb6 expref: 17 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708779.815674:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8a00, rc 0) 00000100:00100000:1.0:1789708779.815728:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:22855:x1876645365585280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708779.815735:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789708779.815775:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365585280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708779.815790:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708779.815799:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708779.815868:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365585408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789708779.821791:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708779.821844:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f6e8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708779.821977:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365585408 00000100:00100000:3.0:1789708779.821987:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365585408 00000100:00100000:3.0:1789708779.822106:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789708779.822120:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:22855:x1876645365585408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789708779.822149:0:22849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789708779.822174:0:22849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789708779.822177:0:22849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1789708779.822294:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:22855:x1876645365585408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 178us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708779.822303:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789708779.822325:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365585408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789708779.822500:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789708779.822572:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708779.822591:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708779.822602:0:22855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789708779.822605:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bed0343c000 from 12 10000000:01000000:1.0:1789708779.822608:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789708779.822637:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708779.822644:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708779.822653:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708779.822672:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365585536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789708779.822701:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708779.822731:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee340fd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789708779.823129:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365585536 00000100:00100000:3.0:1789708779.823136:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365585536 00000100:00100000:3.0:1789708779.823171:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789708779.823179:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:22855:x1876645365585536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708779.823196:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708779.823208:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee1103ae00/0xf45f43947e47ebcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ebc4 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708779.823230:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee1103ae00/0xf45f43947e47ebcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ebc4 expref: 18 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708779.823239:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee1103ae00/0xf45f43947e47ebcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ebc4 expref: 18 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708779.823248:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103ae00, rc 0) 00000100:00100000:3.0:1789708779.823302:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:22855:x1876645365585536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708779.823309:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789708779.824588:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365585536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708779.824607:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708779.824619:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708779.824670:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365585664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789708779.824713:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708779.824746:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee340fd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708779.825083:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365585664 00000100:00100000:0.0:1789708779.825089:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365585664 00000100:00100000:0.0:1789708779.825130:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789708779.825139:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:22855:x1876645365585664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789708779.825155:0:22852:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789708779.825170:0:22852:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789708779.825173:0:22852:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1789708779.825248:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:22855:x1876645365585664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708779.825255:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789708779.825597:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365585664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789708779.825641:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789708779.825649:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708779.825658:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708780.009570:0:23614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789708780.198362:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 0 seconds 00010000:00010000:3.0:1789708780.198495:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708781.033401:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708766/real 1789708766] req@ffff9bee3fac2300 x1876645365579392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708781 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708781.033434:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3fac2300 x1876645365579392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708781 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708781.033446:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708766/real 1789708766] req@ffff9bee3fac1180 x1876645365579520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708781 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708781.033458:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3fac1180 x1876645365579520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708781 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708781.033478:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa71000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708781.033627:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789708781.033632:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365579392:0@lo:8:kworker.0 00000100:00080000:0.0:1789708781.033651:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708781.033657:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789708781.033660:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365579520:0@lo:8:kworker.0 00000100:00080000:3.0:1789708781.033779:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789708781.033784:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789708781.033786:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708781.033800:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bee30744000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708781.033835:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708781.033848:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365585792:0@lo:400:kworker.0 00000100:00100000:0.0:1789708781.033915:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708781.033981:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365585792 00000100:00100000:0.0:1789708781.033990:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365585792 00000100:00100000:0.0:1789708781.034057:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708781.034065:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:3617:x1876645365585792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708781.034102:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cc380 x1876645365585920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708781.034115:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708781.034118:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789708781.034120:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa71000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708781.034123:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 337 00000100:00080000:3.0:1789708781.034126:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789708781.034135:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bed0aa71000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708781.034146:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cca80 x1876645365586048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708781.034154:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708781.034157:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789708781.034158:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708781.034160:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 337 00000100:00080000:3.0:1789708781.034162:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789708781.034165:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bed08562000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708781.034172:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2cf480 x1876645365586176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708781.034213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708781.034216:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708781.034219:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708781.034221:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789708781.034238:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708781.034245:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365586560:0@lo:400:kworker.0 00000100:00100000:3.0:1789708781.034312:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708781.034341:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365586304:0@lo:400:kworker.0 00000100:00100000:3.0:1789708781.034393:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708781.034412:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708781.034418:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365586432:0@lo:400:kworker.0 00000100:00100000:3.0:1789708781.034443:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708781.034471:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365586560 00000100:00100000:3.0:1789708781.034480:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365586560 00000100:00100000:3.0:1789708781.034776:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365586304 00000100:00100000:3.0:1789708781.034781:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365586304 00000100:00100000:3.0:1789708781.034800:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708781.034806:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365586560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708781.034850:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365586560:12345-0@lo:400:kworker.0 Request processed in 44us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708781.034858:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708781.034875:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708781.034880:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365586304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708781.034909:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365586304:12345-0@lo:400:kworker.0 Request processed in 29us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708781.034915:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708781.034950:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365586432 00000100:00100000:3.0:1789708781.034954:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365586432 00000100:00100000:3.0:1789708781.034976:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789708781.034981:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365586432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708781.035011:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365586432:12345-0@lo:400:kworker.0 Request processed in 29us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708781.035016:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789708781.035050:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bed0a2cd500 x1876645365586560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708781.035063:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365586560:0@lo:400:kworker.0 00000100:00100000:3.0:1789708781.035084:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365586432:0@lo:400:kworker.0 00010000:00080000:3.0:1789708781.035093:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bed0a2cd180 x1876645365586304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708781.035112:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365586304:0@lo:400:kworker.0 00000100:00100000:0.0:1789708781.035393:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:3617:x1876645365585792:12345-0@lo:400:kworker.0 Request processed in 1327us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708781.035401:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708781.035453:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365585792:0@lo:400:kworker.0 00000100:00100000:0.0:1789708781.035473:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365585920:0@lo:38:kworker.0 00000100:00100000:0.0:1789708781.035500:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708781.035563:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365586048:0@lo:8:kworker.0 00000400:00000100:0.0:1789708781.035581:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365586048 offset 0 length 520: 4 00000100:00100000:0.0:1789708781.035600:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365586176:0@lo:8:kworker.0 00000400:00000100:0.0:1789708781.035615:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365586176 offset 0 length 520: 4 00000100:00100000:3.0:1789708781.035788:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365585920 00000100:00100000:3.0:1789708781.035793:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365585920 00000100:00100000:3.0:1789708781.035880:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708781.035885:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876645365585920:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789708781.035940:0:22863:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:3.0:1789708781.035974:0:22863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ebd2 00000004:00100000:3.0:1789708781.035988:0:22863:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789708781.035993:0:22863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1789708781.051152:0:22863:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa0a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708781.051360:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1876645365585920:12345-0@lo:38:kworker.0 Request processed in 15471us (15857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708781.051371:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789708781.051516:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789708781.051526:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789708781.051531:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789708781.051534:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee30744000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789708781.051546:0:3614:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007783f476): req@ffff9bee3622e680 x1876645365578240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708781.051705:0:22899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708781.051733:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708781.051748:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365578240 00000100:00100000:3.0:1789708781.051754:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365578240 00000100:00100000:3.0:1789708781.051785:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708781.051791:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22899:x1876645365578240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789708781.051855:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22899:x1876645365578240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708781.051861:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708781.051886:0:22899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22899:1876645365578240:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789708781.051922:0:22899:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789708781.051958:0:22899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22899:1876645365586688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789708781.051991:0:22899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708781.052012:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acf240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708781.052021:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365586688 00000100:00100000:3.0:1789708781.052025:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365586688 00000100:00100000:3.0:1789708781.052057:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708781.052063:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22899:x1876645365586688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789708781.052195:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22899:x1876645365586688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 132us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708781.052202:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708781.052224:0:22899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22899:1876645365586688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789708781.052318:0:22899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22899:1876645365586816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789708781.052347:0:22899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708781.052363:0:22899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee030e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708781.052375:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365586816 00000100:00100000:3.0:1789708781.052378:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365586816 00000100:00100000:3.0:1789708781.052395:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708781.052401:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22899:x1876645365586816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789708781.052444:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22899:x1876645365586816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708781.052450:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708781.052472:0:22899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22899:1876645365586816:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789708781.052523:0:22899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708781.054498:0:22899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789708781.054580:0:22899:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 25, retries 0 00000004:00080000:3.0:1789708781.054586:0:22899:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1789708781.054781:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708781.054798:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365586944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708781.054887:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708781.054924:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365586944 00000100:00100000:1.0:1789708781.054931:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365586944 00000100:00100000:1.0:1789708781.054962:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708781.054970:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1876645365586944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789708781.055000:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789708781.055055:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1876645365586944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708781.055062:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708781.055097:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365586944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789708781.055256:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365585920:0@lo:38:kworker.0 00010000:00010000:0.0:1789708781.222440:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789708781.881584:0:23862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789708782.246363:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789708782.607227:0:23914:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708782.607926:0:23914:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789708782.951086:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789708782.951119:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365587072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789708782.951227:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708782.951400:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365587072 00000100:00100000:2.0:1789708782.951411:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365587072 00000100:00100000:2.0:1789708782.951477:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789708782.951487:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365587072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789708782.951533:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789708782.951600:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365587072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708782.951609:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789708782.951671:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365587072:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789708783.270526:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789708783.307510:0:23964:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708783.307720:0:23964:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000080:3.0:1789708784.257057:0:24012:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5f374d30 20000000:00000080:3.0:1789708784.257075:0:24012:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bee40296400 uarg=0000000000000000 20000000:01000000:3.0:1789708784.257159:0:24012:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789708784.257166:0:24012:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789708784.257177:0:24012:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789708784.257825:0:24013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789708784.258056:0:24012:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789708784.272705:0:24012:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789708784.272736:0:24012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708784.272792:0:24012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ea82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ea7b expref: 17 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708784.272801:0:24012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee1103b200/0xf45f43947e47eb85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eb7e expref: 17 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708784.272809:0:24012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708784.272853:0:24012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee1103b200/0xf45f43947e47eb85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47eb7e expref: 17 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708784.272867:0:24012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee1103b200/0xf45f43947e47eb85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47eb7e expref: 17 pid: 22851 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708784.272881:0:24012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24012:1876645365587200:0@lo:104: 00000100:00100000:3.0:1789708784.272945:0:24012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708784.273043:0:24012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ea82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ea7b expref: 17 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708784.273051:0:24012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ea82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ea7b expref: 17 pid: 22851 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708784.273060:0:24012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24012:1876645365587328:0@lo:104: 00000100:00100000:3.0:1789708784.273081:0:24012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708784.279572:0:24012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed01759840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708784.282561:0:22840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365587200 00000100:00100000:0.0:1789708784.282576:0:22840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365587200 00000100:00100000:0.0:1789708784.282630:0:22840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365587328 00000100:00100000:0.0:1789708784.282633:0:22840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365587328 00000100:00100000:0.0:1789708784.282650:0:22840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708784.282661:0:22840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+4:24012:x1876645365587200:12345-0@lo:104: 00010000:00010000:0.0:1789708784.282679:0:22840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.282775:0:22840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708784.282782:0:22840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+4:24012:x1876645365587200:12345-0@lo:104: Request processed in 124us (9838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708784.282789:0:22840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708784.282809:0:22840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708784.282816:0:22840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:24012:x1876645365587328:12345-0@lo:104: 00010000:00010000:0.0:1789708784.282823:0:22840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.282853:0:22840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708784.282858:0:22840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:24012:x1876645365587328:12345-0@lo:104: Request processed in 44us (9777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708784.282864:0:22840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789708784.282890:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708784.282897:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.282905:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9000 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708784.282909:0:22845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.282927:0:22845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708784.282934:0:22845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708784.282940:0:22845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789708784.283044:0:22845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283051:0:22845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708784.283074:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283081:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47eb7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47eb85 expref: -99 pid: 23593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283095:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708784.283099:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283105:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ac00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708784.283107:0:22845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283114:0:22845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708784.283120:0:22845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708784.283133:0:22845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789708784.283149:0:22845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283155:0:22845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708784.283170:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283176:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103ac00/0xf45f43947e47ea7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ea82 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283189:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708784.283190:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708784.283192:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708784.283198:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708784.283206:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708784.283219:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365587456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708784.283283:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708784.283493:0:24012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24012:1876645365587200:0@lo:104: 00000100:00100000:3.0:1789708784.283504:0:24012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24012:1876645365587328:0@lo:104: 00010000:00010000:3.0:1789708784.283524:0:24012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708784.283598:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708784.283607:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365587584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708784.283631:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708784.283664:0:22844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365587456 00000100:00100000:0.0:1789708784.283669:0:22844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365587456 00010000:00010000:0.0:1789708784.283688:0:22844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee1103b200/0xf45f43947e47eb85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47eb7e expref: 18 pid: 22851 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708784.283707:0:22844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365587584 00000100:00100000:0.0:1789708784.283710:0:22844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365587584 00010000:00010000:0.0:1789708784.283719:0:22844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ea82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ea7b expref: 19 pid: 22851 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708784.283740:0:22844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708784.283747:0:22844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:3615:x1876645365587456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708784.283772:0:22844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708784.283779:0:22844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee1103b200/0xf45f43947e47eb85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47eb7e expref: 19 pid: 22851 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283789:0:22844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee1103b200/0xf45f43947e47eb85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47eb7e expref: 19 pid: 22851 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283802:0:22844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee1103b200/0xf45f43947e47eb85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47eb7e expref: 19 pid: 22851 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283814:0:22844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708784.283840:0:22844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:3615:x1876645365587456:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708784.283847:0:22844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708784.283859:0:22844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708784.283864:0:22844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:3618:x1876645365587584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708784.283871:0:22844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708784.283876:0:22844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ea82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ea7b expref: 17 pid: 22851 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283884:0:22844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ea82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ea7b expref: 17 pid: 22851 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283893:0:22844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ea82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ea7b expref: 17 pid: 22851 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283913:0:22844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283922:0:22844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283935:0:22844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283942:0:22844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283949:0:22844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283955:0:22844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283960:0:22844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708784.283964:0:22844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.283972:0:22844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708784.286960:0:24012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708784.286988:0:24012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708784.295739:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708784.297081:0:22844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.297099:0:22844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee1103b800/0xf45f43947e47ebd9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708784.297131:0:22844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708784.297214:0:22844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+16:3618:x1876645365587584:12345-0@lo:103:ldlm_bl.0 Request processed in 13346us (13579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708784.297224:0:22844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708784.297382:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365587456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708784.299852:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365587584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708785.319082:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789708786.023615:0:22855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708786.023623:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee2d93d800 from 13 10000000:01000000:3.0:1789708786.023628:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708786.023680:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708786.023692:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708786.023704:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708786.023730:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365587712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708786.023800:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708786.023852:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708786.023959:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365587712 00000100:00100000:1.0:1789708786.023969:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365587712 00000100:00100000:1.0:1789708786.024034:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789708786.024043:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+16:22855:x1876645365587712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708786.024056:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708786.024068:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee029c9600/0xf45f43947e47ebe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ebe0 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708786.024091:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c9600/0xf45f43947e47ebe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ebe0 expref: 17 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708786.024100:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee029c9600/0xf45f43947e47ebe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ebe0 expref: 17 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708786.024109:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c9600, rc 0) 00000100:00100000:1.0:1789708786.024150:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:22855:x1876645365587712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708786.024156:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789708786.024211:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365587712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708786.024224:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708786.024232:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708786.024312:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365587840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708786.024336:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708786.024353:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708786.024364:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365587840 00000100:00100000:1.0:1789708786.024367:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365587840 00000100:00100000:1.0:1789708786.024394:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789708786.024400:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36242c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:22855:x1876645365587840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708786.024500:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36242c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:22855:x1876645365587840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708786.024507:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789708786.024536:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365587840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708786.024575:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365587968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708786.024612:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708786.024632:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708786.024732:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365587968 00000100:00100000:0.0:1789708786.024737:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365587968 00000100:00100000:0.0:1789708786.024847:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789708786.024855:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36243450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:22855:x1876645365587968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708786.025165:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36243450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:22855:x1876645365587968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 309us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708786.025172:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789708786.027982:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365587968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789708786.035707:0:24112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789708786.035848:0:22855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789708786.035885:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708786.035897:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708786.035909:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708786.035920:0:22855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789708786.035923:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed0343c000 from 13 10000000:01000000:1.0:1789708786.035926:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708786.035976:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708786.035985:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708786.035996:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708786.036031:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365588096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789708786.036093:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708786.036137:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708786.036303:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365588096 00000100:00100000:0.0:1789708786.036311:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365588096 00000100:00100000:0.0:1789708786.036358:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789708786.036367:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+17:22855:x1876645365588096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708786.036381:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708786.036404:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee30492800/0xf45f43947e47ebf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ebee expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708786.036426:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee30492800/0xf45f43947e47ebf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ebee expref: 18 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708786.036436:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee30492800/0xf45f43947e47ebf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ebee expref: 18 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708786.036455:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30492800, rc 0) 00000100:00100000:0.0:1789708786.036494:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:22855:x1876645365588096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708786.036501:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789708786.036709:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365588096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708786.036722:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708786.036730:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708786.036799:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365588224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708786.036825:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708786.036852:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708786.036902:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365588224 00000100:00100000:0.0:1789708786.036907:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365588224 00000100:00100000:0.0:1789708786.036937:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789708786.036952:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36243050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:22855:x1876645365588224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708786.037059:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36243050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:22855:x1876645365588224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708786.037066:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708786.037182:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365588224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708786.037234:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365588352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708786.037349:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708786.037365:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708786.038183:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365588352 00000100:00100000:0.0:1789708786.038190:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365588352 00000100:00100000:0.0:1789708786.038231:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789708786.038238:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee061a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:22855:x1876645365588352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708786.038375:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee061a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:22855:x1876645365588352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708786.038382:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789708786.038482:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365588352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789708786.045662:0:24115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789708786.045897:0:22855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789708786.045937:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708786.046014:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708786.046027:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708786.343370:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708786.541108:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365588480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789708786.541226:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789708786.541357:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708786.541362:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789708786.541365:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708786.541368:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789708786.544201:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708786.544223:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365588864:0@lo:400:kworker.0 00000100:00100000:0.0:1789708786.544403:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365588608:0@lo:400:kworker.0 00000100:00100000:0.0:1789708786.544477:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708786.544522:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708786.544529:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365588736:0@lo:400:kworker.0 00000100:00100000:0.0:1789708786.544556:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708786.544591:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365588608 00000100:00100000:0.0:1789708786.544599:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365588608 00000100:00100000:0.0:1789708786.544643:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789708786.544651:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:3615:x1876645365588608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708786.544701:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:3615:x1876645365588608:12345-0@lo:400:kworker.0 Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708786.544708:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789708786.544740:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365588736 00000100:00100000:0.0:1789708786.544745:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365588736 00000100:00100000:0.0:1789708786.544962:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708786.544970:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365588736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708786.545121:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365588736:12345-0@lo:400:kworker.0 Request processed in 152us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708786.545128:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789708786.545171:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bed098d7480 x1876645365588736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708786.545185:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365588736:0@lo:400:kworker.0 00000100:00100000:0.0:1789708786.545206:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365588608:0@lo:400:kworker.0 00000100:00100000:2.0:1789708786.545545:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708786.545595:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365588480 00000100:00100000:2.0:1789708786.545600:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365588480 00000100:00100000:2.0:1789708786.545624:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365588864 00000100:00100000:2.0:1789708786.545626:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365588864 00000100:00100000:2.0:1789708786.545639:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789708786.545645:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365588480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789708786.545672:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789708786.545713:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365588480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708786.545720:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789708786.545734:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708786.545739:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365588864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708786.545835:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365588864:12345-0@lo:400:kworker.0 Request processed in 96us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708786.545841:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789708786.545922:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365588864:0@lo:400:kworker.0 00000100:00100000:2.0:1789708786.546207:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365588480:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1789708786.546700:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708786.546705:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789708786.546715:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708786.546719:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789708786.546770:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708786.546784:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365588992:0@lo:400:kworker.0 00000100:00100000:1.0:1789708786.546826:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708786.546956:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365588992 00000100:00100000:0.0:1789708786.546969:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365588992 00000100:00100000:0.0:1789708786.547021:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708786.547030:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365588992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708786.547076:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365588992:12345-0@lo:400:kworker.0 Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708786.547083:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789708786.547227:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bed098d7800 x1876645365588992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708786.547292:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365588992:0@lo:400:kworker.0 00000001:00100000:3.0:1789708787.062234:0:23594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789708787.175320:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708777/real 1789708777] req@ffff9bee3622f480 x1876645365582208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708787 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708787.175353:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3622f480 x1876645365582208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708787 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708787.175363:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708777/real 1789708777] req@ffff9bee3fac3480 x1876645365582080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708787 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708787.175375:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3fac3480 x1876645365582080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708787 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789708787.175396:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708787.175611:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789708787.175616:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365582208:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789708787.175622:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa0d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708787.175627:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:2.0:1789708787.175709:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708787.175714:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708787.175717:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708787.175720:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708787.175723:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708787.175726:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789708787.175729:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa0d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708787.175733:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 348 00000100:00080000:2.0:1789708787.175739:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789708787.175749:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bed0aa0d800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708787.175785:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fac2d80 x1876645365589120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708787.175800:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708787.175803:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789708787.175805:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708787.175807:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 348 00000100:00080000:2.0:1789708787.175810:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789708787.175814:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bee04469000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708787.175828:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fac1180 x1876645365589248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789708787.175870:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365582080:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789708787.175900:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365589120:0@lo:8:kworker.0 00000400:00000100:3.0:1789708787.176001:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365589120 offset 0 length 520: 4 00000100:00100000:3.0:1789708787.176051:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365589248:0@lo:8:kworker.0 00000400:00000100:3.0:1789708787.176088:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645365589248 offset 0 length 520: 4 00010000:00010000:0.0:1789708787.367241:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708788.072107:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708788.072134:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365589376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708788.072224:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708788.072287:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365589376 00000100:00100000:1.0:1789708788.072295:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365589376 00000100:00100000:1.0:1789708788.072349:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708788.072357:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365589376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708788.072389:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789708788.072434:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365589376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708788.072442:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708788.072485:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365589376:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789708788.395734:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708789.414989:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708789.415472:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1789708789.930761:0:24361:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789708789.930769:0:24361:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789708789.930771:0:24361:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789708789.931149:0:24361:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bee2f445800 00000020:01000004:3.0:1789708789.931166:0:24361:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789708789.931181:0:24361:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789708789.931196:0:24361:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bed095f8000) 00000020:00000080:3.0:1789708789.931212:0:24361:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789708789.968609:0:24361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789708789.970081:0:24361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789708789.970256:0:24361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789708789.970468:0:24361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789708789.970602:0:24361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789708789.970949:0:24361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789708789.971100:0:24361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1789708789.972644:0:24361:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789708789.972822:0:24361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789708789.972833:0:24361:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789708789.972842:0:24361:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45f43947e47ec03 00000020:01000004:3.0:1789708789.972847:0:24361:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789708789.972864:0:24361:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789708789.972866:0:24361:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789708789.972926:0:24361:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789708789.972933:0:24361:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789708789.972943:0:24361:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bed095f99c0) 00000020:00000080:3.0:1789708789.972952:0:24361:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789708789.974777:0:24361:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789708789.974968:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789708789.974975:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789708789.975740:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789708789.975752:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789708789.976055:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789708789.976060:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789708789.978689:0:24361:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789708789.978867:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789708789.979002:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789708789.979653:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789708789.979660:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789708790.022489:0:24361:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789708790.023016:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789708790.023024:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789708790.027910:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789708790.027925:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789708790.029423:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789708790.029433:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789708790.040255:0:24361:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708790.040902:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789708790.040909:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789708790.041602:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789708790.041610:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789708790.101845:0:24361:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708790.102039:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789708790.102045:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789708790.103671:0:24361:0:(service.c:3474:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789708790.103682:0:24361:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789708790.104162:0:24361:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789708790.104190:0:24361:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789708790.104197:0:24361:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789708790.114838:0:24361:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789708790.114930:0:24361:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789708790.114935:0:24361:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789708790.114937:0:24361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708790.114938:0:24361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708790.114940:0:24361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708790.114941:0:24361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708790.114942:0:24361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708790.114944:0:24361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708790.114945:0:24361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708790.114947:0:24361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789708790.114950:0:24361:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789708790.114952:0:24361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789708790.114954:0:24361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708790.114955:0:24361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708790.114956:0:24361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708790.114957:0:24361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708790.114958:0:24361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708790.114959:0:24361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708790.114964:0:24361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708790.114965:0:24361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789708790.114995:0:24361:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789708790.115014:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365589504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789708790.115082:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708790.115176:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08a91300 going to sleep for 11 seconds 00000100:00100000:1.0:1789708790.115219:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365589504 00000100:00100000:1.0:1789708790.115227:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365589504 00000100:00100000:1.0:1789708790.115358:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789708790.115367:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:24361:x1876645365589504:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789708790.115404:0:22849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789708790.115412:0:22849:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789708790.115416:0:22849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789708790.115824:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:24361:x1876645365589504:12345-0@lo:253:mount.lustre.0 Request processed in 457us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708790.115833:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789708790.115945:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365589504:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789708790.115954:0:24361:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789708790.115956:0:24361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789708790.115958:0:24361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789708790.115959:0:24361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708790.115960:0:24361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708790.115961:0:24361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708790.115962:0:24361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708790.115964:0:24361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708790.115965:0:24361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708790.115966:0:24361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789708790.115990:0:24361:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bee2f445800 from lustre-OST0000 10000000:01000000:2.0:1789708790.116018:0:24361:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789708790.116021:0:24361:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789708790.116029:0:24361:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bed04200000 local copy 00010000:00010000:2.0:1789708790.116039:0:24361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708790.116115:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365589632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708790.116156:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708790.116220:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee10fcfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708790.116272:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365589632 00000100:00100000:1.0:1789708790.116277:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365589632 00000100:00100000:1.0:1789708790.116342:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789708790.116349:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:24361:x1876645365589632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708790.116415:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:24361:x1876645365589632:12345-0@lo:501:mount.lustre.0 Request processed in 67us (259us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789708790.116422:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789708790.116480:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365589632:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789708790.116493:0:24361:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789708790.116509:0:24361:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789708790.116515:0:24361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.116525:0:24361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708790.116549:0:24361:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bee2f445800 10000000:01000000:3.0:1789708790.116553:0:24361:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789708790.116557:0:24361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789708790.116559:0:24361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708790.116563:0:24361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789708790.116567:0:24361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789708790.116586:0:24361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b800/0xf45f43947e47ec11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.116594:0:24361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103b800/0xf45f43947e47ec11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.116611:0:24361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103b800/0xf45f43947e47ec11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708790.116623:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365589760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708790.116648:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.116718:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708790.116805:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365589760 00000100:00100000:2.0:1789708790.116810:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365589760 00000100:00100000:2.0:1789708790.116828:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789708790.116834:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+18:24361:x1876645365589760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708790.116842:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708790.116858:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47ec18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ec11 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708790.116887:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47ec18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ec11 expref: 19 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708790.116898:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebda00/0xf45f43947e47ec18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ec11 expref: 19 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708790.116907:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebda00, rc 0) 00000100:00100000:2.0:1789708790.117020:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365589760:12345-0@lo:101:mount.lustre.0 Request processed in 184us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708790.117026:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789708790.117103:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365589760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708790.117114:0:24361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103b800/0xf45f43947e47ec11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec18 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.117134:0:24361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103b800/0xf45f43947e47ec11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ec18 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708790.118051:0:24361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1789708790.118946:0:24361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708790.120540:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789708790.120583:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789708790.120599:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789708790.120614:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789708790.120627:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789708790.120640:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789708790.120651:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789708790.120663:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789708790.120675:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1789708790.120687:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1789708790.120712:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1789708790.120725:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1789708790.120745:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1789708790.120750:0:24361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1789708790.120865:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365589888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708790.121061:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.121146:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d9233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708790.121187:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365589888 00000100:00100000:2.0:1789708790.121196:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365589888 00000100:00100000:2.0:1789708790.121378:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789708790.121389:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365589888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708790.121655:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365589888:12345-0@lo:501:mount.lustre.0 Request processed in 268us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708790.121663:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789708790.121718:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365589888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708790.121759:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708790.121792:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.121875:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d9233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708790.121995:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365590016 00000100:00100000:1.0:1789708790.122000:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365590016 00000100:00100000:1.0:1789708790.122026:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789708790.122031:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365590016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708790.122863:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365590016:12345-0@lo:503:mount.lustre.0 Request processed in 827us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708790.122882:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789708790.123010:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590016:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789708790.123508:0:24361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708790.123605:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708790.123660:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708790.123690:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708790.123752:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365590144 00000100:00100000:2.0:1789708790.123759:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365590144 00000100:00100000:2.0:1789708790.123792:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789708790.123800:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365590144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708790.124302:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365590144:12345-0@lo:502:mount.lustre.0 Request processed in 501us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708790.124311:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789708790.124532:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708790.124725:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789708790.124748:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789708790.124760:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789708790.124771:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789708790.124782:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789708790.124800:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789708790.124811:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789708790.124822:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789708790.124833:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1789708790.124844:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1789708790.124854:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1789708790.124865:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1789708790.125052:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708790.125099:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708790.125177:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708790.125241:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365590272 00000100:00100000:0.0:1789708790.125248:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365590272 00000100:00100000:2.0:1789708790.125438:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789708790.125453:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365590272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708790.125599:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365590272:12345-0@lo:502:mount.lustre.0 Request processed in 148us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708790.125606:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789708790.125769:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708790.125824:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1789708790.125834:0:24361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789708790.126740:0:24378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789708790.126750:0:24378:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789708790.126757:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.126759:0:24378:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789708790.126767:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789708790.126784:0:24378:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bed09714d40) 00000020:00000080:0.0:1789708790.126809:0:24378:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789708790.126816:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789708790.126915:0:24378:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee2f445800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789708790.126925:0:24378:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789708790.126932:0:24378:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45f43947e47ec26 00010000:00010000:0.0:1789708790.130098:0:24378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1789708790.130955:0:24378:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934601 00080000:10000000:0.0:1789708790.132584:0:24378:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1789708790.133989:0:24378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789708790.134001:0:24378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708790.134007:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.134009:0:24378:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789708790.134012:0:24378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789708790.134015:0:24378:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1789708790.134016:0:24378:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708790.134018:0:24378:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708790.134019:0:24378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789708790.134022:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.134023:0:24378:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789708790.134031:0:24378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708790.134034:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.134036:0:24378:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789708790.134039:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789708790.134041:0:24378:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789708790.134043:0:24378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708790.134045:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.134047:0:24378:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789708790.134049:0:24378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708790.134051:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.134052:0:24378:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789708790.134055:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789708790.134078:0:24378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708790.134081:0:24378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.134082:0:24378:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789708790.134085:0:24378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1789708790.140376:0:24361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789708790.140440:0:24361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789708790.140468:0:24361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b800/0xf45f43947e47ec11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec18 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.140482:0:24361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103b800/0xf45f43947e47ec11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec18 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708790.140515:0:24361:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee2f445800 from 1 10000000:01000000:3.0:1789708790.140519:0:24361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708790.140556:0:24361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.140565:0:24361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.140575:0:24361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708790.140613:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708790.140677:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.140711:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708790.141466:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365590400 00000100:00100000:2.0:1789708790.141477:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365590400 00000100:00100000:2.0:1789708790.141563:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789708790.141574:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365590400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708790.141589:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708790.141603:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ec34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ec2d expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708790.141628:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ec34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ec2d expref: 20 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708790.141639:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ec34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ec2d expref: 20 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708790.141649:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc800, rc 0) 00000100:00100000:2.0:1789708790.141699:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:24361:x1876645365590400:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708790.141706:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789708790.143442:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708790.143465:0:24361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.143477:0:24361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708790.144837:0:24361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789708790.145107:0:24361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708790.145304:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789708790.145327:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789708790.145339:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789708790.145351:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789708790.145362:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789708790.145373:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789708790.145384:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789708790.145395:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789708790.145405:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789708790.145417:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789708790.145430:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789708790.145458:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789708790.145464:0:24361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789708790.145540:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708790.145604:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.145644:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d9233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708790.145761:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365590528 00000100:00100000:0.0:1789708790.145768:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365590528 00000100:00100000:0.0:1789708790.145805:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789708790.145814:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:24361:x1876645365590528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708790.145921:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:24361:x1876645365590528:12345-0@lo:501:mount.lustre.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708790.145929:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789708790.146035:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708790.146070:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708790.146106:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.146161:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d9233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708790.146221:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365590656 00000100:00100000:1.0:1789708790.146226:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365590656 00000100:00100000:1.0:1789708790.146244:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789708790.146250:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:24361:x1876645365590656:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708790.146344:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:24361:x1876645365590656:12345-0@lo:503:mount.lustre.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708790.146351:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789708790.146420:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590656:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789708790.146714:0:24361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789708790.146771:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708790.146808:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.146840:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708790.146893:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365590784 00000100:00100000:1.0:1789708790.146898:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365590784 00000100:00100000:1.0:1789708790.146919:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789708790.146924:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:24361:x1876645365590784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708790.147013:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:24361:x1876645365590784:12345-0@lo:502:mount.lustre.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708790.147021:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789708790.147145:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708790.147312:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789708790.147335:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789708790.147348:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789708790.147360:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789708790.147373:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789708790.147387:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789708790.147401:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789708790.147415:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789708790.147429:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789708790.147443:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789708790.147456:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789708790.147478:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708790.147511:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.147528:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2d923180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708790.147589:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365590912 00000100:00100000:2.0:1789708790.147594:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365590912 00000100:00100000:2.0:1789708790.147617:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789708790.147624:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:24361:x1876645365590912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708790.147823:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:24361:x1876645365590912:12345-0@lo:502:mount.lustre.0 Request processed in 199us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708790.147839:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789708790.148029:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365590912:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708790.148066:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1789708790.148077:0:24361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789708790.148793:0:24382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708790.148803:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.148805:0:24382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789708790.148812:0:24382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee2f445800 00000020:00000080:0.0:1789708790.148815:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708790.148822:0:24382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708790.148824:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.148826:0:24382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789708790.148828:0:24382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708790.148836:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.148837:0:24382:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789708790.148841:0:24382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee2f445800 00000020:00000080:0.0:1789708790.148843:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708790.148990:0:24382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708790.148995:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.148997:0:24382:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789708790.148999:0:24382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708790.149002:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.149003:0:24382:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789708790.149007:0:24382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee2f445800 00000020:00000080:0.0:1789708790.149009:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708790.159231:0:24382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708790.159278:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.159281:0:24382:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789708790.159286:0:24382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708790.159291:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.159292:0:24382:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789708790.159297:0:24382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee2f445800 00000020:00000080:0.0:1789708790.159300:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708790.159360:0:24382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708790.159364:0:24382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708790.159365:0:24382:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789708790.159369:0:24382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1789708790.160986:0:24361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789708790.161035:0:24361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708790.161054:0:24361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.161069:0:24361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708790.161147:0:24361:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789708790.161156:0:24361:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bee2f445800 10000000:01000000:0.0:1789708790.161160:0:24361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bee2f445800 10000000:01000000:0.0:1789708790.161164:0:24361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789708790.161170:0:24361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee2f445800 from 1 10000000:01000000:0.0:1789708790.161173:0:24361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789708790.161210:0:24361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492200/0xf45f43947e47ec3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.161219:0:24361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee30492200/0xf45f43947e47ec3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.161230:0:24361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee30492200/0xf45f43947e47ec3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708790.161253:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708790.161334:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708790.161374:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08a919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708790.162311:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365591040 00000100:00100000:1.0:1789708790.162333:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365591040 00000100:00100000:1.0:1789708790.162387:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789708790.162397:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:24361:x1876645365591040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708790.162413:0:22849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708790.162427:0:22849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee029c8e00/0xf45f43947e47ec42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ec3b expref: -99 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708790.162725:0:22849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c8e00/0xf45f43947e47ec42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ec3b expref: 21 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708790.162737:0:22849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee029c8e00/0xf45f43947e47ec42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ec3b expref: 21 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708790.162746:0:22849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8e00, rc 0) 00000100:00100000:1.0:1789708790.162796:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591040:12345-0@lo:101:mount.lustre.0 Request processed in 401us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708790.162803:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789708790.164053:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708790.164074:0:24361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee30492200/0xf45f43947e47ec3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec42 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.164085:0:24361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee30492200/0xf45f43947e47ec3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ec42 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708790.168812:0:24361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789708790.169141:0:24361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708790.169348:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789708790.169373:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789708790.169389:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789708790.169403:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789708790.169428:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789708790.169455:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789708790.169470:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789708790.169484:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789708790.169498:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789708790.169511:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789708790.169526:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789708790.169539:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789708790.169554:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789708790.169567:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789708790.169581:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789708790.169596:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789708790.169609:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789708790.169623:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789708790.169635:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789708790.169648:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789708790.169662:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789708790.169688:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789708790.169704:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789708790.169719:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789708790.169731:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789708790.169744:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789708790.169756:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789708790.169768:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789708790.169780:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789708790.169793:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789708790.169806:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789708790.169818:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789708790.169832:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789708790.169845:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789708790.169859:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789708790.169873:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789708790.169886:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789708790.169919:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789708790.169935:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789708790.169948:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789708790.169962:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789708790.169974:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789708790.169985:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789708790.169996:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789708790.170008:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789708790.170019:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789708790.170030:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789708790.170042:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789708790.170182:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789708790.170200:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789708790.170213:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789708790.170218:0:24361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789708790.170330:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708790.170395:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708790.170440:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365591168 00000100:00100000:0.0:1789708790.170448:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365591168 00000100:00100000:0.0:1789708790.170501:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789708790.170511:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708790.170615:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591168:12345-0@lo:501:mount.lustre.0 Request processed in 104us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708790.170623:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789708790.170664:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08a91300 going to sleep for 11 seconds 00000100:00100000:0.0:1789708790.170687:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708790.170725:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708790.170766:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708790.170796:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08a91300 going to sleep for 11 seconds 00000100:00100000:1.0:1789708790.170941:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365591296 00000100:00100000:1.0:1789708790.170946:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365591296 00000100:00100000:1.0:1789708790.170976:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789708790.170984:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708790.171067:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591296:12345-0@lo:503:mount.lustre.0 Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708790.171074:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789708790.173232:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591296:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789708790.174220:0:24361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708790.174344:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708790.174416:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708790.177298:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365591424 00000100:00100000:1.0:1789708790.177312:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365591424 00000100:00100000:1.0:1789708790.177359:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789708790.177369:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708790.177539:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591424:12345-0@lo:502:mount.lustre.0 Request processed in 171us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708790.177547:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789708790.178797:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708790.178830:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708790.179336:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789708790.179370:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789708790.179387:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789708790.179402:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789708790.179416:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789708790.179430:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789708790.179444:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789708790.179472:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789708790.179488:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789708790.179502:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789708790.179516:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789708790.179528:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789708790.179541:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789708790.179553:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789708790.179565:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789708790.179576:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789708790.179588:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789708790.179599:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789708790.179611:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789708790.179623:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789708790.179637:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789708790.179650:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789708790.179663:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789708790.179689:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789708790.179704:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789708790.179726:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789708790.179737:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789708790.179748:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789708790.179761:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789708790.179772:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789708790.179785:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789708790.179799:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789708790.179813:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789708790.179827:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789708790.179842:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789708790.179857:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789708790.179946:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789708790.179966:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789708790.179980:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789708790.180006:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789708790.180020:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789708790.180034:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789708790.180047:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789708790.180061:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789708790.180075:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789708790.180089:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789708790.180102:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789708790.180116:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789708790.180186:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708790.180283:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708790.180320:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acf780 going to sleep for 11 seconds 00000100:00100000:0.0:1789708790.183426:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365591552 00000100:00100000:0.0:1789708790.183442:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365591552 00000100:00100000:0.0:1789708790.183512:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789708790.183521:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708790.183707:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591552:12345-0@lo:502:mount.lustre.0 Request processed in 186us (3444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708790.183714:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789708790.185052:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708790.185292:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789708790.185318:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789708790.185352:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708790.185423:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708790.185459:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ed9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708790.186390:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365591680 00000100:00100000:2.0:1789708790.186400:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365591680 00000100:00100000:2.0:1789708790.186526:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789708790.186536:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708790.186682:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365591680:12345-0@lo:502:mount.lustre.0 Request processed in 146us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708790.186689:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789708790.186772:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365591680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708790.186825:0:24361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789708790.186834:0:24361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789708790.193570:0:24387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789708790.193588:0:24387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bed097119c0) 00000020:00000080:0.0:1789708790.193614:0:24387:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789708790.193706:0:24387:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee2f445800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789708790.193711:0:24387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee2f445800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789708790.193713:0:24387:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee2f445800 3 00010000:00080000:0.0:1789708790.193746:0:24387:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed03052800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1789708790.198677:0:24387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789708790.198963:0:24387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789708790.199011:0:24387:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789708790.199023:0:24387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf45f43947e47ec50 00000100:00080000:0.0:1789708790.199033:0:24387:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708790.199045:0:24387:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bed03052800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708790.199080:0:24387:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3622f480 x1876645365591808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708790.199116:0:24387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789708790.199337:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365591808:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789708790.199408:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708790.199528:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365591808 00000100:00100000:1.0:1789708790.199536:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365591808 00000100:00100000:1.0:1789708790.199607:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708790.199615:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365591808:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789708790.199639:0:22857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 361 last 0 00000100:00080000:2.0:1789708790.199649:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708790.199653:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708790.199656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708790.199659:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708790.199674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708790.199677:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708790.199679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1789708790.199679:0:22857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf45f43947e47ec57 00000100:00080000:2.0:1789708790.199682:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00100000:1.0:1789708790.199693:0:22857:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789708790.199725:0:22857:0:(import.c:65:import_set_state_nolock()) ffff9bed02d3d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708790.199785:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876645365591808:12345-0@lo:38:llog_process_th.0 Request processed in 168us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708790.199792:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789708790.199982:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bee3622f480 x1876645365591808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708790.199993:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708790.199999:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789708790.200005:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789708790.200009:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789708790.200011:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed03052800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789708790.200016:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876645365591808:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708790.200300:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365592320:0@lo:400:kworker.0 00000100:00100000:3.0:1789708790.200336:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.200360:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789708790.200366:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365591936:0@lo:400:kworker.0 00000100:00100000:3.0:1789708790.200391:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.200415:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365592448:0@lo:400:kworker.0 00000100:00100000:3.0:1789708790.200436:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.200460:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365591936 00000100:00100000:3.0:1789708790.200465:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365591936 00000100:00100000:0.0:1789708790.200962:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365592320 00000100:00100000:0.0:1789708790.200967:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365592320 00000100:00100000:0.0:1789708790.200994:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708790.201001:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365592320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708790.201052:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365592320:12345-0@lo:400:kworker.0 Request processed in 51us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708790.201059:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708790.201877:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365592064:0@lo:400:kworker.0 00000100:00100000:2.0:1789708790.201921:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708790.201954:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789708790.201961:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365592192:0@lo:400:kworker.0 00000100:00100000:2.0:1789708790.201985:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708790.202021:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365592064 00000100:00100000:3.0:1789708790.202026:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789708790.202026:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365592064 00000100:00100000:3.0:1789708790.202036:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3615:x1876645365591936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708790.202058:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789708790.202063:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365592064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708790.202072:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3615:x1876645365591936:12345-0@lo:400:kworker.0 Request processed in 39us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708790.202078:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789708790.202107:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365592448 00000100:00100000:2.0:1789708790.202108:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365592064:12345-0@lo:400:kworker.0 Request processed in 44us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708790.202110:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365592448 00000100:00100000:2.0:1789708790.202115:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708790.202145:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365592192 00000100:00100000:3.0:1789708790.202148:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365592192 00000100:00100000:2.0:1789708790.202149:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708790.202154:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365592448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708790.202160:0:22859:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789708790.202167:0:22859:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789708790.202184:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365592448:12345-0@lo:400:kworker.0 Request processed in 30us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708790.202190:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708790.202202:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789708790.202207:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365592192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708790.202232:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365592192:12345-0@lo:400:kworker.0 Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708790.202237:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789708790.202283:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bee3fac1880 x1876645365592192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708790.202296:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365592192:0@lo:400:kworker.0 00000100:00100000:3.0:1789708790.202304:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365591936:0@lo:400:kworker.0 00000100:00100000:2.0:1789708790.202306:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365592064:0@lo:400:kworker.0 00010000:00080000:3.0:1789708790.202316:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bee3fac3480 x1876645365592448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708790.202324:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365592448:0@lo:400:kworker.0 00000100:00100000:3.0:1789708790.202334:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365592320:0@lo:400:kworker.0 00000020:01000004:3.0:1789708790.204452:0:24387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789708790.204470:0:24387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9bed095fcd40) 00000020:00000080:3.0:1789708790.204494:0:24387:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789708790.204575:0:24387:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee2f445800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789708790.204580:0:24387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee2f445800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789708790.204582:0:24387:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee2f445800 3 00010000:00080000:3.0:1789708790.204612:0:24387:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed07d3a000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789708790.209547:0:24387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789708790.210712:0:24387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789708790.210763:0:24387:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789708790.210837:0:24387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf45f43947e47ec65 00000100:00080000:3.0:1789708790.210847:0:24387:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708790.210858:0:24387:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9bed07d3a000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708790.210907:0:24387:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee086a4700 x1876645365592576/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789708790.210944:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876645365592576:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708790.211001:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.211056:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365592576 00000100:00100000:3.0:1789708790.211063:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365592576 00000100:00100000:3.0:1789708790.211089:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708790.211096:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876645365592576:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789708790.211120:0:22858:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:3.0:1789708790.211174:0:22858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf45f43947e47ec6c 00000004:00100000:3.0:1789708790.211186:0:22858:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789708790.211212:0:22858:0:(import.c:65:import_set_state_nolock()) ffff9bed0320b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708790.211256:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876645365592576:12345-0@lo:38:llog_process_th.0 Request processed in 158us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708790.211295:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789708790.211327:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bee086a4700 x1876645365592576/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708790.211337:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789708790.211343:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789708790.211348:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789708790.211352:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789708790.211354:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed07d3a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789708790.211359:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876645365592576:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789708790.211398:0:24387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789708790.211417:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708790.211421:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708790.211424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708790.211427:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708790.211430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708790.211433:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708790.211435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708790.211437:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789708790.212581:0:24387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1789708790.212716:0:24361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789708790.212758:0:24361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789708790.212781:0:24361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492200/0xf45f43947e47ec3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec42 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708790.212794:0:24361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee30492200/0xf45f43947e47ec3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec42 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789708790.212841:0:24361:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789708790.212843:0:24361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789708790.212844:0:24361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708790.212846:0:24361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708790.212847:0:24361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708790.212848:0:24361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708790.212850:0:24361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708790.212851:0:24361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708790.212853:0:24361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708790.212857:0:24361:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789708790.212859:0:24361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708790.212860:0:24361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789708790.212861:0:24361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708790.212862:0:24361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708790.212864:0:24361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708790.212874:0:24361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708790.212875:0:24361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708790.212876:0:24361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708790.212877:0:24361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708790.212919:0:24361:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789708790.212935:0:24361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365592704:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789708790.212989:0:24361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708790.219138:0:24361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04e9d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708790.219241:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365592704 00000100:00100000:2.0:1789708790.219250:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365592704 00000100:00100000:2.0:1789708790.219322:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789708790.219331:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:24361:x1876645365592704:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789708790.219363:0:22851:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789708790.219377:0:22851:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789708790.224701:0:22851:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789708790.224716:0:22851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789708790.224785:0:22873:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789708790.224790:0:22873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789708790.224814:0:22873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.224834:0:22873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47ebbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ebb6 expref: 21 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.224843:0:22873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee1103ae00/0xf45f43947e47ebcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ebc4 expref: 21 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.224851:0:22873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.224908:0:22873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee1103ae00/0xf45f43947e47ebcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ebc4 expref: 21 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.224936:0:22873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee1103ae00/0xf45f43947e47ebcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ebc4 expref: 21 pid: 22851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708790.224953:0:22873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365592832:0@lo:104: 00000100:00100000:0.0:1789708790.225018:0:22873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708790.225077:0:22873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47ebbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ebb6 expref: 21 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225087:0:22873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47ebbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ebb6 expref: 21 pid: 22851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708790.225095:0:22873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365592960:0@lo:104: 00000100:00100000:0.0:1789708790.225120:0:22873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708790.225155:0:22873:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08a919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708790.225189:0:22841:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789708790.225207:0:22841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365592832 00000100:00100000:0.0:1789708790.225214:0:22841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365592832 00000100:00100000:0.0:1789708790.225249:0:22841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365592960 00000100:00100000:0.0:1789708790.225252:0:22841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365592960 00000100:00100000:0.0:1789708790.225305:0:22841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708790.225314:0:22841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+4:22873:x1876645365592832:12345-0@lo:104: 00010000:00010000:0.0:1789708790.225327:0:22841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225377:0:22841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708790.225382:0:22841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+4:22873:x1876645365592832:12345-0@lo:104: Request processed in 70us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708790.225389:0:22841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708790.225416:0:22841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708790.225423:0:22841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed01641850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:22873:x1876645365592960:12345-0@lo:104: 00010000:00010000:0.0:1789708790.225431:0:22841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225465:0:22841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708790.225470:0:22841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed01641850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:22873:x1876645365592960:12345-0@lo:104: Request processed in 49us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708790.225475:0:22841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789708790.225524:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708790.225530:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225538:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8000 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708790.225541:0:22845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225550:0:22845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708790.225557:0:22845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708790.225563:0:22845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708790.225592:0:22845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225598:0:22845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708790.225614:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225632:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee029c8000/0xf45f43947e47ebc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebcb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225645:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708790.225648:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225654:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493e00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708790.225657:0:22845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225664:0:22845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708790.225671:0:22845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708790.225676:0:22845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708790.225690:0:22845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225696:0:22845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708790.225702:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225708:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee30493e00/0xf45f43947e47ebb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebbd expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708790.225719:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708790.225725:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708790.225727:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708790.225734:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708790.225764:0:22873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365592832:0@lo:104: 00000100:00100000:0.0:1789708790.225773:0:22873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365592960:0@lo:104: 00010000:00010000:0.0:1789708790.225790:0:22873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708790.226159:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365593088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708790.226199:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708790.226243:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789708790.226249:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365593216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708790.226297:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708790.226383:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365593088 00000100:00100000:3.0:1789708790.226389:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365593088 00010000:00010000:3.0:1789708790.226414:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee1103ae00/0xf45f43947e47ebcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ebc4 expref: 22 pid: 22851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708790.226448:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365593216 00000100:00100000:3.0:1789708790.226452:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365593216 00010000:00010000:3.0:1789708790.226465:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47ebbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ebb6 expref: 23 pid: 22851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708790.226477:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708790.226484:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:3617:x1876645365593088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708790.226495:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708790.226500:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee1103ae00/0xf45f43947e47ebcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ebc4 expref: 23 pid: 22851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226510:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee1103ae00/0xf45f43947e47ebcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ebc4 expref: 23 pid: 22851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226524:0:22842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee1103ae00/0xf45f43947e47ebcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ebc4 expref: 23 pid: 22851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226536:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708790.226574:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:3617:x1876645365593088:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708790.226580:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708790.226593:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708790.226599:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3617:x1876645365593216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708790.226607:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708790.226611:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47ebbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ebb6 expref: 21 pid: 22851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226619:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47ebbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ebb6 expref: 21 pid: 22851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226635:0:22842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47ebbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ebb6 expref: 21 pid: 22851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226646:0:22842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226655:0:22842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789708790.226671:0:22842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024365707s 00010000:00010000:3.0:1789708790.226676:0:22842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226683:0:22842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226690:0:22842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226697:0:22842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226703:0:22842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708790.226707:0:22842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226715:0:22842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226730:0:22842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226746:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708790.226769:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:3617:x1876645365593216:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708790.226776:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789708790.226825:0:22873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226833:0:22873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708790.226840:0:22873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee30493200/0xf45f43947e47ec73 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708790.227030:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365593216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708790.227041:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365593088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708790.227348:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:24361:x1876645365592704:12345-0@lo:253:mount.lustre.0 Request processed in 8018us (14358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708790.227357:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789708790.227490:0:24361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:24361:1876645365592704:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789708790.227501:0:24361:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789708790.227505:0:24361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708790.227507:0:24361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789708790.227508:0:24361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708790.227510:0:24361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708790.227511:0:24361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708790.227512:0:24361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708790.227514:0:24361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708790.227516:0:24361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708790.227517:0:24361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789708790.227539:0:24361:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1789708790.245079:0:24361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:0.0:1789708790.248390:0:23614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00002000:00080000:1.0:1789708790.255558:0:24361:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789708790.255568:0:24361:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789708790.255610:0:24361:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789708790.255662:0:24361:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789708790.255706:0:24361:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789708790.255734:0:24361:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789708790.256567:0:24361:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708790.259196:0:24361:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789708790.438953:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789708791.022623:0:24441:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708791.022850:0:24441:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708791.464947:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708791.655389:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365593344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789708791.655456:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708791.655519:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365593344 00000100:00100000:2.0:1789708791.655528:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365593344 00000100:00100000:2.0:1789708791.655568:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789708791.655575:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365593344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789708791.655607:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789708791.655648:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365593344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708791.655655:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789708791.655699:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365593344:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1789708791.783479:0:22855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708791.783486:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee2d93d800 from 13 10000000:01000000:3.0:1789708791.783491:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708791.783531:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.783552:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.783563:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708791.783588:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365593472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708791.783650:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708791.783684:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708791.783738:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365593472 00000100:00100000:3.0:1789708791.783745:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365593472 00000100:00100000:3.0:1789708791.783796:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789708791.783805:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+19:22855:x1876645365593472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708791.783817:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708791.783829:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee1103ac00/0xf45f43947e47ec81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ec7a expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.784901:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee1103ac00/0xf45f43947e47ec81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ec7a expref: 20 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.784915:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee1103ac00/0xf45f43947e47ec81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ec7a expref: 20 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.784925:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103ac00, rc 0) 00000100:00100000:3.0:1789708791.784972:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:22855:x1876645365593472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1167us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708791.784980:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789708791.785037:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365593472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708791.785051:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.785061:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708791.785122:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365593600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789708791.785208:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708791.785234:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708791.785247:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365593600 00000100:00100000:3.0:1789708791.785252:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365593600 00000100:00100000:3.0:1789708791.785304:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789708791.785312:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:22855:x1876645365593600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789708791.785327:0:22851:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789708791.785341:0:22851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789708791.785344:0:22851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1789708791.785407:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:22855:x1876645365593600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708791.785414:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789708791.785450:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365593600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789708791.785500:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708791.785507:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.785515:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708791.785532:0:22855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708791.785534:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bed0343c000 from 13 10000000:01000000:3.0:1789708791.785537:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708791.785552:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.785559:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.785567:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708791.785578:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365593728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708791.785601:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708791.785617:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708791.785627:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365593728 00000100:00100000:3.0:1789708791.785630:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365593728 00000100:00100000:3.0:1789708791.785648:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789708791.785653:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:22855:x1876645365593728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708791.785661:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708791.785670:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee1103a800/0xf45f43947e47ec8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ec88 expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.785683:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee1103a800/0xf45f43947e47ec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ec88 expref: 21 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.785691:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee1103a800/0xf45f43947e47ec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ec88 expref: 21 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.785706:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103a800, rc 0) 00000100:00100000:3.0:1789708791.785731:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:22855:x1876645365593728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708791.785737:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789708791.785761:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365593728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708791.785771:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.785778:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708791.785812:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365593856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789708791.786082:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708791.786149:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708791.786236:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365593856 00000100:00100000:1.0:1789708791.786242:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365593856 00000100:00100000:1.0:1789708791.786357:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789708791.786365:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:22855:x1876645365593856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789708791.786377:0:22849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789708791.786388:0:22849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789708791.786392:0:22849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1789708791.786454:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:22855:x1876645365593856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708791.786461:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789708791.786580:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365593856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789708791.786619:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708791.786624:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708791.786632:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708792.490322:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708793.190581:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708793.190603:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365593984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708793.190666:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708793.190750:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365593984 00000100:00100000:1.0:1789708793.190758:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365593984 00000100:00100000:1.0:1789708793.190807:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708793.190816:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365593984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708793.190847:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789708793.190887:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365593984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708793.190894:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789708793.190974:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365593984:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789708793.513361:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708794.536312:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708795.168549:0:24730:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1789708795.238643:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708795.238648:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708795.238651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708795.238662:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708795.238688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708795.238691:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708795.238694:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708795.238697:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789708795.238751:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365594112:0@lo:400:kworker.0 00000100:00100000:2.0:1789708795.238833:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708795.238873:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365594624:0@lo:400:kworker.0 00000100:00100000:2.0:1789708795.238902:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708795.238926:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789708795.238933:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365594240:0@lo:400:kworker.0 00000100:00100000:2.0:1789708795.238958:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708795.238977:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365594752:0@lo:400:kworker.0 00000100:00100000:2.0:1789708795.239003:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708795.239043:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365594368:0@lo:400:kworker.0 00000100:00100000:2.0:1789708795.239067:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708795.239084:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365594880:0@lo:400:kworker.0 00000100:00100000:2.0:1789708795.239124:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708795.239142:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708795.239147:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365594496:0@lo:400:kworker.0 00000100:00100000:2.0:1789708795.239168:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708795.239199:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365594240 00000100:00100000:2.0:1789708795.239207:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365594240 00000100:00100000:2.0:1789708795.239246:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365594496 00000100:00100000:2.0:1789708795.239250:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365594496 00000100:00100000:2.0:1789708795.239312:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708795.239320:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365594240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708795.239374:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365594240:12345-0@lo:400:kworker.0 Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708795.239380:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708795.239406:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708795.239412:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365594496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708795.239441:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365594496:12345-0@lo:400:kworker.0 Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708795.239448:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708795.239483:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365594496:0@lo:400:kworker.0 00000100:00100000:2.0:1789708795.239511:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365594240:0@lo:400:kworker.0 00000100:00100000:3.0:1789708795.239711:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365594112 00000100:00100000:3.0:1789708795.239722:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365594112 00000100:00100000:3.0:1789708795.239760:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789708795.239767:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3617:x1876645365594112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708795.239815:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3617:x1876645365594112:12345-0@lo:400:kworker.0 Request processed in 49us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708795.239821:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789708795.239846:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365594624 00000100:00100000:3.0:1789708795.239849:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365594624 00000100:00100000:3.0:1789708795.239867:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365594752 00000100:00100000:3.0:1789708795.239869:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365594752 00000100:00100000:3.0:1789708795.239897:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365594368 00000100:00100000:3.0:1789708795.239900:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365594368 00000100:00100000:3.0:1789708795.239910:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365594880 00000100:00100000:3.0:1789708795.239912:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365594880 00000100:00100000:3.0:1789708795.239926:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708795.239931:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365594624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708795.239962:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365594624:12345-0@lo:400:kworker.0 Request processed in 30us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708795.239968:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708795.239980:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789708795.239985:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365594752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708795.240012:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365594752:12345-0@lo:400:kworker.0 Request processed in 27us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708795.240018:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789708795.240041:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789708795.240048:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365594368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708795.240080:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365594368:12345-0@lo:400:kworker.0 Request processed in 33us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708795.240093:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789708795.240106:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708795.240111:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365594880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708795.240139:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365594880:12345-0@lo:400:kworker.0 Request processed in 29us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708795.240146:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789708795.240181:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed09ab0e00 x1876645365594368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708795.240191:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365594368:0@lo:400:kworker.0 00010000:00080000:3.0:1789708795.240203:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed09ab0000 x1876645365594880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708795.240212:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365594880:0@lo:400:kworker.0 00010000:00080000:3.0:1789708795.240241:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed09ab3800 x1876645365594752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708795.240250:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365594752:0@lo:400:kworker.0 00000100:00100000:3.0:1789708795.240283:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365594112:0@lo:400:kworker.0 00010000:00080000:3.0:1789708795.240296:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bed09ab3480 x1876645365594624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708795.240304:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365594624:0@lo:400:kworker.0 00000100:00080000:0.0:1789708795.241691:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789708795.241699:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789708795.561377:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789708795.941670:0:24784:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708795.941896:0:24784:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789708796.583384:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708796.774445:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708796.774469:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365595008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789708796.774540:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708796.774597:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365595008 00000100:00100000:2.0:1789708796.774606:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365595008 00000100:00100000:2.0:1789708796.774651:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789708796.774659:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365595008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789708796.774693:0:22863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789708796.774750:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365595008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708796.774757:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789708796.774818:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365595008:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789708796.881622:0:24834:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708796.882246:0:24834:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789708797.606418:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708798.311103:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365595136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789708798.311186:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708798.311409:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365595136 00000100:00100000:0.0:1789708798.311418:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365595136 00000100:00100000:0.0:1789708798.311474:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789708798.311483:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365595136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789708798.311516:0:22863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789708798.311578:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365595136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708798.311585:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789708798.311722:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365595136:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789708798.635211:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708799.655158:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708799.655850:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1789708800.358517:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708800.358535:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708800.358539:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708800.358543:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708800.358564:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708800.358568:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789708800.358570:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708800.358574:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789708800.358617:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365595648:0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.358693:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708800.358760:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789708800.358766:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365595264:0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.358798:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708800.358822:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365595776:0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.358847:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708800.358872:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365595392:0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.358893:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708800.358910:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365595904:0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.358929:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708800.358958:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789708800.358964:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365595520:0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.358984:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708800.358999:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365596032:0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359032:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708800.359064:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365595648 00000100:00100000:3.0:1789708800.359072:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365595648 00000100:00100000:3.0:1789708800.359104:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365595392 00000100:00100000:3.0:1789708800.359107:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365595392 00000100:00100000:3.0:1789708800.359122:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789708800.359130:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365595648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359185:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365595648:12345-0@lo:400:kworker.0 Request processed in 56us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708800.359193:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789708800.359210:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789708800.359217:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365595392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359251:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365595392:12345-0@lo:400:kworker.0 Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708800.359284:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789708800.359304:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365595264 00000100:00100000:3.0:1789708800.359308:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365595264 00000100:00100000:3.0:1789708800.359331:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789708800.359337:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3617:x1876645365595264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359367:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3617:x1876645365595264:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708800.359374:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789708800.359398:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365595776 00000100:00100000:3.0:1789708800.359402:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365595776 00000100:00100000:3.0:1789708800.359419:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365595904 00000100:00100000:3.0:1789708800.359422:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365595904 00000100:00100000:3.0:1789708800.359446:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365595520 00000100:00100000:3.0:1789708800.359448:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365595520 00000100:00100000:3.0:1789708800.359469:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365596032 00000100:00100000:3.0:1789708800.359472:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365596032 00000100:00100000:3.0:1789708800.359486:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708800.359491:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365595776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359522:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365595776:12345-0@lo:400:kworker.0 Request processed in 29us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708800.359528:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708800.359539:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708800.359545:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365595904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359574:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365595904:12345-0@lo:400:kworker.0 Request processed in 28us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708800.359580:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708800.359591:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708800.359596:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365595520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359621:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365595520:12345-0@lo:400:kworker.0 Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708800.359627:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708800.359638:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789708800.359644:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365596032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359669:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365596032:12345-0@lo:400:kworker.0 Request processed in 26us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708800.359674:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789708800.359706:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708800.359710:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789708800.359733:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee086a5f80 x1876645365595520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708800.359759:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365595520:0@lo:400:kworker.0 00010000:00080000:3.0:1789708800.359774:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee086a4e00 x1876645365596032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708800.359783:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365596032:0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359793:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365595392:0@lo:400:kworker.0 00010000:00080000:3.0:1789708800.359803:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee086a5880 x1876645365595904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708800.359811:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365595904:0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359845:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365595264:0@lo:400:kworker.0 00010000:00080000:3.0:1789708800.359855:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee086a5c00 x1876645365595776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708800.359863:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365595776:0@lo:400:kworker.0 00000100:00100000:3.0:1789708800.359872:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365595648:0@lo:400:kworker.0 00000040:00080000:1.0:1789708800.486870:0:23614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789708800.680068:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708801.510389:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708781/real 1789708781] req@ffff9bed0a2cca80 x1876645365586048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708801 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708801.510433:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bed0a2cca80 x1876645365586048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708801 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708801.510444:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708781/real 1789708781] req@ffff9bed0a2cf480 x1876645365586176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708801 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708801.510457:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bed0a2cf480 x1876645365586176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708801 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789708801.510483:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa71000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708801.510569:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789708801.510574:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365586048:0@lo:8:kworker.0 00000100:00080000:2.0:1789708801.510581:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708801.510716:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708801.510722:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789708801.510725:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa71000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708801.510732:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 351 00000100:00080000:3.0:1789708801.510739:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789708801.510755:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bed0aa71000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708801.510778:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee086a4700 x1876645365596416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789708801.510778:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365596288:0@lo:400:kworker.0 00000100:00080000:3.0:1789708801.510822:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708801.510825:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789708801.510827:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789708801.510832:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 351 00000100:00080000:3.0:1789708801.510836:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789708801.510842:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bed08562000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708801.510858:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee086a5880 x1876645365596544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789708801.510893:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789708801.510910:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708801.510953:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789708801.510955:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1789708801.510957:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789708801.510963:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789708801.510968:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365596160:0@lo:400:kworker.0 00000100:00100000:1.0:1789708801.511014:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708801.511048:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365596672:0@lo:400:kworker.0 00000100:00100000:1.0:1789708801.511071:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365597056:0@lo:400:kworker.0 00000100:00100000:3.0:1789708801.511106:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708801.511139:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365596288 00000100:00100000:1.0:1789708801.511150:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365596288 00000100:00100000:3.0:1789708801.511161:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365597184:0@lo:400:kworker.0 00000100:00100000:3.0:1789708801.511199:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708801.511204:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789708801.511220:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365596288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708801.511242:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1789708801.511249:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789708801.511253:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365596800:0@lo:400:kworker.0 00000100:00100000:2.0:1789708801.511258:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365586176:0@lo:8:kworker.0 00000100:00100000:2.0:1789708801.511321:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365596416:0@lo:8:kworker.0 00000100:00100000:3.0:1789708801.511338:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708801.511348:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365596288:12345-0@lo:400:kworker.0 Request processed in 131us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708801.511361:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789708801.511379:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708801.511393:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365596800 00000100:00100000:3.0:1789708801.511395:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365596672 00000100:00100000:1.0:1789708801.511402:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365596800 00000100:00100000:3.0:1789708801.511405:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365596672 00000100:00100000:2.0:1789708801.511413:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365596544:0@lo:8:kworker.0 00000100:00100000:1.0:1789708801.511445:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789708801.511454:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708801.511462:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365596800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708801.511466:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365597184 00000100:00100000:3.0:1789708801.511475:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365597184 00000100:00100000:3.0:1789708801.511515:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708801.511538:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365596672:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789708801.511538:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1789708801.511550:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365596800:12345-0@lo:400:kworker.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00080000:2.0:1789708801.511551:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708801.511560:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708801.511567:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789708801.511574:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789708801.511615:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876645365596672:12345-0@lo:400:kworker.0 Request processed in 80us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708801.511616:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365596160 00000100:00100000:1.0:1789708801.511625:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365596160 00000100:00100000:3.0:1789708801.511631:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708801.511658:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789708801.511666:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365597184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708801.511685:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789708801.511697:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3618:x1876645365596160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708801.511708:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365597184:12345-0@lo:400:kworker.0 Request processed in 40us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708801.511718:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789708801.511750:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3618:x1876645365596160:12345-0@lo:400:kworker.0 Request processed in 53us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708801.511759:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789708801.511824:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365596800:0@lo:400:kworker.0 00010000:00080000:1.0:1789708801.511839:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee086a6d80 x1876645365596672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708801.511850:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876645365596672:0@lo:400:kworker.0 00010000:00080000:1.0:1789708801.511866:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee086a7800 x1876645365597184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708801.511874:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365597184:0@lo:400:kworker.0 00000100:00100000:1.0:1789708801.511908:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708801.511955:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365596160:0@lo:400:kworker.0 00000100:00100000:1.0:1789708801.511966:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365596288:0@lo:400:kworker.0 00000100:00100000:1.0:1789708801.511980:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708801.511986:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365596928:0@lo:400:kworker.0 00000100:00100000:1.0:1789708801.512008:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708801.512036:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365597056 00000100:00100000:1.0:1789708801.512040:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365597056 00000100:00100000:1.0:1789708801.512063:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365596928 00000100:00100000:1.0:1789708801.512066:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365596928 00000100:00100000:1.0:1789708801.512083:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789708801.512090:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365597056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708801.512122:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365597056:12345-0@lo:400:kworker.0 Request processed in 33us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708801.512129:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789708801.512139:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708801.512145:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365596928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708801.512181:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365596928:12345-0@lo:400:kworker.0 Request processed in 37us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708801.512191:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789708801.512236:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee086a5f80 x1876645365596928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708801.512245:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365596928:0@lo:400:kworker.0 00010000:00080000:1.0:1789708801.512256:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee086a6300 x1876645365597056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708801.512311:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365597056:0@lo:400:kworker.0 00000100:00100000:0.0:1789708801.512320:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365596416 00000100:00100000:0.0:1789708801.512329:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365596416 00000100:00100000:0.0:1789708801.512356:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365596544 00000100:00100000:0.0:1789708801.512360:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365596544 00000100:00100000:0.0:1789708801.512380:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708801.512388:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876645365596416:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789708801.512389:0:24367:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789708801.512408:0:24367:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1789708801.512437:0:24365:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 372 last 0 00000020:00000080:0.0:1789708801.512485:0:24365:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ec96 00002000:00100000:0.0:1789708801.512504:0:24365:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bed03052000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789708801.512509:0:24365:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789708801.512513:0:24365:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789708801.512623:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708801.512633:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876645365596544:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789708801.512654:0:25061:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00002000:00080000:0.0:1789708801.512756:0:24365:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789708801.512786:0:24365:0:(import.c:65:import_set_state_nolock()) ffff9bed03055000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708801.512840:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1876645365596416:12345-0@lo:8:kworker.0 Request processed in 452us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708801.512848:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789708801.513987:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee086a4700 x1876645365596416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708801.514001:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789708801.514009:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789708801.514017:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789708801.514022:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789708801.514026:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa71000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789708801.514056:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789708801.514071:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365596416:0@lo:8:kworker.0 00000004:00080000:3.0:1789708801.514636:0:22881:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789708801.514740:0:22881:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372324479104ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789708801.514748:0:22881:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789708801.515203:0:22882:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1789708801.515227:0:22882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22882:1876645365597440:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789708801.515310:0:22882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708801.515339:0:22882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee053c0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708801.515357:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365597440 00000100:00100000:0.0:1789708801.515363:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365597440 00000100:00100000:0.0:1789708801.515413:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708801.515422:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22882:x1876645365597440:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1789708801.515589:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708801.515652:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708801.515664:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365597312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708801.515694:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708801.516085:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365597312 00000100:00100000:0.0:1789708801.516090:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365597312 00000100:00100000:0.0:1789708801.516132:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708801.516140:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365597312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789708801.516159:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789708801.516306:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365597312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708801.516314:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1789708801.521218:0:22837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1789708801.522822:0:24367:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789708801.522836:0:24367:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789708801.522842:0:24367:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00010000:00080000:3.0:1789708801.525233:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3622e680 x1876645365597312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708801.525277:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365597312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708801.533246:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876645365596544:12345-0@lo:8:kworker.0 Request processed in 20607us (21788us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789708801.533283:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789708801.533324:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708801.533329:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789708801.533333:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365596544:0@lo:8:kworker.0 00002000:00010000:2.0:1789708801.555797:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708801.555811:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47ec9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.555828:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1789708801.555832:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708801.555845:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47ec9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.555864:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47ec9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.555874:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47ec9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.555882:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47ec9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.555906:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708801.556050:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708801.556058:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47ec9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.556077:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708801.556082:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47ec9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.556091:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47ec9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.556121:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47ec9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.556129:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f63a01/0xf45f43947e47ec9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.556156:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708801.556158:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708801.556160:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708801.558113:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708801.558127:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47eca4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.558142:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1789708801.558146:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708801.558152:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47eca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.558164:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47eca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.558173:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47eca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.558196:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47eca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.558221:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789708801.560888:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708801.560904:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd547fee/0xf45f43947e47ecab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.560932:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1789708801.560936:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708801.560943:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd547fee/0xf45f43947e47ecab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.560958:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd547fee/0xf45f43947e47ecab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.560970:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd547fee/0xf45f43947e47ecab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.560977:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd547fee/0xf45f43947e47ecab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.561000:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789708801.561008:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789708801.561016:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47eca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.561023:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708801.561028:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47eca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.561036:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47eca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.561052:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47eca4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.561059:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078e9cc5c/0xf45f43947e47eca4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.561104:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708801.561108:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd547fee/0xf45f43947e47ecab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.561114:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708801.561117:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd547fee/0xf45f43947e47ecab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.561123:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd547fee/0xf45f43947e47ecab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.561133:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd547fee/0xf45f43947e47ecab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.561140:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd547fee/0xf45f43947e47ecab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.561151:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708801.561152:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708801.561154:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.561480:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708801.562075:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708801.562086:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47ecb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.562102:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1789708801.562105:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708801.562110:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47ecb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.562121:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47ecb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.562131:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47ecb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.562139:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47ecb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.562162:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708801.562669:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708801.562677:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47ecb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.562687:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708801.562698:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47ecb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.562706:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47ecb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.562720:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47ecb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.562728:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008018bf8b/0xf45f43947e47ecb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.562747:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708801.562749:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708801.562750:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.572058:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.572075:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47ecb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.572092:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.572096:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.572102:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47ecb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.572115:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47ecb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.572125:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47ecb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.572152:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47ecb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.572184:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789708801.573864:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.573876:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009970e73b/0xf45f43947e47ecc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.573892:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.573896:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.573901:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009970e73b/0xf45f43947e47ecc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.573922:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009970e73b/0xf45f43947e47ecc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.573932:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009970e73b/0xf45f43947e47ecc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.573940:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009970e73b/0xf45f43947e47ecc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.573966:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789708801.574020:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789708801.574028:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47ecb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.574035:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708801.574040:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47ecb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.574048:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47ecb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.574075:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47ecb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.574089:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a86f9cc/0xf45f43947e47ecb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.574107:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708801.574110:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009970e73b/0xf45f43947e47ecc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.574116:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708801.574120:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009970e73b/0xf45f43947e47ecc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.574127:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009970e73b/0xf45f43947e47ecc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.574138:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009970e73b/0xf45f43947e47ecc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.574144:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009970e73b/0xf45f43947e47ecc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708801.574155:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708801.574157:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708801.574158:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.576805:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708801.577487:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708801.577499:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be4f7307/0xf45f43947e47ecc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.577518:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1789708801.577523:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708801.577530:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be4f7307/0xf45f43947e47ecc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.577544:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be4f7307/0xf45f43947e47ecc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.577561:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be4f7307/0xf45f43947e47ecc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.577569:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be4f7307/0xf45f43947e47ecc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.577595:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708801.578249:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708801.578273:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be4f7307/0xf45f43947e47ecc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.578290:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebde00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708801.578295:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be4f7307/0xf45f43947e47ecc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.578304:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be4f7307/0xf45f43947e47ecc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.578321:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be4f7307/0xf45f43947e47ecc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.578328:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be4f7307/0xf45f43947e47ecc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.578351:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.578353:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.578355:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.584010:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.584025:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.584042:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.584047:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.584053:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.584066:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.584082:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.584089:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.584161:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789708801.584970:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.584978:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47ecd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.584990:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.584993:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.584997:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47ecd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.585007:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47ecd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.585016:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47ecd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.585024:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47ecd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.589063:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708801.589089:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.589106:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.589111:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.589122:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.589147:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.589157:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.589190:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708801.589212:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47ecd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.589220:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.589223:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47ecd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.589231:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47ecd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.589243:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47ecd5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.589251:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.589253:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.589255:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.592651:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789708801.592667:0:24367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b12027/0xf45f43947e47ecd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.599291:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.599589:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.599606:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8c4d30/0xf45f43947e47ecdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.599629:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.599634:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.599641:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8c4d30/0xf45f43947e47ecdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.600397:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e8c4d30/0xf45f43947e47ecdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.600414:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8c4d30/0xf45f43947e47ecdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.600423:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e8c4d30/0xf45f43947e47ecdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.600462:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789708801.601611:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.601622:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47ece3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.601638:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708801.601645:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1789708801.601654:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e8c4d30/0xf45f43947e47ecdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.601671:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708801.601676:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8c4d30/0xf45f43947e47ecdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.601702:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8c4d30/0xf45f43947e47ecdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.601705:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.601726:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47ece3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.601744:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47ece3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.601753:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47ece3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.601762:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47ece3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.601784:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708801.601796:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708801.601817:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e8c4d30/0xf45f43947e47ecdc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.601829:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e8c4d30/0xf45f43947e47ecdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.601859:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708801.601863:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708801.601866:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.602541:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.602549:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008236d3d5/0xf45f43947e47ecea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.602560:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.602564:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.602569:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008236d3d5/0xf45f43947e47ecea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.602580:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008236d3d5/0xf45f43947e47ecea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.602597:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008236d3d5/0xf45f43947e47ecea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.602606:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008236d3d5/0xf45f43947e47ecea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.606867:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708801.606961:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708801.606974:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008236d3d5/0xf45f43947e47ecea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.606994:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708801.607114:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008236d3d5/0xf45f43947e47ecea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.607132:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008236d3d5/0xf45f43947e47ecea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.607221:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008236d3d5/0xf45f43947e47ecea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.607232:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008236d3d5/0xf45f43947e47ecea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.607283:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.607304:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.607307:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.607991:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.608000:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608145:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.608151:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.608170:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608186:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608198:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608207:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608233:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708801.608245:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708801.608250:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608258:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708801.608287:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608311:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608325:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecf1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608333:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da159d3/0xf45f43947e47ecf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608351:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.608353:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.608355:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.608835:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.608842:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb08ea62/0xf45f43947e47ecf8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608851:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.608855:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.608860:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb08ea62/0xf45f43947e47ecf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608870:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb08ea62/0xf45f43947e47ecf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608879:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb08ea62/0xf45f43947e47ecf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608894:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb08ea62/0xf45f43947e47ecf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608910:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708801.608929:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708801.608933:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb08ea62/0xf45f43947e47ecf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608940:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708801.608944:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb08ea62/0xf45f43947e47ecf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608952:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb08ea62/0xf45f43947e47ecf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608964:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb08ea62/0xf45f43947e47ecf8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608973:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb08ea62/0xf45f43947e47ecf8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.608988:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.608990:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.608991:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.609377:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.609390:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47ecff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609399:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.609403:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.609408:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47ecff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609418:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47ecff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609427:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47ecff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609436:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47ecff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609449:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708801.609457:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708801.609461:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47ecff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609469:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708801.609472:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47ecff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609481:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47ecff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609498:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47ecff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609506:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000065affb3/0xf45f43947e47ecff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609522:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.609524:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.609525:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.609841:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.609848:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1550371/0xf45f43947e47ed06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609857:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.609861:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.609867:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1550371/0xf45f43947e47ed06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609879:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1550371/0xf45f43947e47ed06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609889:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1550371/0xf45f43947e47ed06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609898:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1550371/0xf45f43947e47ed06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609939:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708801.609949:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708801.609954:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1550371/0xf45f43947e47ed06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609962:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708801.609965:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1550371/0xf45f43947e47ed06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609975:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1550371/0xf45f43947e47ed06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609990:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1550371/0xf45f43947e47ed06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.609999:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1550371/0xf45f43947e47ed06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610143:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.610145:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.610147:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.610522:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.610530:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a32da1ad/0xf45f43947e47ed0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610540:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.610550:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.610555:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a32da1ad/0xf45f43947e47ed0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610566:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a32da1ad/0xf45f43947e47ed0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610577:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a32da1ad/0xf45f43947e47ed0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610585:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a32da1ad/0xf45f43947e47ed0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610606:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708801.610619:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708801.610624:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a32da1ad/0xf45f43947e47ed0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610632:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708801.610637:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a32da1ad/0xf45f43947e47ed0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610646:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a32da1ad/0xf45f43947e47ed0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610762:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a32da1ad/0xf45f43947e47ed0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610783:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a32da1ad/0xf45f43947e47ed0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.610798:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.610800:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.610802:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.611073:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.611080:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008f422bb/0xf45f43947e47ed14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611089:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.611093:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.611097:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008f422bb/0xf45f43947e47ed14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611109:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008f422bb/0xf45f43947e47ed14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611118:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008f422bb/0xf45f43947e47ed14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611126:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008f422bb/0xf45f43947e47ed14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611145:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708801.611155:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708801.611348:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008f422bb/0xf45f43947e47ed14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611357:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708801.611361:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008f422bb/0xf45f43947e47ed14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611371:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008f422bb/0xf45f43947e47ed14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611387:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008f422bb/0xf45f43947e47ed14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611395:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008f422bb/0xf45f43947e47ed14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611432:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.611436:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.611440:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.611664:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.611803:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47ece3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611813:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708801.611817:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47ece3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611826:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47ece3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611845:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47ece3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611853:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4670081/0xf45f43947e47ece3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611871:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.611873:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.611875:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.611979:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.611985:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aca4149/0xf45f43947e47ed1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.611994:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.611997:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.612112:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aca4149/0xf45f43947e47ed1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.612125:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aca4149/0xf45f43947e47ed1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.612134:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aca4149/0xf45f43947e47ed1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.612143:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aca4149/0xf45f43947e47ed1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612171:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.612176:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.612336:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789708801.612671:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.612678:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3afd7a/0xf45f43947e47ed22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.612688:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.612691:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.612695:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f3afd7a/0xf45f43947e47ed22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.612705:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f3afd7a/0xf45f43947e47ed22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.612714:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3afd7a/0xf45f43947e47ed22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.612722:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f3afd7a/0xf45f43947e47ed22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612791:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708801.612797:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aca4149/0xf45f43947e47ed1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612805:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.612809:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aca4149/0xf45f43947e47ed1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612818:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aca4149/0xf45f43947e47ed1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612840:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aca4149/0xf45f43947e47ed1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612848:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aca4149/0xf45f43947e47ed1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612867:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708801.612871:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f3afd7a/0xf45f43947e47ed22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612879:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.612882:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3afd7a/0xf45f43947e47ed22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612891:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3afd7a/0xf45f43947e47ed22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612901:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f3afd7a/0xf45f43947e47ed22 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.612909:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.612921:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.612924:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.612961:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789708801.612967:0:24367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f3afd7a/0xf45f43947e47ed22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708801.613413:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.613420:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000823ea0e1/0xf45f43947e47ed29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.613435:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.613438:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.613443:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000823ea0e1/0xf45f43947e47ed29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.613452:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000823ea0e1/0xf45f43947e47ed29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.613461:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000823ea0e1/0xf45f43947e47ed29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.613469:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000823ea0e1/0xf45f43947e47ed29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.613526:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789708801.613821:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.613827:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063be3bba/0xf45f43947e47ed30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.613836:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.613839:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.613844:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063be3bba/0xf45f43947e47ed30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.613853:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063be3bba/0xf45f43947e47ed30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.613873:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063be3bba/0xf45f43947e47ed30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.613882:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063be3bba/0xf45f43947e47ed30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.613969:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708801.613975:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000823ea0e1/0xf45f43947e47ed29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.613995:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.613999:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000823ea0e1/0xf45f43947e47ed29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.614017:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000823ea0e1/0xf45f43947e47ed29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.614031:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000823ea0e1/0xf45f43947e47ed29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.614039:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000823ea0e1/0xf45f43947e47ed29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.614055:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708801.614059:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063be3bba/0xf45f43947e47ed30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.614066:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.614070:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063be3bba/0xf45f43947e47ed30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.614078:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063be3bba/0xf45f43947e47ed30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.614088:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063be3bba/0xf45f43947e47ed30 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.614106:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.614108:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.614110:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708801.615196:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.615203:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789708801.615291:0:24367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063be3bba/0xf45f43947e47ed30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.615830:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.616074:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.616083:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47ed37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.616097:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.616101:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.616108:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47ed37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.616123:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47ed37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.616134:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47ed37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.616156:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47ed37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.616283:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708801.616522:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708801.616530:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47ed37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.616540:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.616546:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47ed37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.616556:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47ed37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.616575:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47ed37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.616583:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47ed37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.616601:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.616603:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.616605:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708801.616689:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.616695:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d75dd8/0xf45f43947e47ed3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.616888:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.616892:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.616897:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d75dd8/0xf45f43947e47ed3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.616907:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3d75dd8/0xf45f43947e47ed3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.616924:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d75dd8/0xf45f43947e47ed3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.616932:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d75dd8/0xf45f43947e47ed3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.617007:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789708801.617305:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.617311:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0b23d80/0xf45f43947e47ed45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.617329:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.617332:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.617336:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0b23d80/0xf45f43947e47ed45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.617346:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0b23d80/0xf45f43947e47ed45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.617355:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0b23d80/0xf45f43947e47ed45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.617363:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0b23d80/0xf45f43947e47ed45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.617441:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708801.617449:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3d75dd8/0xf45f43947e47ed3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.617457:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708801.617461:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d75dd8/0xf45f43947e47ed3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.617470:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d75dd8/0xf45f43947e47ed3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.617483:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3d75dd8/0xf45f43947e47ed3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.617498:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3d75dd8/0xf45f43947e47ed3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.617516:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708801.617519:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0b23d80/0xf45f43947e47ed45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.617527:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708801.617530:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0b23d80/0xf45f43947e47ed45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.617539:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0b23d80/0xf45f43947e47ed45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.617550:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0b23d80/0xf45f43947e47ed45 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.617558:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708801.617559:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708801.617562:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.617669:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789708801.617674:0:24367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0b23d80/0xf45f43947e47ed45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708801.618201:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.618208:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47ed4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.618216:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.618220:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.618224:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47ed4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.618247:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47ed4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.618256:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47ed4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.618296:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47ed4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.618339:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708801.618347:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47ed4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.618361:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.618364:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47ed4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.618373:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47ed4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.618386:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47ed4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.618395:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.618397:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.618399:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.618493:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789708801.618498:0:24367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5fa71e5/0xf45f43947e47ed4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708801.618859:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.618865:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47ed53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.618874:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.618877:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.618881:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47ed53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.618891:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47ed53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.618922:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47ed53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.618930:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47ed53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.618959:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708801.618964:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47ed53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.618971:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.618975:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47ed53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.618983:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47ed53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.618993:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47ed53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.619007:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.619009:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.619011:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.619144:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789708801.619149:0:24367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f4df420/0xf45f43947e47ed53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708801.619499:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708801.619506:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c5b244/0xf45f43947e47ed5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.619515:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789708801.619518:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708801.619523:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c5b244/0xf45f43947e47ed5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.619533:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c5b244/0xf45f43947e47ed5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.619542:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c5b244/0xf45f43947e47ed5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708801.619564:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c5b244/0xf45f43947e47ed5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.619618:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708801.619625:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c5b244/0xf45f43947e47ed5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.619633:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708801.619644:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c5b244/0xf45f43947e47ed5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.619653:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c5b244/0xf45f43947e47ed5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.619678:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c5b244/0xf45f43947e47ed5a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.619688:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708801.619690:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708801.619692:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708801.619831:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789708801.619838:0:24367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c5b244/0xf45f43947e47ed5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708801.620892:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708801.620903:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47ed61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.620928:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1789708801.620932:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708801.620936:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47ed61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.620948:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47ed61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.620958:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47ed61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.620966:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47ed61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.623862:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708801.623887:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47ed61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.623902:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.623906:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47ed61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.623928:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47ed61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.623951:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47ed61 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.623958:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.623960:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708801.624015:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789708801.624027:0:24367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000003cb707/0xf45f43947e47ed61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.624170:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708801.624799:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708801.624809:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47ed68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.624825:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1789708801.624831:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708801.624838:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47ed68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.624854:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47ed68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.624864:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47ed68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.624873:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47ed68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.624897:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708801.624932:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708801.624940:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47ed68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.624949:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.624953:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47ed68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.624969:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47ed68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.624983:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47ed68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.624992:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cac26f5/0xf45f43947e47ed68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.625112:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.625114:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.625115:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708801.625996:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708801.627058:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708801.627075:0:24367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47ed6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.627106:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1789708801.627110:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708801.627118:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47ed6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.627135:0:24367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47ed6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.627146:0:24367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47ed6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.627155:0:24367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47ed6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708801.627178:0:24367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708801.627216:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708801.627225:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47ed6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.627236:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708801.627242:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47ed6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.627251:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47ed6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.627288:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47ed6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789708801.627294:0:24367:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:2.0:1789708801.627310:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d68b7e3/0xf45f43947e47ed6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708801.627333:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.627336:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708801.627337:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708801.627425:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22882:x1876645365597440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 111999us (112109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708801.627438:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708801.628751:0:22882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22882:1876645365597440:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789708801.628798:0:22882:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1789708801.629739:0:22882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22882:1876645365597568:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789708801.629816:0:22882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708801.629860:0:22882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08857000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708801.630799:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365597568 00000100:00100000:1.0:1789708801.630816:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365597568 00000100:00100000:1.0:1789708801.631797:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708801.631814:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22882:x1876645365597568:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789708801.631878:0:24366:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1789708801.644302:0:24362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1789708801.644383:0:24362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789708801.645074:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22882:x1876645365597568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13257us (15249us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789708801.645092:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708801.645192:0:22882:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789708801.645201:0:22882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22882:1876645365597568:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789708801.645217:0:22882:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1789708801.706310:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708801.896147:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708801.907477:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365597696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708801.907545:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708801.908065:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365597696 00000100:00100000:3.0:1789708801.908075:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365597696 00000100:00100000:3.0:1789708801.908124:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789708801.908133:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365597696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789708801.908166:0:22863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789708801.908214:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365597696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708801.908220:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789708801.908323:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365597696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789708802.534594:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708787/real 1789708787] req@ffff9bee3fac2d80 x1876645365589120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708802 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708802.534626:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3fac2d80 x1876645365589120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708802 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708802.536049:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708787/real 1789708787] req@ffff9bee3fac1180 x1876645365589248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708802 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708802.536083:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bee3fac1180 x1876645365589248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708802 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708802.536170:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa0d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708802.536191:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789708802.536195:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365589120:0@lo:8:kworker.0 00000100:00080000:0.0:1789708802.536201:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708802.536207:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789708802.536210:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365589248:0@lo:8:kworker.0 00000100:00080000:2.0:1789708802.536387:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708802.536393:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789708802.536396:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708802.536401:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 372 00000100:00080000:2.0:1789708802.536405:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789708802.536416:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bed08562000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708802.536434:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed09ab3800 x1876645365598208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708802.536460:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708802.536463:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789708802.536465:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa0d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708802.536468:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 357 00000100:00080000:2.0:1789708802.536472:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1789708802.536476:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365597824:0@lo:400:kworker.0 00000100:00080000:2.0:1789708802.536479:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bed0aa0d800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708802.536505:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fac2680 x1876645365598592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708802.536514:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708802.536518:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789708802.536520:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708802.536523:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 357 00000100:00080000:2.0:1789708802.536526:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789708802.536532:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bee04469000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708802.536544:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fac0a80 x1876645365598720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789708802.536549:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708802.536599:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365598464:0@lo:400:kworker.0 00000100:00100000:2.0:1789708802.536602:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365597952:0@lo:400:kworker.0 00000100:00100000:0.0:1789708802.536873:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365598336:0@lo:400:kworker.0 00000100:00100000:1.0:1789708802.542468:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708802.542479:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365598080:0@lo:400:kworker.0 00000100:00100000:2.0:1789708802.542527:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708802.542555:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365597824 00000100:00100000:2.0:1789708802.542559:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876645365598976:0@lo:400:kworker.0 00000100:00100000:1.0:1789708802.542565:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365597824 00000100:00100000:2.0:1789708802.542590:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708802.542624:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789708802.542634:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3618:x1876645365597824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708802.544536:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3618:x1876645365597824:12345-0@lo:400:kworker.0 Request processed in 1900us (7987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708802.544547:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789708802.544582:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365597824:0@lo:400:kworker.0 00000100:00100000:1.0:1789708802.544603:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365598464 00000100:00100000:1.0:1789708802.544610:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365598464 00000100:00100000:1.0:1789708802.544663:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789708802.544671:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365598464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708802.544889:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708802.544935:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365599104:0@lo:400:kworker.0 00000100:00100000:0.0:1789708802.544977:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708802.545019:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365598976 00000100:00100000:0.0:1789708802.545023:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365598976 00000100:00100000:0.0:1789708802.545060:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365598336 00000100:00100000:0.0:1789708802.545063:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365598336 00000100:00100000:0.0:1789708802.545075:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365599104 00000100:00100000:0.0:1789708802.545078:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365599104 00000100:00100000:0.0:1789708802.545093:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708802.545100:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876645365598976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708802.545498:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876645365598976:12345-0@lo:400:kworker.0 Request processed in 398us (2908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708802.545505:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708802.545519:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708802.545526:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365598336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708802.545560:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365598336:12345-0@lo:400:kworker.0 Request processed in 35us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708802.545566:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708802.545577:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789708802.545583:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365599104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708802.545610:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876645365599104:12345-0@lo:400:kworker.0 Request processed in 28us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708802.545616:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789708802.545636:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789708802.547581:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789708802.547691:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3fac1180 x1876645365598336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708802.547721:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365598336:0@lo:400:kworker.0 00010000:00080000:0.0:1789708802.547738:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3fac3800 x1876645365599104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708802.547746:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876645365599104:0@lo:400:kworker.0 00000100:00100000:0.0:1789708802.547790:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365598208:0@lo:8:kworker.0 00000100:00100000:0.0:1789708802.547845:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708802.547881:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365598592:0@lo:8:kworker.0 00000100:00100000:0.0:1789708802.547916:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708802.547941:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365598720:0@lo:8:kworker.0 00000100:00100000:0.0:1789708802.548078:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708802.549315:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365598080 00000100:00100000:3.0:1789708802.549326:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365598080 00000100:00100000:3.0:1789708802.549366:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365598208 00000100:00100000:3.0:1789708802.549369:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365598208 00000100:00100000:3.0:1789708802.549378:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365598592 00000100:00100000:3.0:1789708802.549381:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365598592 00000100:00100000:3.0:1789708802.549389:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365598720 00000100:00100000:3.0:1789708802.549392:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365598720 00000100:00100000:3.0:1789708802.549404:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708802.549413:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365598080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708802.549483:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365598080:12345-0@lo:400:kworker.0 Request processed in 71us (6956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708802.549505:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708802.549524:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708802.549528:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876645365598208:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789708802.549550:0:25061:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789708802.549591:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876645365598208:12345-0@lo:8:kworker.0 Request processed in 61us (1745us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789708802.549597:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708802.549608:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708802.549612:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876645365598592:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789708802.549630:0:25061:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:3.0:1789708802.549672:0:25061:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47ed76 00002000:00100000:3.0:1789708802.549685:0:25061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9bed03208000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789708802.549690:0:25061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789708802.549693:0:25061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789708802.549762:0:25061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789708802.549791:0:25061:0:(import.c:65:import_set_state_nolock()) ffff9bed0320f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708802.549825:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3614:x1876645365598592:12345-0@lo:8:kworker.0 Request processed in 211us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708802.549831:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708802.549843:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708802.549848:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876645365598720:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789708802.549858:0:25061:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789708802.549881:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876645365598720:12345-0@lo:8:kworker.0 Request processed in 32us (1804us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789708802.549908:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708802.549933:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708802.550555:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365598848:0@lo:400:kworker.0 00000100:00100000:3.0:1789708802.550594:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789708802.551330:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708802.551337:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789708802.551341:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365598208:0@lo:8:kworker.0 00000100:00100000:0.0:1789708802.551355:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708802.551362:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789708802.551368:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789708802.551373:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789708802.551376:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed0aa0d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789708802.551392:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789708802.551396:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365598592:0@lo:8:kworker.0 00000100:00080000:0.0:1789708802.551406:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708802.551409:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789708802.551411:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365598720:0@lo:8:kworker.0 00000004:00080000:0.0:1789708802.551456:0:23602:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789708802.551537:0:23602:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 373361276408ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789708802.551544:0:23602:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789708802.552844:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365598848 00000100:00100000:0.0:1789708802.552857:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365598848 00000100:00100000:0.0:1789708802.552919:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789708802.552929:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365598848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708802.553024:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365598848:12345-0@lo:400:kworker.0 Request processed in 97us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708802.553031:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789708802.553296:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3fac2300 x1876645365598848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708802.553311:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365598848:0@lo:400:kworker.0 00000100:00100000:0.0:1789708802.553565:0:22862:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789708802.553575:0:22862:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00080000:0.0:1789708802.554727:0:23594:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789708802.554969:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365598464:12345-0@lo:400:kworker.0 Request processed in 10285us (12496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708802.554981:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000004:00080000:1.0:1789708802.555061:0:23603:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789708802.555087:0:23603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23603:1876645365599360:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789708802.555242:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708802.555255:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365599232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708802.555342:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708802.555379:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365599232 00000100:00100000:0.0:1789708802.555386:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365599232 00000100:00100000:0.0:1789708802.555433:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708802.555442:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1876645365599232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789708802.555460:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789708802.555499:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1876645365599232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708802.555505:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708802.555547:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365599232:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789708802.555566:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708802.555927:0:23603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708802.555961:0:23603:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee053c0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708802.556140:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365599360 00000100:00100000:0.0:1789708802.556152:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365599360 00000100:00100000:0.0:1789708802.556187:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708802.556194:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23603:x1876645365599360:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789708802.556225:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365598080:0@lo:400:kworker.0 00010000:00080000:2.0:1789708802.556245:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee3fac3480 x1876645365598976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708802.556256:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876645365598976:0@lo:400:kworker.0 00000100:00100000:3.0:1789708802.556754:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365598464:0@lo:400:kworker.0 00000100:00100000:1.0:1789708802.557108:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365597952 00000100:00100000:1.0:1789708802.557114:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365597952 00000100:00100000:1.0:1789708802.557143:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789708802.557150:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365597952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708802.557214:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365597952:12345-0@lo:400:kworker.0 Request processed in 64us (7281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708802.557222:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789708802.557913:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365597952:0@lo:400:kworker.0 00002000:00080000:1.0:1789708802.571098:0:25061:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789708802.571187:0:25061:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789708802.571504:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23603:x1876645365599360:12345-0@lo:7:osp-pre-0-1.0 Request processed in 15307us (15573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708802.571516:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708802.571652:0:23603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23603:1876645365599360:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1789708802.571673:0:23603:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1789708802.571716:0:23603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23603:1876645365599488:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789708802.571755:0:23603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708802.571779:0:23603:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708802.571824:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365599488 00000100:00100000:0.0:1789708802.571832:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365599488 00000100:00100000:0.0:1789708802.571877:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708802.571886:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23603:x1876645365599488:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789708802.571922:0:24366:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789708802.572031:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23603:x1876645365599488:12345-0@lo:5:osp-pre-0-1.0 Request processed in 146us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708802.572039:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708802.572228:0:23603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23603:1876645365599488:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789708802.572237:0:23603:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1789708802.572372:0:23603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23603:1876645365599616:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789708802.572396:0:23603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708802.572414:0:23603:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708802.572461:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365599616 00000100:00100000:1.0:1789708802.572465:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365599616 00000100:00100000:1.0:1789708802.572491:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789708802.572498:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23603:x1876645365599616:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789708802.572524:0:24365:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:3.0:1789708802.684978:0:24362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1789708802.685407:0:24362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789708802.685790:0:23603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1789708802.685810:0:23603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23603:1876645365599616:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789708802.685828:0:23603:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1789708802.685904:0:23603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23603:1876645365599744:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789708802.685943:0:23603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708802.685969:0:23603:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed09acf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708802.686057:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23603:x1876645365599616:12345-0@lo:5:osp-pre-0-1.0 Request processed in 113134us (113233us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789708802.686068:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708802.686405:0:22869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365599744 00000100:00100000:3.0:1789708802.686414:0:22869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365599744 00000100:00100000:3.0:1789708802.686499:0:22869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708802.686509:0:22869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23603:x1876645365599744:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789708802.686564:0:22869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23603:x1876645365599744:12345-0@lo:900:osp-pre-0-1.0 Request processed in 56us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708802.686571:0:22869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789708802.688354:0:23603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bee363cc380 x1876645365599744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789708818 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708802.688370:0:23603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23603:1876645365599744:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789708802.746484:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708803.435755:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365599872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789708803.435830:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708803.435960:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365599872 00000100:00100000:1.0:1789708803.435968:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365599872 00000100:00100000:1.0:1789708803.436025:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789708803.436035:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365599872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708803.436068:0:22863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789708803.436127:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365599872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708803.436134:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789708803.436391:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365599872:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1789708803.547782:0:25182:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789708803.547789:0:25182:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789708803.547790:0:25182:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789708803.548578:0:25182:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bee10920800 00000020:01000004:2.0:1789708803.548606:0:25182:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789708803.548636:0:25182:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789708803.548656:0:25182:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bee3dd7b380) 00000020:00000080:2.0:1789708803.548677:0:25182:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789708803.616546:0:25182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789708803.621858:0:25182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789708803.622863:0:25182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789708803.623084:0:25182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789708803.623283:0:25182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789708803.623585:0:25182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789708803.623835:0:25182:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1789708803.627180:0:25182:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789708803.627944:0:25182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789708803.627960:0:25182:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789708803.627981:0:25182:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45f43947e47ed84 00000020:01000004:3.0:1789708803.627989:0:25182:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789708803.628012:0:25182:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789708803.628015:0:25182:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789708803.628022:0:25182:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789708803.628056:0:25182:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789708803.628061:0:25182:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789708803.640677:0:25182:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789708803.640716:0:25182:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.152@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789708803.640721:0:25182:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789708803.640722:0:25182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708803.640724:0:25182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708803.640729:0:25182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708803.640730:0:25182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708803.640731:0:25182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708803.640733:0:25182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708803.640734:0:25182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708803.640735:0:25182:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789708803.640739:0:25182:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789708803.640741:0:25182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789708803.640742:0:25182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708803.640743:0:25182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708803.640744:0:25182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708803.640745:0:25182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708803.640746:0:25182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708803.640747:0:25182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708803.640748:0:25182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708803.640748:0:25182:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789708803.640783:0:25182:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789708803.640802:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600000:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789708803.640889:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708803.640983:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02f02a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708803.641023:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365600000 00000100:00100000:2.0:1789708803.641031:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365600000 00000100:00100000:2.0:1789708803.641125:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789708803.641136:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:25182:x1876645365600000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789708803.641167:0:22849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789708803.641170:0:22849:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789708803.641174:0:22849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789708803.641759:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:25182:x1876645365600000:12345-0@lo:253:mount.lustre.0 Request processed in 624us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708803.641767:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789708803.641840:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600000:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789708803.641851:0:25182:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789708803.641854:0:25182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708803.641855:0:25182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708803.641856:0:25182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708803.641857:0:25182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708803.641858:0:25182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708803.641859:0:25182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708803.641861:0:25182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708803.641862:0:25182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708803.641863:0:25182:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789708803.641903:0:25182:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bee10920800 from lustre-OST0001 10000000:01000000:3.0:1789708803.641933:0:25182:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789708803.641936:0:25182:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789708803.641944:0:25182:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bed04200000 local copy 00010000:00010000:3.0:1789708803.641954:0:25182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708803.642045:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708803.642073:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708803.642373:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708803.642524:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365600128 00000100:00100000:1.0:1789708803.642529:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365600128 00000100:00100000:1.0:1789708803.642555:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789708803.642562:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:25182:x1876645365600128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708803.642637:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:25182:x1876645365600128:12345-0@lo:501:mount.lustre.0 Request processed in 75us (563us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789708803.642644:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789708803.642770:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600128:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789708803.642783:0:25182:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789708803.642803:0:25182:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789708803.642809:0:25182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708803.642818:0:25182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee30492e00/0xf45f43947e47e9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47e9c5 expref: -99 pid: 22836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708803.642856:0:25182:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bee10920800 10000000:01000000:3.0:1789708803.642862:0:25182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789708803.642867:0:25182:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789708803.642870:0:25182:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708803.642890:0:25182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789708803.642894:0:25182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789708803.642917:0:25182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5200/0xf45f43947e47ed8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708803.642924:0:25182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5200/0xf45f43947e47ed8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708803.642933:0:25182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5200/0xf45f43947e47ed8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708803.642958:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708803.642985:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708803.643007:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708803.643110:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365600256 00000100:00100000:1.0:1789708803.643115:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365600256 00000100:00100000:1.0:1789708803.643137:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789708803.643143:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:25182:x1876645365600256:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708803.643151:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708803.643164:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ed92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ed8b expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.643186:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ed92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ed8b expref: 22 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.643196:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee029c8600/0xf45f43947e47ed92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ed8b expref: 22 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.643204:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8600, rc 0) 00000100:00100000:1.0:1789708803.643240:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:25182:x1876645365600256:12345-0@lo:101:mount.lustre.0 Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708803.643245:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789708803.643339:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708803.643351:0:25182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5200/0xf45f43947e47ed8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ed92 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708803.643359:0:25182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5200/0xf45f43947e47ed8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ed92 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708803.644329:0:25182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1789708803.645130:0:25182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708803.647688:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789708803.647748:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789708803.647765:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789708803.647779:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789708803.647793:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789708803.647807:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789708803.647821:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789708803.647854:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789708803.647869:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1789708803.647911:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1789708803.647917:0:25182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1789708803.648054:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708803.648121:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708803.648232:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed0853c900 going to sleep for 11 seconds 00000100:00100000:0.0:1789708803.648532:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365600384 00000100:00100000:0.0:1789708803.648541:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365600384 00000100:00100000:1.0:1789708803.648669:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789708803.648682:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:25182:x1876645365600384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708803.648895:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:25182:x1876645365600384:12345-0@lo:501:mount.lustre.0 Request processed in 215us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708803.648911:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789708803.649073:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708803.649130:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708803.649171:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.649235:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789708803.649300:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365600512 00000100:00100000:0.0:1789708803.649305:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365600512 00000100:00100000:0.0:1789708803.649323:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789708803.649329:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:25182:x1876645365600512:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708803.650023:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:25182:x1876645365600512:12345-0@lo:503:mount.lustre.0 Request processed in 691us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708803.650032:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789708803.650132:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600512:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789708803.650897:0:25182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708803.650982:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708803.651038:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.651067:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708803.651141:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365600640 00000100:00100000:1.0:1789708803.651147:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365600640 00000100:00100000:1.0:1789708803.651176:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789708803.651183:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:25182:x1876645365600640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708803.651607:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:25182:x1876645365600640:12345-0@lo:502:mount.lustre.0 Request processed in 423us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708803.651670:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789708803.651827:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789708803.652040:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789708803.652066:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789708803.652082:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789708803.652095:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789708803.652109:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789708803.652121:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789708803.652134:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789708803.652146:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789708803.652159:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1789708803.652183:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708803.652225:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.652257:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08b6f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708803.652352:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365600768 00000100:00100000:1.0:1789708803.652357:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365600768 00000100:00100000:0.0:1789708803.652479:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789708803.652490:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:25182:x1876645365600768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708803.652596:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:25182:x1876645365600768:12345-0@lo:502:mount.lustre.0 Request processed in 108us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708803.652603:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789708803.652745:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789708803.652798:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1789708803.652806:0:25182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789708803.653789:0:25186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789708803.653798:0:25186:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789708803.653808:0:25186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708803.653810:0:25186:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789708803.653816:0:25186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789708803.653831:0:25186:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bee3dd7cd40) 00000020:00000080:2.0:1789708803.653854:0:25186:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789708803.653860:0:25186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789708803.653945:0:25186:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee10920800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789708803.653954:0:25186:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789708803.653961:0:25186:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45f43947e47eda0 00010000:00010000:2.0:1789708803.657941:0:25186:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789708803.658497:0:25186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1789708803.659831:0:25186:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789708803.661252:0:25186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789708803.661295:0:25186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708803.661313:0:25186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708803.661315:0:25186:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789708803.661321:0:25186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708803.661324:0:25186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708803.661326:0:25186:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789708803.661329:0:25186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789708803.661330:0:25186:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789708803.661332:0:25186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708803.661335:0:25186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708803.661336:0:25186:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789708803.661338:0:25186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708803.661340:0:25186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708803.661342:0:25186:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789708803.661345:0:25186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789708803.661369:0:25186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708803.661372:0:25186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708803.661373:0:25186:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789708803.661377:0:25186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1789708803.670525:0:25182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789708803.670601:0:25182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789708803.670636:0:25182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5200/0xf45f43947e47ed8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ed92 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708803.670650:0:25182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5200/0xf45f43947e47ed8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ed92 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708803.670679:0:25182:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee10920800 from 1 10000000:01000000:2.0:1789708803.670683:0:25182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708803.670724:0:25182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708803.670731:0:25182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708803.670741:0:25182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708803.670768:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789708803.670853:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.670907:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04eea180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708803.671704:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365600896 00000100:00100000:1.0:1789708803.671713:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365600896 00000100:00100000:1.0:1789708803.671767:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789708803.671776:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:25182:x1876645365600896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708803.671790:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708803.671803:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee029c8000/0xf45f43947e47edae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47eda7 expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.671827:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c8000/0xf45f43947e47edae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47eda7 expref: 23 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.671836:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee029c8000/0xf45f43947e47edae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eda7 expref: 23 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.671844:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee029c8000, rc 0) 00000100:00100000:1.0:1789708803.671899:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:25182:x1876645365600896:12345-0@lo:101:mount.lustre.0 Request processed in 124us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708803.671905:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789708803.672520:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365600896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708803.672537:0:25182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708803.672546:0:25182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708803.676227:0:25182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1789708803.676610:0:25182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708803.676825:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789708803.676851:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789708803.676866:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789708803.676895:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789708803.676909:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789708803.676922:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789708803.676936:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789708803.676951:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1789708803.677005:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1789708803.677021:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1789708803.677034:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1789708803.677052:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1789708803.677057:0:25182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1789708803.677146:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708803.677211:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.677281:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365601024 00000100:00100000:2.0:1789708803.677289:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365601024 00000100:00100000:2.0:1789708803.677331:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789708803.677340:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:25182:x1876645365601024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708803.677451:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:25182:x1876645365601024:12345-0@lo:501:mount.lustre.0 Request processed in 111us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708803.677459:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789708803.677500:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04eea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708803.677521:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708803.677560:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708803.677598:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.677620:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04eea6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708803.678012:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365601152 00000100:00100000:1.0:1789708803.678017:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365601152 00000100:00100000:1.0:1789708803.678055:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789708803.678063:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:25182:x1876645365601152:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708803.678162:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:25182:x1876645365601152:12345-0@lo:503:mount.lustre.0 Request processed in 99us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708803.678170:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789708803.684951:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601152:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789708803.686578:0:25182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708803.686815:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708803.686900:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.686973:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04eea180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708803.693024:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365601280 00000100:00100000:1.0:1789708803.693040:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365601280 00000100:00100000:1.0:1789708803.693140:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789708803.693151:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:25182:x1876645365601280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708803.693357:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:25182:x1876645365601280:12345-0@lo:502:mount.lustre.0 Request processed in 208us (6456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708803.693365:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789708803.693483:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789708803.693719:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789708803.693748:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789708803.693762:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789708803.693774:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789708803.693786:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789708803.693797:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789708803.693809:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789708803.693820:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1789708803.693832:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1789708803.693845:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1789708803.693901:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1789708803.693936:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708803.693989:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708803.704793:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365601408 00000100:00100000:0.0:1789708803.704809:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365601408 00000100:00100000:0.0:1789708803.704862:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789708803.704871:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:25182:x1876645365601408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708803.705058:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:25182:x1876645365601408:12345-0@lo:502:mount.lustre.0 Request processed in 187us (11068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708803.705066:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789708803.709419:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee04eea180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708803.709468:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789708803.709585:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789708803.709599:0:25182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789708803.711852:0:25190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708803.711865:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708803.711867:0:25190:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789708803.711887:0:25190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee10920800 00000020:00000080:2.0:1789708803.711890:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708803.711898:0:25190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708803.711901:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708803.711902:0:25190:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789708803.711905:0:25190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708803.711908:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708803.711909:0:25190:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789708803.711912:0:25190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bee10920800 00000020:00000080:2.0:1789708803.711914:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708803.711976:0:25190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708803.711979:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708803.711981:0:25190:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789708803.711983:0:25190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708803.711986:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708803.711987:0:25190:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708803.711990:0:25190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee10920800 00000020:00000080:2.0:1789708803.711993:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708803.712011:0:25190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708803.712014:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708803.712015:0:25190:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708803.712017:0:25190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708803.712020:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708803.712021:0:25190:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789708803.712033:0:25190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bee10920800 00000020:00000080:2.0:1789708803.712035:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789708803.712061:0:25190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708803.712064:0:25190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708803.712066:0:25190:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789708803.712069:0:25190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1789708803.717327:0:25182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789708803.717378:0:25182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708803.717473:0:25182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.717619:0:25182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708803.717682:0:25182:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789708803.717685:0:25182:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bee10920800 10000000:01000000:1.0:1789708803.717688:0:25182:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bee10920800 10000000:01000000:1.0:1789708803.717691:0:25182:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789708803.717697:0:25182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bee10920800 from 1 10000000:01000000:1.0:1789708803.717700:0:25182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789708803.717734:0:25182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47edb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.717748:0:25182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47edb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.717760:0:25182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47edb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708803.717783:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789708803.717841:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708803.717892:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708803.717938:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365601536 00000100:00100000:3.0:1789708803.717946:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365601536 00000100:00100000:3.0:1789708803.717988:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789708803.717997:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:25182:x1876645365601536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708803.718010:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708803.718021:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb4400/0xf45f43947e47edbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47edb5 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708803.718043:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb4400/0xf45f43947e47edbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47edb5 expref: 24 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708803.718053:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb4400/0xf45f43947e47edbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47edb5 expref: 24 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708803.718063:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4400, rc 0) 00000100:00100000:3.0:1789708803.718103:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365601536:12345-0@lo:101:mount.lustre.0 Request processed in 107us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708803.718110:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789708803.718353:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708803.718365:0:25182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47edb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47edbc expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.718374:0:25182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47edb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47edbc expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789708803.741603:0:25182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789708803.741955:0:25182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708803.742183:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789708803.742208:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789708803.742221:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789708803.742247:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789708803.742281:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789708803.742295:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789708803.742306:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789708803.742317:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789708803.742328:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789708803.742339:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789708803.742362:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789708803.742375:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789708803.742565:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789708803.742584:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789708803.742597:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789708803.742610:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789708803.742624:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789708803.742638:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789708803.742652:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789708803.742681:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789708803.742697:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789708803.742711:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789708803.742725:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789708803.742739:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789708803.742753:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789708803.742767:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789708803.742780:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789708803.742793:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789708803.742807:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789708803.742820:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789708803.742833:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789708803.742847:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789708803.742861:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789708803.742885:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789708803.742899:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789708803.742925:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789708803.742941:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789708803.742956:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789708803.742969:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789708803.742982:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789708803.742996:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789708803.743009:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789708803.743023:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789708803.743048:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789708803.743062:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789708803.743075:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789708803.743089:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789708803.743103:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789708803.743222:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789708803.743242:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789708803.743293:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789708803.743299:0:25182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789708803.746990:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708803.747068:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708803.747115:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708803.747228:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365601664 00000100:00100000:3.0:1789708803.747236:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365601664 00000100:00100000:3.0:1789708803.747328:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789708803.747338:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365601664:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708803.749725:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365601664:12345-0@lo:501:mount.lustre.0 Request processed in 2382us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708803.749738:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789708803.752662:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708803.752736:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601792:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708803.752807:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708803.752850:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708803.753044:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365601792 00000100:00100000:3.0:1789708803.753052:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365601792 00000100:00100000:3.0:1789708803.753099:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789708803.753108:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365601792:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708803.753229:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365601792:12345-0@lo:503:mount.lustre.0 Request processed in 121us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708803.753236:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789708803.753575:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601792:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789708803.754008:0:25182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708803.754081:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708803.754123:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708803.754145:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047e000 going to sleep for 11 seconds 00010000:00010000:2.0:1789708803.754310:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708803.756666:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365601920 00000100:00100000:3.0:1789708803.756678:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365601920 00000100:00100000:3.0:1789708803.756726:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789708803.756734:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365601920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708803.756892:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365601920:12345-0@lo:502:mount.lustre.0 Request processed in 158us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708803.756899:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789708803.756996:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365601920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708803.757191:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789708803.757217:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789708803.757228:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789708803.757239:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789708803.757249:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789708803.757325:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789708803.757338:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789708803.757348:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789708803.757359:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789708803.757369:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789708803.757379:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789708803.757389:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789708803.757399:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789708803.757410:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789708803.757433:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789708803.757444:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789708803.757454:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789708803.757464:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789708803.757474:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789708803.758631:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789708803.758681:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789708803.758696:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789708803.758708:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789708803.758721:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789708803.758733:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789708803.758745:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789708803.758757:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789708803.758769:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789708803.758780:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789708803.758792:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789708803.758823:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789708803.758841:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789708803.758855:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789708803.758869:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789708803.758898:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789708803.758911:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789708803.758924:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789708803.758939:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789708803.758971:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789708803.758985:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789708803.758998:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789708803.759012:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789708803.759024:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789708803.759037:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789708803.759050:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789708803.759064:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789708803.759096:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789708803.759113:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789708803.759164:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365602048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708803.759236:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708803.759292:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708803.760600:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365602048 00000100:00100000:3.0:1789708803.760610:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365602048 00000100:00100000:3.0:1789708803.760662:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789708803.760679:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365602048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708803.760820:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365602048:12345-0@lo:502:mount.lustre.0 Request processed in 142us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708803.760829:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789708803.762093:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365602048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708803.762369:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789708803.763705:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789708803.763758:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365602176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708803.763835:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708803.763867:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708803.763975:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365602176 00000100:00100000:3.0:1789708803.763982:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365602176 00000100:00100000:3.0:1789708803.764026:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789708803.764035:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365602176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708803.764167:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365602176:12345-0@lo:502:mount.lustre.0 Request processed in 133us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708803.764174:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789708803.764311:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365602176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708803.764354:0:25182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789708803.764361:0:25182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789708803.770905:0:25195:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789708803.770925:0:25195:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bed08674d40) 00000020:00000080:2.0:1789708803.770951:0:25195:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789708803.771039:0:25195:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee10920800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789708803.771044:0:25195:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee10920800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789708803.771046:0:25195:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee10920800 3 00010000:00080000:2.0:1789708803.771078:0:25195:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed03857000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1789708803.773167:0:25195:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789708803.773385:0:25195:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789708803.773435:0:25195:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789708803.773446:0:25195:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf45f43947e47edca 00000100:00080000:2.0:1789708803.773455:0:25195:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708803.773464:0:25195:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bed03857000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708803.773495:0:25195:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fac2d80 x1876645365602304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708803.773523:0:25195:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789708803.773584:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708803.773588:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789708803.773590:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708803.773593:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 373 00000100:00080000:2.0:1789708803.773596:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789708803.773601:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bed08562000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708803.773618:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee3fac2680 x1876645365602688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708803.773639:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708803.773642:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789708803.773643:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708803.773647:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 373 00000100:00080000:2.0:1789708803.773650:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789708803.773655:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bee04469000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789708803.773666:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed09ab0e00 x1876645365603072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789708803.773716:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365602432:0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.773771:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.773801:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365603200:0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.773822:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.773843:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789708803.773848:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365602944:0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.773898:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.773928:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365602816:0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.773950:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.773969:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365603456:0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.773989:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.774005:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789708803.774010:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365602560:0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.774029:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.774052:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365603328:0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.774071:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.774098:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365603200 00000100:00100000:2.0:1789708803.774105:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365603200 00000100:00100000:2.0:1789708803.774134:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365602816 00000100:00100000:2.0:1789708803.774137:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365602816 00000100:00100000:2.0:1789708803.774147:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365603456 00000100:00100000:2.0:1789708803.774149:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365603456 00000100:00100000:2.0:1789708803.774160:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365603328 00000100:00100000:2.0:1789708803.774162:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365603328 00000100:00100000:2.0:1789708803.774176:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708803.774183:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365603200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.774232:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365603200:12345-0@lo:400:kworker.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708803.774239:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708803.774253:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708803.774277:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365602816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.774309:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365602816:12345-0@lo:400:kworker.0 Request processed in 50us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708803.774314:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708803.774326:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789708803.774331:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365603456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.774371:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365603456:12345-0@lo:400:kworker.0 Request processed in 39us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708803.774376:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789708803.774388:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789708803.774393:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365603328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708803.774430:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365603328:12345-0@lo:400:kworker.0 Request processed in 37us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708803.774436:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789708803.774467:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab3800 x1876645365603328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708803.774480:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365603328:0@lo:400:kworker.0 00010000:00080000:2.0:1789708803.774491:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fac3800 x1876645365602816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708803.774497:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365602816:0@lo:400:kworker.0 00010000:00080000:2.0:1789708803.774505:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab0000 x1876645365603456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708803.774513:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365603456:0@lo:400:kworker.0 00010000:00080000:2.0:1789708803.774539:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed09ab1c00 x1876645365603200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708803.774547:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365603200:0@lo:400:kworker.0 00000100:00100000:3.0:1789708803.778952:0:25134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365602432 00000100:00100000:3.0:1789708803.778967:0:25134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365602432 00000100:00100000:3.0:1789708803.779026:0:25134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789708803.779035:0:25134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365602432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708803.779128:0:25134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365602432:12345-0@lo:400:kworker.0 Request processed in 93us (5354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708803.779136:0:25134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789708803.779172:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365602304:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708803.779215:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708803.779245:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365602688:0@lo:8:kworker.0 00000100:00100000:3.0:1789708803.779289:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708803.779314:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365603072:0@lo:8:kworker.0 00000100:00100000:3.0:1789708803.779335:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708803.779646:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365602944 00000100:00100000:1.0:1789708803.779651:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365602944 00000100:00100000:1.0:1789708803.779677:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365602560 00000100:00100000:1.0:1789708803.779681:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365602560 00000100:00100000:1.0:1789708803.779705:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365602688 00000100:00100000:1.0:1789708803.779709:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365602688 00000100:00100000:1.0:1789708803.779716:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365603072 00000100:00100000:1.0:1789708803.779731:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365603072 00000100:00100000:1.0:1789708803.779743:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708803.779751:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365602944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708803.779786:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365602944:12345-0@lo:400:kworker.0 Request processed in 37us (5888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708803.779793:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708803.779807:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708803.779812:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365602560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708803.779854:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365602560:12345-0@lo:400:kworker.0 Request processed in 42us (5824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708803.779860:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708803.779882:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708803.779886:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876645365602688:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789708803.779934:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876645365602688:12345-0@lo:8:kworker.0 Request processed in 47us (645us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789708803.779941:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708803.779951:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708803.779954:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876645365603072:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789708803.779984:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876645365603072:12345-0@lo:8:kworker.0 Request processed in 28us (648us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789708803.779990:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708803.780025:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708803.780033:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789708803.780037:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789708803.780040:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365602688:0@lo:8:kworker.0 00000100:00100000:1.0:1789708803.780053:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708803.780063:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789708803.780066:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789708803.780069:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed09ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365603072:0@lo:8:kworker.0 00000100:00100000:1.0:1789708803.782672:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365602304 00000100:00100000:1.0:1789708803.782687:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365602304 00000100:00100000:1.0:1789708803.782722:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708803.782729:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365602304:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789708803.782754:0:22857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 374 last 0 00000020:00000080:1.0:1789708803.782791:0:22857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf45f43947e47edd1 00000004:00100000:1.0:1789708803.782808:0:22857:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789708803.782839:0:22857:0:(import.c:65:import_set_state_nolock()) ffff9bed0392a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708803.782930:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876645365602304:12345-0@lo:38:llog_process_th.0 Request processed in 200us (3714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708803.782938:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789708803.783011:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee3fac2d80 x1876645365602304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708803.783023:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708803.783031:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1789708803.783037:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789708803.783041:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789708803.783044:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed03857000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789708803.783049:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876645365602304:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708803.783212:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365602560:0@lo:400:kworker.0 00000100:00100000:3.0:1789708803.783322:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365602944:0@lo:400:kworker.0 00000100:00100000:3.0:1789708803.783335:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365602432:0@lo:400:kworker.0 00000100:00080000:1.0:1789708803.786648:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1789708803.786974:0:25195:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789708803.786991:0:25195:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9bed08673380) 00000020:00000080:2.0:1789708803.787014:0:25195:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789708803.787095:0:25195:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bee10920800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789708803.787099:0:25195:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bee10920800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789708803.787101:0:25195:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bee10920800 3 00010000:00080000:2.0:1789708803.787133:0:25195:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bed03853000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789708803.796815:0:25195:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1789708803.797026:0:25195:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789708803.797080:0:25195:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789708803.797093:0:25195:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf45f43947e47eddf 00000100:00080000:3.0:1789708803.797103:0:25195:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708803.797114:0:25195:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9bed03853000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789708803.797149:0:25195:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bee363cf100 x1876645365603584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708803.797171:0:25195:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789708803.797845:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876645365603584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789708803.797920:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708803.798130:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365603584 00000100:00100000:2.0:1789708803.798137:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365603584 00000100:00100000:2.0:1789708803.798177:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708803.798184:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876645365603584:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789708803.798207:0:22857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 374 last 0 00000020:00000080:2.0:1789708803.798235:0:22857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf45f43947e47ede6 00000004:00100000:2.0:1789708803.798247:0:22857:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789708803.798297:0:22857:0:(import.c:65:import_set_state_nolock()) ffff9bed03850000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708803.798345:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876645365603584:12345-0@lo:38:llog_process_th.0 Request processed in 161us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708803.798353:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789708803.798389:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee363cf100 x1876645365603584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708803.798399:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789708803.798406:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789708803.798412:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789708803.798415:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789708803.798418:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed03853000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789708803.798422:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876645365603584:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789708803.798618:0:25195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1789708803.798960:0:25182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789708803.798996:0:25182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789708803.799007:0:25182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47edb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47edbc expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.799019:0:25182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee029c9000/0xf45f43947e47edb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47edbc expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789708803.799062:0:25182:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789708803.799064:0:25182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708803.799065:0:25182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708803.799066:0:25182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708803.799067:0:25182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708803.799068:0:25182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708803.799070:0:25182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708803.799071:0:25182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708803.799073:0:25182:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708803.799076:0:25182:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789708803.799078:0:25182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708803.799080:0:25182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708803.799081:0:25182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708803.799082:0:25182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708803.799083:0:25182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708803.799084:0:25182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708803.799085:0:25182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708803.799086:0:25182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708803.799087:0:25182:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708803.799109:0:25182:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789708803.799121:0:25182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365603712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789708803.799161:0:25182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708803.799182:0:25182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3047ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708803.799250:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365603712 00000100:00100000:1.0:1789708803.799254:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365603712 00000100:00100000:1.0:1789708803.799302:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789708803.799308:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365603712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789708803.799333:0:22849:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789708803.799347:0:22849:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789708803.816105:0:22849:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789708803.816161:0:22849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789708803.818936:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:25182:x1876645365603712:12345-0@lo:253:mount.lustre.0 Request processed in 19619us (19766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708803.818950:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789708803.819057:0:25182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:25182:1876645365603712:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789708803.819070:0:25182:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789708803.819074:0:25182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789708803.819075:0:25182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708803.819076:0:25182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708803.819078:0:25182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708803.819079:0:25182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708803.819081:0:25182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708803.819082:0:25182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708803.819084:0:25182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708803.819085:0:25182:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789708803.819110:0:25182:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1789708803.824023:0:25182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 20000000:01000000:0.0:1789708803.827613:0:22873:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789708803.827623:0:22873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789708803.827828:0:22873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.827850:0:22873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee1103ac00/0xf45f43947e47ec81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ec7a expref: 23 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.827858:0:22873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee1103a800/0xf45f43947e47ec8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ec88 expref: 23 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.827866:0:22873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.827919:0:22873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee1103a800/0xf45f43947e47ec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ec88 expref: 23 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.827934:0:22873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee1103a800/0xf45f43947e47ec8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ec88 expref: 23 pid: 22852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708803.827967:0:22873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365603840:0@lo:104: 00000100:00100000:1.0:1789708803.828030:0:22873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708803.828084:0:22873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee1103ac00/0xf45f43947e47ec81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ec7a expref: 23 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.828092:0:22873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee1103ac00/0xf45f43947e47ec81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ec7a expref: 23 pid: 22852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708803.828100:0:22873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365603968:0@lo:104: 00000100:00100000:1.0:1789708803.828120:0:22873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708803.828142:0:22873:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee1892c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789708803.828193:0:22841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365603840 00000100:00100000:0.0:1789708803.828202:0:22841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365603840 00000100:00100000:0.0:1789708803.828239:0:22841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365603968 00000100:00100000:0.0:1789708803.828242:0:22841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365603968 00000100:00100000:0.0:1789708803.828284:0:22841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708803.828295:0:22841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+4:22873:x1876645365603840:12345-0@lo:104: 00010000:00010000:0.0:1789708803.828306:0:22841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828362:0:22841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708803.828369:0:22841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+4:22873:x1876645365603840:12345-0@lo:104: Request processed in 77us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708803.828376:0:22841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708803.828404:0:22841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708803.828411:0:22841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:22873:x1876645365603968:12345-0@lo:104: 00010000:00010000:0.0:1789708803.828426:0:22841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828463:0:22841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708803.828469:0:22841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:22873:x1876645365603968:12345-0@lo:104: Request processed in 59us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708803.828475:0:22841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789708803.828505:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708803.828511:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828519:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a200 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708803.828523:0:22846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828531:0:22846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708803.828538:0:22846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708803.828544:0:22846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708803.828574:0:22846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828580:0:22846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708803.828600:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828607:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103a200/0xf45f43947e47ec88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ec8f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828636:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708803.828640:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828645:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ae00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708803.828648:0:22846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828654:0:22846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708803.828659:0:22846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708803.828663:0:22846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708803.828677:0:22846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828683:0:22846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708803.828689:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828695:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103ae00/0xf45f43947e47ec7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ec81 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828705:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708803.828707:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708803.828708:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708803.828715:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708803.828735:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365604096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708803.828764:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708803.828785:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708803.828790:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365604224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708803.828810:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708803.828840:0:22844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365604096 00000100:00100000:0.0:1789708803.828844:0:22844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365604096 00010000:00010000:0.0:1789708803.828858:0:22844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee1103a800/0xf45f43947e47ec8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ec88 expref: 24 pid: 22852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708803.828889:0:22844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365604224 00000100:00100000:0.0:1789708803.828892:0:22844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365604224 00010000:00010000:0.0:1789708803.828902:0:22844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee1103ac00/0xf45f43947e47ec81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ec7a expref: 25 pid: 22852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708803.828913:0:22844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708803.828920:0:22844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+25:3615:x1876645365604096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708803.828930:0:22844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708803.828934:0:22844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee1103a800/0xf45f43947e47ec8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ec88 expref: 25 pid: 22852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828943:0:22844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee1103a800/0xf45f43947e47ec8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ec88 expref: 25 pid: 22852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.828957:0:22844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708803.828983:0:22844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+25:3615:x1876645365604096:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708803.828988:0:22844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708803.829001:0:22844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708803.829007:0:22844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3615:x1876645365604224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708803.829020:0:22844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708803.829024:0:22844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee1103ac00/0xf45f43947e47ec81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ec7a expref: 24 pid: 22852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.829031:0:22844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee1103ac00/0xf45f43947e47ec81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ec7a expref: 24 pid: 22852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.829041:0:22844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.829049:0:22844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789708803.829061:0:22844:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024365707s 00010000:00010000:0.0:1789708803.829065:0:22844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.829072:0:22844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.829078:0:22844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.829085:0:22844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.829091:0:22844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708803.829094:0:22844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.829102:0:22844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.829116:0:22844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708803.829125:0:22844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708803.829148:0:22844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3615:x1876645365604224:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708803.829154:0:22844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708803.829191:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365604224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708803.829201:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365604096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708803.831313:0:22873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee1103a800/0xf45f43947e47ec8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ec88 expref: 23 pid: 22852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708803.831332:0:22873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365603840:0@lo:104: 00010000:00010000:1.0:1789708803.831343:0:22873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee1103ac00/0xf45f43947e47ec81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ec7a expref: 22 pid: 22852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708803.831351:0:22873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22873:1876645365603968:0@lo:104: 00010000:00010000:1.0:1789708803.831371:0:22873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.831390:0:22873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.831397:0:22873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708803.831415:0:22873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee029c8a00/0xf45f43947e47eded lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789708803.834809:0:25182:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789708803.834819:0:25182:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789708803.834865:0:25182:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789708803.834925:0:25182:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789708803.834960:0:25182:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789708803.834980:0:25182:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789708803.836328:0:25182:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789708803.838966:0:25182:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789708804.775033:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789708805.236721:0:25248:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789708805.236973:0:25248:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789708805.422947:0:22855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708805.422955:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bee2d93d800 from 14 10000000:01000000:3.0:1789708805.422961:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708805.423002:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4600/0xf45f43947e47edf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.423013:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4600/0xf45f43947e47edf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.423024:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4600/0xf45f43947e47edf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708805.423062:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365604352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708805.423126:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708805.423173:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22133a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708805.423227:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365604352 00000100:00100000:0.0:1789708805.423235:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365604352 00000100:00100000:0.0:1789708805.424930:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789708805.424948:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:22855:x1876645365604352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708805.424965:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708805.424983:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d1e00/0xf45f43947e47edfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47edf4 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708805.425009:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d1e00/0xf45f43947e47edfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47edf4 expref: 23 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708805.425019:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d1e00/0xf45f43947e47edfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47edf4 expref: 23 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708805.425027:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1e00, rc 0) 00000100:00100000:0.0:1789708805.425084:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:22855:x1876645365604352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708805.425102:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789708805.425372:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365604352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708805.425389:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4600/0xf45f43947e47edf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47edfb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.425397:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4600/0xf45f43947e47edf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47edfb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708805.425755:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365604480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789708805.425796:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708805.425824:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee22133a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708805.425838:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365604480 00000100:00100000:3.0:1789708805.425857:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365604480 00000100:00100000:3.0:1789708805.425891:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789708805.425898:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:22855:x1876645365604480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789708805.425913:0:22849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789708805.425930:0:22849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789708805.425933:0:22849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789708805.426032:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:22855:x1876645365604480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708805.426041:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789708805.426073:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365604480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789708805.426127:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708805.426138:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4600/0xf45f43947e47edf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47edfb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.426147:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb4600/0xf45f43947e47edf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47edfb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708805.426157:0:22855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708805.426160:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bed0343c000 from 14 10000000:01000000:3.0:1789708805.426163:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708805.426179:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5800/0xf45f43947e47ee02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.426186:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5800/0xf45f43947e47ee02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.426194:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5800/0xf45f43947e47ee02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708805.426206:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365604608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708805.426236:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708805.426249:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f006c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708805.426279:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365604608 00000100:00100000:3.0:1789708805.426283:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365604608 00000100:00100000:3.0:1789708805.427911:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789708805.427924:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:22855:x1876645365604608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708805.427938:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708805.427953:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb4000/0xf45f43947e47ee09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ee02 expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.427977:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb4000/0xf45f43947e47ee09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ee02 expref: 24 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.427996:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb4000/0xf45f43947e47ee09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ee02 expref: 24 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.428005:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4000, rc 0) 00000100:00100000:3.0:1789708805.428058:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:22855:x1876645365604608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708805.428064:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789708805.428117:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365604608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708805.428130:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5800/0xf45f43947e47ee02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ee09 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.428140:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5800/0xf45f43947e47ee02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ee09 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708805.428192:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365604736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789708805.428224:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708805.428251:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f006c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708805.428282:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365604736 00000100:00100000:3.0:1789708805.428287:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365604736 00000100:00100000:3.0:1789708805.428327:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789708805.428333:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:22855:x1876645365604736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789708805.428344:0:22851:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789708805.428360:0:22851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789708805.428363:0:22851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789708805.435161:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:22855:x1876645365604736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 6818us (6927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708805.435190:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789708805.438375:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365604736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789708805.440564:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708805.440579:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5800/0xf45f43947e47ee02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ee09 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.440601:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5800/0xf45f43947e47ee02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ee09 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708805.804990:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708806.822986:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708807.015367:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708807.015387:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365604864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708807.015446:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708807.015485:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365604864 00000100:00100000:1.0:1789708807.015492:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365604864 00000100:00100000:1.0:1789708807.015529:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789708807.015536:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365604864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789708807.015578:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789708807.015616:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365604864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708807.015622:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789708807.015656:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365604864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708807.015975:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708807.015985:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365604992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708807.016018:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708807.017966:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365604992 00000100:00100000:0.0:1789708807.017977:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365604992 00000100:00100000:0.0:1789708807.018038:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708807.018048:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365604992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789708807.018078:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789708807.018890:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365604992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 841us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708807.018899:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708807.019039:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365604992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789708807.021056:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789708807.849511:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708808.042106:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708808.042131:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365605120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708808.042199:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708808.042733:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365605120 00000100:00100000:3.0:1789708808.042743:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365605120 00000100:00100000:3.0:1789708808.042823:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708808.042833:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365605120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789708808.042868:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708808.042923:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365605120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708808.042931:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789708808.043550:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708808.043592:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365605120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708808.562474:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365605248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789708808.562552:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708808.562729:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365605248 00000100:00100000:1.0:1789708808.562738:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365605248 00000100:00100000:1.0:1789708808.562797:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789708808.562808:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365605248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708808.562983:0:22863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789708808.563045:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365605248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 239us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708808.563053:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708808.563130:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed098d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365605248:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789708808.871024:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708809.082250:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708809.082279:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789708809.082284:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708809.082302:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bed08562000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708809.082329:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f3100 x1876645365605760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708809.082362:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708809.082365:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789708809.082368:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708809.082373:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bee04469000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789708809.082384:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bed0a2f1f80 x1876645365606144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708809.082442:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365605888:0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.082484:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365605504:0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.082521:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708809.082521:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708809.082564:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365606272:0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.082587:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708809.082598:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365605376:0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.082604:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365606784:0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.082633:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708809.082681:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365605632:0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.082706:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708809.082725:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365606400:0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.082744:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708809.082783:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365605888 00000100:00100000:1.0:1789708809.082791:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365605888 00000100:00100000:1.0:1789708809.082838:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365606272 00000100:00100000:1.0:1789708809.082848:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365606272 00000100:00100000:1.0:1789708809.082865:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365606784 00000100:00100000:1.0:1789708809.082868:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365606784 00000100:00100000:1.0:1789708809.082893:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365606400 00000100:00100000:1.0:1789708809.082896:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365606400 00000100:00100000:1.0:1789708809.082914:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708809.082922:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365605888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.082971:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365605888:12345-0@lo:400:kworker.0 Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708809.082979:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708809.082995:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789708809.083001:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365606272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.083029:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365606272:12345-0@lo:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708809.083034:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789708809.083044:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789708809.083048:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365606784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.083074:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365606784:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708809.083079:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789708809.083088:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789708809.083093:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365606400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.083119:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365606400:12345-0@lo:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708809.083125:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789708809.083141:0:25134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365605504 00000100:00100000:1.0:1789708809.083145:0:25134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365605504 00000100:00100000:1.0:1789708809.083177:0:25134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789708809.083184:0:25134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365605504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.083218:0:25134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365605504:12345-0@lo:400:kworker.0 Request processed in 36us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708809.083223:0:25134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789708809.083247:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365605632 00000100:00100000:1.0:1789708809.083250:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365605632 00000100:00100000:1.0:1789708809.083301:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708809.083307:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365605632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.083337:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365605632:12345-0@lo:400:kworker.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708809.083342:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789708809.083361:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708809.083366:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789708809.083368:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789708809.083400:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365605632:0@lo:400:kworker.0 00010000:00080000:1.0:1789708809.083412:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2f2a00 x1876645365606400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708809.083421:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365606400:0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.083453:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365605504:0@lo:400:kworker.0 00010000:00080000:1.0:1789708809.083463:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2f0700 x1876645365606272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708809.083471:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365606272:0@lo:400:kworker.0 00010000:00080000:1.0:1789708809.083480:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2f2680 x1876645365606784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708809.083501:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365606784:0@lo:400:kworker.0 00010000:00080000:0.0:1789708809.098507:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2f3800 x1876645365605888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708809.098528:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365605888:0@lo:400:kworker.0 00000100:00100000:0.0:1789708809.098539:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365606528:0@lo:400:kworker.0 00000100:00100000:0.0:1789708809.098603:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708809.098668:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365605760:0@lo:8:kworker.0 00000100:00100000:0.0:1789708809.098697:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708809.098713:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365606144:0@lo:8:kworker.0 00000100:00100000:0.0:1789708809.098730:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708809.098762:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365606528 00000100:00100000:0.0:1789708809.098768:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365606528 00000100:00100000:0.0:1789708809.098828:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789708809.098842:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365606528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708809.098893:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365606528:12345-0@lo:400:kworker.0 Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708809.098899:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789708809.098918:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789708809.098937:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2f0e00 x1876645365606528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708809.098946:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365606528:0@lo:400:kworker.0 00000100:00100000:2.0:1789708809.100870:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708809.100965:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365605760 00000100:00100000:2.0:1789708809.100972:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365605760 00000100:00100000:2.0:1789708809.100994:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365606144 00000100:00100000:2.0:1789708809.100996:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365606144 00000100:00100000:2.0:1789708809.101009:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708809.101015:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876645365605760:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789708809.101043:0:24365:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:2.0:1789708809.101069:0:24365:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45f43947e47ee10 00002000:00100000:2.0:1789708809.101081:0:24365:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bed03855000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789708809.101086:0:24365:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789708809.101088:0:24365:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789708809.101296:0:24365:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789708809.101317:0:24365:0:(import.c:65:import_set_state_nolock()) ffff9bed03851000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708809.101368:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1876645365605760:12345-0@lo:8:kworker.0 Request processed in 353us (2670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708809.101375:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708809.101389:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708809.101393:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876645365606144:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789708809.101407:0:24365:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:2.0:1789708809.101421:0:24365:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45f43947e47ee17 00002000:00100000:2.0:1789708809.101427:0:24365:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9bed03851800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789708809.101430:0:24365:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789708809.101432:0:24365:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789708809.101450:0:24365:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789708809.101459:0:24365:0:(import.c:65:import_set_state_nolock()) ffff9bed03852800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708809.101482:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3614:x1876645365606144:12345-0@lo:8:kworker.0 Request processed in 88us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708809.101496:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708809.101525:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365606016:0@lo:400:kworker.0 00000100:00100000:2.0:1789708809.101553:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708809.101570:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365606016 00000100:00100000:2.0:1789708809.101573:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365606016 00000100:00100000:2.0:1789708809.101591:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708809.101595:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365606016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708809.101621:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365606016:12345-0@lo:400:kworker.0 Request processed in 25us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708809.101626:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708809.101650:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365606016:0@lo:400:kworker.0 00000100:00100000:2.0:1789708809.101657:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876645365606656:0@lo:400:kworker.0 00000100:00100000:2.0:1789708809.101681:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708809.101885:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365605376 00000100:00100000:0.0:1789708809.101890:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365605376 00000100:00100000:0.0:1789708809.101925:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789708809.101932:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3617:x1876645365605376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708809.101977:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3617:x1876645365605376:12345-0@lo:400:kworker.0 Request processed in 47us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708809.101982:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789708809.102008:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365606656 00000100:00100000:1.0:1789708809.102012:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365606656 00010000:00080000:0.0:1789708809.102015:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2f3100 x1876645365605760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708809.102028:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789708809.102034:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789708809.102039:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789708809.102042:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bed08562000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789708809.102048:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789708809.102053:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876645365606656:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1789708809.102061:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789708809.102066:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876645365605760:0@lo:8:kworker.0 00010000:00080000:0.0:1789708809.102078:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2f1f80 x1876645365606144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708809.102087:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00100000:1.0:1789708809.102088:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876645365606656:12345-0@lo:400:kworker.0 Request processed in 36us (407us total) trans 0 rc 0/0 00000100:00080000:0.0:1789708809.102091:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789708809.102094:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:1.0:1789708809.102095:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789708809.102096:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9bee04469000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789708809.102106:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789708809.102109:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876645365606144:0@lo:8:kworker.0 00000100:00080000:1.0:1789708809.102113:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789708809.102218:0:22883:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789708809.102481:0:22883:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379912219304ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789708809.102488:0:22883:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789708809.102537:0:23604:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789708809.102560:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365605376:0@lo:400:kworker.0 00010000:00080000:2.0:1789708809.102570:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a2f1c00 x1876645365606656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708809.102579:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876645365606656:0@lo:400:kworker.0 00000004:00080000:1.0:1789708809.102581:0:23604:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 379912320539ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789708809.102585:0:23604:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789708809.104530:0:22884:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789708809.104562:0:22884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22884:1876645365607040:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789708809.104629:0:23605:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789708809.104632:0:22884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708809.104644:0:23605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23605:1876645365607296:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789708809.104728:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365607168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708809.104768:0:22884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed07f22240 going to sleep for 11 seconds 00000100:00100000:2.0:1789708809.104797:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365607040 00000100:00100000:2.0:1789708809.104803:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365607040 00000100:00100000:2.0:1789708809.104857:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708809.104867:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22884:x1876645365607040:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789708809.104893:0:23605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708809.104908:0:23605:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee180040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708809.109555:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365606912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708809.109638:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708809.109701:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365606912 00000100:00100000:1.0:1789708809.109709:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365606912 00000100:00100000:1.0:1789708809.109753:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708809.109762:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365606912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708809.109806:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789708809.109861:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876645365606912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708809.109868:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708809.109894:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365607296 00000100:00100000:1.0:1789708809.109898:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365607296 00000100:00100000:1.0:1789708809.109926:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789708809.109932:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23605:x1876645365607296:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:1.0:1789708809.109998:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789708809.110029:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed08bd8000 x1876645365606912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708809.110047:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365606912:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1789708809.116907:0:24365:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789708809.116922:0:24365:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789708809.116929:0:24365:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:0.0:1789708809.125743:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708809.125992:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365607168 00000100:00100000:0.0:1789708809.126002:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365607168 00000100:00100000:0.0:1789708809.126047:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708809.127478:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3616:x1876645365607168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789708809.127522:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789708809.127592:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3616:x1876645365607168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 732us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708809.127601:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789708809.127647:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee363cce00 x1876645365607168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708809.127670:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365607168:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1789708809.129042:0:22837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789708809.159379:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708809.159394:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ec59f45/0xf45f43947e47ee1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.159410:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789708809.159414:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708809.159421:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ec59f45/0xf45f43947e47ee1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.159438:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ec59f45/0xf45f43947e47ee1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.159448:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ec59f45/0xf45f43947e47ee1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.159455:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ec59f45/0xf45f43947e47ee1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.159477:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708809.164852:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708809.164866:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ec59f45/0xf45f43947e47ee1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.164880:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebce00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708809.164885:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ec59f45/0xf45f43947e47ee1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.164895:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ec59f45/0xf45f43947e47ee1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.164920:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ec59f45/0xf45f43947e47ee1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.164927:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ec59f45/0xf45f43947e47ee1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.164948:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708809.164950:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708809.164966:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708809.169632:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708809.169651:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013f63a01/0xf45f43947e47ee25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.169669:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789708809.169674:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708809.169681:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013f63a01/0xf45f43947e47ee25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.169696:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013f63a01/0xf45f43947e47ee25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.169707:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013f63a01/0xf45f43947e47ee25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.169714:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013f63a01/0xf45f43947e47ee25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.169738:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708809.169766:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708809.169783:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013f63a01/0xf45f43947e47ee25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.169791:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708809.169796:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013f63a01/0xf45f43947e47ee25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.169804:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013f63a01/0xf45f43947e47ee25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.169833:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013f63a01/0xf45f43947e47ee25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.169841:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013f63a01/0xf45f43947e47ee25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.169871:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.169873:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.169875:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789708809.173231:0:24367:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789708809.173244:0:24367:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789708809.173384:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23605:x1876645365607296:12345-0@lo:7:osp-pre-1-1.0 Request processed in 63447us (68485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708809.173396:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708809.174024:0:23605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23605:1876645365607296:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789708809.174043:0:23605:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789708809.174087:0:23605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23605:1876645365607424:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789708809.174129:0:23605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708809.174163:0:23605:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee180040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708809.176904:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365607424 00000100:00100000:1.0:1789708809.176930:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365607424 00000100:00100000:1.0:1789708809.177021:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708809.177032:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23605:x1876645365607424:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789708809.177076:0:24366:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789708809.177161:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23605:x1876645365607424:12345-0@lo:5:osp-pre-1-1.0 Request processed in 132us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708809.177168:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00002000:00010000:0.0:1789708809.179375:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708809.179389:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aca4149/0xf45f43947e47ee2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.179405:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789708809.179409:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708809.179416:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aca4149/0xf45f43947e47ee2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.179430:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aca4149/0xf45f43947e47ee2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.179440:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aca4149/0xf45f43947e47ee2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.179446:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007aca4149/0xf45f43947e47ee2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.179471:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708809.180030:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708809.180038:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007aca4149/0xf45f43947e47ee2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.180047:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708809.180051:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007aca4149/0xf45f43947e47ee2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.180061:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007aca4149/0xf45f43947e47ee2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.180079:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007aca4149/0xf45f43947e47ee2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.180086:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aca4149/0xf45f43947e47ee2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.180114:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.180116:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.180118:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708809.180231:0:23605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23605:1876645365607424:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789708809.180246:0:23605:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789708809.180319:0:23605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23605:1876645365607552:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789708809.180370:0:23605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708809.180394:0:23605:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee180040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708809.180634:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365607552 00000100:00100000:1.0:1789708809.180641:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365607552 00000100:00100000:1.0:1789708809.180697:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708809.180707:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23605:x1876645365607552:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789708809.180746:0:24367:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:0.0:1789708809.181119:0:23594:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1789708809.181354:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708809.181361:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47ee33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.181374:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789708809.181378:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708809.181383:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47ee33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.181401:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47ee33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.181410:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47ee33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.181417:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47ee33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.181434:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708809.181551:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708809.181557:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47ee33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.181566:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708809.181570:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47ee33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.181578:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47ee33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.181590:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47ee33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.181598:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d75dd8/0xf45f43947e47ee33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.181617:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708809.181619:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708809.181621:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708809.183922:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708809.183934:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000823ea0e1/0xf45f43947e47ee3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.183949:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789708809.183952:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708809.183958:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000823ea0e1/0xf45f43947e47ee3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.183970:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000823ea0e1/0xf45f43947e47ee3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.183980:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000823ea0e1/0xf45f43947e47ee3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.183988:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000823ea0e1/0xf45f43947e47ee3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184009:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789708809.184653:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708809.184660:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47ee41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184681:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789708809.184684:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708809.184688:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47ee41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184698:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47ee41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184708:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47ee41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184715:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47ee41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184730:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789708809.184836:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708809.184842:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000823ea0e1/0xf45f43947e47ee3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184850:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708809.184854:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000823ea0e1/0xf45f43947e47ee3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184863:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000823ea0e1/0xf45f43947e47ee3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184889:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000823ea0e1/0xf45f43947e47ee3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184897:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000823ea0e1/0xf45f43947e47ee3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184915:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708809.184918:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47ee41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184924:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708809.184927:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47ee41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184934:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47ee41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184942:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47ee41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184949:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a276957/0xf45f43947e47ee41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.184959:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708809.184960:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708809.184965:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.186965:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708809.187168:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708809.187179:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47ee48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.187195:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789708809.187199:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708809.187206:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47ee48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.187219:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47ee48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.187229:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47ee48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.187250:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47ee48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.187294:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708809.187810:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708809.187818:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47ee48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.187828:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.187843:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47ee48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.187865:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47ee48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.187881:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47ee48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.187889:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015c5b244/0xf45f43947e47ee48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.187909:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.187911:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.187913:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708809.188672:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789708809.188680:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f4df420/0xf45f43947e47ee4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.188692:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789708809.188696:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708809.188701:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4df420/0xf45f43947e47ee4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.188724:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f4df420/0xf45f43947e47ee4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.188733:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f4df420/0xf45f43947e47ee4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.188742:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f4df420/0xf45f43947e47ee4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708809.188767:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708809.189231:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708809.189249:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f4df420/0xf45f43947e47ee4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.189257:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.189277:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f4df420/0xf45f43947e47ee4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.189286:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f4df420/0xf45f43947e47ee4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.189299:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f4df420/0xf45f43947e47ee4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.189315:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f4df420/0xf45f43947e47ee4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.189331:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.189333:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.189334:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708809.193431:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.193446:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47ee56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.193463:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.193469:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.193475:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47ee56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.193490:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47ee56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.193501:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47ee56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.193509:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47ee56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.193546:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708809.193763:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708809.193779:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47ee56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.193788:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.193793:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47ee56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.193800:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47ee56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.193827:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47ee56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.193835:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c87fb9e2/0xf45f43947e47ee56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.193852:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.193854:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.193856:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708809.194118:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.194124:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bba25edb/0xf45f43947e47ee5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.194133:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.194136:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.194140:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bba25edb/0xf45f43947e47ee5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.194148:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bba25edb/0xf45f43947e47ee5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.194156:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bba25edb/0xf45f43947e47ee5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.194163:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bba25edb/0xf45f43947e47ee5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.194183:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708809.194407:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708809.194413:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bba25edb/0xf45f43947e47ee5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.194421:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.194424:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bba25edb/0xf45f43947e47ee5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.194431:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bba25edb/0xf45f43947e47ee5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.194441:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bba25edb/0xf45f43947e47ee5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.194447:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bba25edb/0xf45f43947e47ee5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.194460:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.194461:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.194463:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708809.196534:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.196546:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.196561:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.196572:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.196578:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.196590:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.196600:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.196608:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.196630:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708809.196839:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708809.196846:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.196854:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ae00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.196869:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.196891:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.196906:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.196913:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.196931:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.196933:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.196935:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708809.197123:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.197129:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.197137:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.197140:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.197143:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.197151:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.197159:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.197173:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.197191:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708809.197383:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708809.197389:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.197396:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.197400:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.197407:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.197419:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.197436:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.197449:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.197450:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.197452:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708809.201826:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708809.201840:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd547fee/0xf45f43947e47ee72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.201857:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789708809.201870:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708809.201876:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd547fee/0xf45f43947e47ee72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.201889:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd547fee/0xf45f43947e47ee72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.201900:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd547fee/0xf45f43947e47ee72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.201908:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd547fee/0xf45f43947e47ee72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.201932:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708809.202558:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708809.202566:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd547fee/0xf45f43947e47ee72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.202576:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708809.202580:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd547fee/0xf45f43947e47ee72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.202588:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd547fee/0xf45f43947e47ee72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.202607:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd547fee/0xf45f43947e47ee72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.202615:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd547fee/0xf45f43947e47ee72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.202639:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.202641:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.202643:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708809.203637:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708809.203652:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47ee79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.203663:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789708809.203667:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708809.203673:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47ee79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.203683:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47ee79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.203692:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47ee79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.203699:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47ee79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.203723:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708809.203760:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708809.203766:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47ee79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.203783:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708809.203786:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47ee79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.203795:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47ee79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.203808:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47ee79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.203826:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47ee79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.203842:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.203844:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.203846:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708809.205311:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708809.205324:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47ee80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.205337:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789708809.205341:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708809.205347:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47ee80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.205357:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47ee80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.205379:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47ee80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.205386:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47ee80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.205400:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708809.205820:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708809.205827:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47ee80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.205837:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebde00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708809.205841:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47ee80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.205849:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47ee80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.205873:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47ee80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.205881:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47ee80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.205899:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.205901:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.205902:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708809.207479:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.207496:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c009b568/0xf45f43947e47ee87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.207508:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.207512:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.207517:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c009b568/0xf45f43947e47ee87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.207529:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c009b568/0xf45f43947e47ee87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.207539:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c009b568/0xf45f43947e47ee87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.207546:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c009b568/0xf45f43947e47ee87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.207564:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708809.207955:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708809.207962:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c009b568/0xf45f43947e47ee87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.207983:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ac00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708809.207987:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c009b568/0xf45f43947e47ee87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.207995:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c009b568/0xf45f43947e47ee87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.208009:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c009b568/0xf45f43947e47ee87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.208016:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c009b568/0xf45f43947e47ee87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.208031:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.208033:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.208035:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708809.209031:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.209039:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b598e02/0xf45f43947e47ee8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.209052:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.209055:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.209061:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b598e02/0xf45f43947e47ee8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.209071:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b598e02/0xf45f43947e47ee8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.209094:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b598e02/0xf45f43947e47ee8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.209102:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b598e02/0xf45f43947e47ee8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.209118:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708809.209274:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708809.209281:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b598e02/0xf45f43947e47ee8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.209289:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.209292:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b598e02/0xf45f43947e47ee8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.209301:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b598e02/0xf45f43947e47ee8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.209311:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b598e02/0xf45f43947e47ee8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.209318:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b598e02/0xf45f43947e47ee8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.209331:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.209338:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.209340:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708809.214055:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.214070:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.214088:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.214149:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.214156:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.214171:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.214180:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.214188:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.214227:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708809.214472:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708809.214480:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.214488:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708809.214493:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.214503:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.214541:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.214549:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000277f4cf4/0xf45f43947e47ee95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.214570:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.214572:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.214574:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708809.216569:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.216581:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.216596:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.216600:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.216606:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.216619:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.216628:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.216636:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.217370:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789708809.223248:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.223289:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47eea3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.223306:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.223316:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.223323:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47eea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.223338:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47eea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.223349:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47eea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.223356:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47eea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.230427:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789708809.230440:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.230455:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ae00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708809.230460:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.230470:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.230492:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.230498:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004425ee7d/0xf45f43947e47ee9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.230544:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708809.230548:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47eea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.230554:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509000 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708809.230557:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47eea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.230565:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47eea3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.230575:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47eea3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.230582:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.230584:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.230586:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.234480:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789708809.234493:0:24365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072aaa00c/0xf45f43947e47eea3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708809.235355:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.235365:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7722615/0xf45f43947e47eeaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.235378:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.235382:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.235389:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7722615/0xf45f43947e47eeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.235403:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7722615/0xf45f43947e47eeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.235420:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7722615/0xf45f43947e47eeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.235427:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7722615/0xf45f43947e47eeaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.235442:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708809.235792:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708809.235800:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7722615/0xf45f43947e47eeaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.235809:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708809.235824:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7722615/0xf45f43947e47eeaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.235846:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7722615/0xf45f43947e47eeaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.235874:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7722615/0xf45f43947e47eeaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.235882:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7722615/0xf45f43947e47eeaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.235900:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.235903:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.235905:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708809.236337:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.236344:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006204215/0xf45f43947e47eeb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.236352:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.236355:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.236360:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006204215/0xf45f43947e47eeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.236369:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006204215/0xf45f43947e47eeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.236377:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006204215/0xf45f43947e47eeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.236384:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006204215/0xf45f43947e47eeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.236412:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708809.236416:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708809.236420:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.236422:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006204215/0xf45f43947e47eeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.236430:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.236433:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006204215/0xf45f43947e47eeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.236440:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006204215/0xf45f43947e47eeb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.236451:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006204215/0xf45f43947e47eeb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.236458:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006204215/0xf45f43947e47eeb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.236470:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.236472:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.236474:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708809.237629:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789708809.237637:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a3459e/0xf45f43947e47eeb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.237649:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789708809.237652:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708809.237656:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a3459e/0xf45f43947e47eeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.237755:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a3459e/0xf45f43947e47eeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.237764:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a3459e/0xf45f43947e47eeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.237782:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a3459e/0xf45f43947e47eeb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.237797:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708809.238166:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708809.238173:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0a3459e/0xf45f43947e47eeb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.238182:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708809.238186:0:22845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a3459e/0xf45f43947e47eeb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.238194:0:22845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a3459e/0xf45f43947e47eeb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.238207:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0a3459e/0xf45f43947e47eeb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.238225:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a3459e/0xf45f43947e47eeb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.238241:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.238243:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.238245:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708809.244146:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708809.244163:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008018bf8b/0xf45f43947e47eebf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.244181:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789708809.244185:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708809.244205:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008018bf8b/0xf45f43947e47eebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.244220:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008018bf8b/0xf45f43947e47eebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.244230:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008018bf8b/0xf45f43947e47eebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.244238:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008018bf8b/0xf45f43947e47eebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.244786:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:3.0:1789708809.253486:0:25183:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1789708809.253556:0:25183:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789708809.253560:0:25183:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789708809.253700:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23605:x1876645365607552:12345-0@lo:5:osp-pre-1-1.0 Request processed in 72990us (73326us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789708809.253711:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789708809.253755:0:23605:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789708809.253762:0:23605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23605:1876645365607552:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789708809.253787:0:23605:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1789708809.253832:0:23605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23605:1876645365607680:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789708809.253865:0:23605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708809.253887:0:23605:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee180040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708809.253904:0:22869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365607680 00000100:00100000:3.0:1789708809.253910:0:22869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365607680 00000100:00100000:3.0:1789708809.253950:0:22869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708809.253957:0:22869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23605:x1876645365607680:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789708809.254003:0:22869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23605:x1876645365607680:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708809.254020:0:22869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789708809.254049:0:23605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee363cc700 x1876645365607680/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789708825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708809.254061:0:23605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23605:1876645365607680:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1789708809.255435:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708809.255447:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008018bf8b/0xf45f43947e47eebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.255460:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708809.255477:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008018bf8b/0xf45f43947e47eebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.255489:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008018bf8b/0xf45f43947e47eebf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.255521:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008018bf8b/0xf45f43947e47eebf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.255530:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008018bf8b/0xf45f43947e47eebf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.255551:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.255553:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.255555:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708809.256433:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708809.256444:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ee6a14/0xf45f43947e47eec6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.256457:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1789708809.256461:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708809.256467:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021ee6a14/0xf45f43947e47eec6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.256479:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021ee6a14/0xf45f43947e47eec6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.256488:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ee6a14/0xf45f43947e47eec6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.256496:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021ee6a14/0xf45f43947e47eec6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.256528:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708809.256789:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708809.256797:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021ee6a14/0xf45f43947e47eec6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.256805:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4800 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.256809:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ee6a14/0xf45f43947e47eec6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.256818:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ee6a14/0xf45f43947e47eec6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.256832:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021ee6a14/0xf45f43947e47eec6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.256850:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021ee6a14/0xf45f43947e47eec6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.256869:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.256870:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.256872:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789708809.257648:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708809.257656:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d5b88c6/0xf45f43947e47eecd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.257685:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1789708809.257689:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708809.257693:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d5b88c6/0xf45f43947e47eecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.257704:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d5b88c6/0xf45f43947e47eecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.257714:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d5b88c6/0xf45f43947e47eecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.257721:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d5b88c6/0xf45f43947e47eecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.257745:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789708809.258080:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708809.258086:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b703496f/0xf45f43947e47eed4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.258589:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1789708809.258593:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708809.258598:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b703496f/0xf45f43947e47eed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.258610:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b703496f/0xf45f43947e47eed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.258630:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b703496f/0xf45f43947e47eed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.258639:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b703496f/0xf45f43947e47eed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.258743:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789708809.259545:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789708809.259552:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f2c7c06/0xf45f43947e47eedb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.259564:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1789708809.259568:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708809.259573:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f2c7c06/0xf45f43947e47eedb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.259583:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f2c7c06/0xf45f43947e47eedb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.259592:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f2c7c06/0xf45f43947e47eedb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708809.259600:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f2c7c06/0xf45f43947e47eedb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263001:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789708809.263015:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d5b88c6/0xf45f43947e47eecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263030:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4a00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.263035:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d5b88c6/0xf45f43947e47eecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263047:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d5b88c6/0xf45f43947e47eecd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263068:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d5b88c6/0xf45f43947e47eecd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263076:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d5b88c6/0xf45f43947e47eecd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263097:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708809.263101:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b703496f/0xf45f43947e47eed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263117:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4c00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.263120:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b703496f/0xf45f43947e47eed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263128:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b703496f/0xf45f43947e47eed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263138:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b703496f/0xf45f43947e47eed4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263146:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b703496f/0xf45f43947e47eed4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263161:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708809.263164:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f2c7c06/0xf45f43947e47eedb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263169:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:2.0:1789708809.263172:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f2c7c06/0xf45f43947e47eedb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263180:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f2c7c06/0xf45f43947e47eedb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263188:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f2c7c06/0xf45f43947e47eedb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.263202:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.263204:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.263206:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.268170:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.268414:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789708809.268426:0:24365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f2c7c06/0xf45f43947e47eedb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.268581:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708809.269123:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708809.269132:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033a957f6/0xf45f43947e47eee2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.269145:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789708809.269150:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708809.269156:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a957f6/0xf45f43947e47eee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.269170:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033a957f6/0xf45f43947e47eee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.269179:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033a957f6/0xf45f43947e47eee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.269188:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033a957f6/0xf45f43947e47eee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.269212:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789708809.269509:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708809.269569:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47eee9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.269588:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789708809.269591:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708809.269595:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47eee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.269604:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47eee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.269612:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47eee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.269619:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47eee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.269635:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789708809.269953:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708809.269960:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033a957f6/0xf45f43947e47eee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.269969:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708809.269974:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a957f6/0xf45f43947e47eee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.269983:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a957f6/0xf45f43947e47eee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.270000:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033a957f6/0xf45f43947e47eee2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.270014:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033a957f6/0xf45f43947e47eee2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.270031:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708809.270034:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47eee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.270040:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebde00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708809.270044:0:25066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47eee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.270052:0:25066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47eee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.270062:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47eee9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.270068:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4f7307/0xf45f43947e47eee9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.270079:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.270081:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.270082:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789708809.270159:0:24365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789708809.270165:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47eef0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.270174:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789708809.270176:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708809.270181:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47eef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.270190:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47eef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.270211:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47eef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.270219:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47eef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708809.270291:0:24365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789708809.270325:0:24365:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:2.0:1789708809.270424:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22884:x1876645365607040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 165555us (165787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708809.270433:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789708809.271080:0:22884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bd8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22884:1876645365607040:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789708809.271095:0:22884:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1789708809.271148:0:22884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22884:1876645365607808:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789708809.271185:0:22884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708809.271210:0:22884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee189e5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789708809.271225:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365607808 00000100:00100000:0.0:1789708809.271231:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365607808 00000100:00100000:0.0:1789708809.271295:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708809.271304:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22884:x1876645365607808:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789708809.271337:0:25061:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1789708809.276475:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22884:x1876645365607808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5165us (5282us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789708809.276489:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708809.276552:0:22884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22884:1876645365607808:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789708809.276576:0:22884:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1789708809.283921:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708809.283937:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47eef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.283970:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:1.0:1789708809.283976:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47eef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.283988:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47eef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.284010:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47eef0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.284018:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e9cc5c/0xf45f43947e47eef0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708809.284047:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.284049:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708809.284051:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708809.290157:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789708809.894876:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789708809.913415:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708810.727890:0:23614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789708810.920070:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708811.954307:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708812.134805:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708812.134829:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365607936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789708812.134898:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708812.137331:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365607936 00000100:00100000:1.0:1789708812.137345:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365607936 00000100:00100000:1.0:1789708812.137419:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789708812.137429:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365607936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789708812.137463:0:22863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789708812.137538:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365607936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708812.137561:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789708812.137611:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365607936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789708812.139639:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789708812.139658:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365608064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708812.139727:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708812.139775:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365608064 00000100:00100000:3.0:1789708812.139782:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365608064 00000100:00100000:3.0:1789708812.139831:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708812.139839:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365608064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708812.139865:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708812.139900:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365608064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708812.139907:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708812.139947:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365608064:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789708812.140122:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789708812.966527:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708813.162444:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708813.162464:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365608192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789708813.162528:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708813.162565:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365608192 00000100:00100000:3.0:1789708813.162571:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365608192 00000100:00100000:3.0:1789708813.162623:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708813.162631:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365608192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789708813.162651:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708813.162689:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365608192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708813.162709:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708813.162750:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365608192:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789708813.162798:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789708813.440942:0:25538:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789708813.670864:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708813.670886:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365608320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789708813.670951:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708813.671240:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365608320 00000100:00100000:1.0:1789708813.671248:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365608320 00000100:00100000:1.0:1789708813.671614:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789708813.671623:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365608320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708813.671657:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789708813.672650:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365608320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1023us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708813.672659:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789708813.686623:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365608320:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789708813.990816:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708814.186346:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365608448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708814.186419:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708814.186480:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708814.186487:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365608576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708814.186510:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708814.186542:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365608448 00000100:00100000:0.0:1789708814.186550:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365608448 00000100:00100000:0.0:1789708814.186592:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365608576 00000100:00100000:0.0:1789708814.186595:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365608576 00000100:00100000:0.0:1789708814.186613:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708814.186623:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876645365608448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789708814.186652:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789708814.186708:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876645365608448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708814.186716:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708814.186733:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708814.187482:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365608704:0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.187521:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708814.187546:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365609216:0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.187569:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708814.187584:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365609728:0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.187606:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708814.187628:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789708814.187633:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365608832:0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.187657:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708814.187676:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365609344:0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.187714:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708814.187732:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365609856:0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.187780:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365608576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789708814.187794:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789708814.187823:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365608576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1084us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708814.187830:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789708814.187864:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708814.187876:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365609728 00000100:00100000:0.0:1789708814.187880:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365609728 00000100:00100000:0.0:1789708814.187909:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365609344 00000100:00100000:0.0:1789708814.187912:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365609344 00000100:00100000:0.0:1789708814.187931:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708814.187938:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365609728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.187971:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365609728:12345-0@lo:400:kworker.0 Request processed in 34us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708814.187978:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708814.187990:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789708814.187995:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365609344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.188023:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876645365609344:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708814.188028:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789708814.188044:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708814.188059:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365609088:0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.188083:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708814.188100:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365609600:0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.188137:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708814.188155:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789708814.188161:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365608960:0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.188182:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708814.188196:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365609472:0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.188216:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708814.188238:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365609088 00000100:00100000:0.0:1789708814.188242:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365609088 00000100:00100000:0.0:1789708814.188282:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365609600 00000100:00100000:0.0:1789708814.188285:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365609600 00000100:00100000:0.0:1789708814.188302:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365609472 00000100:00100000:0.0:1789708814.188305:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365609472 00000100:00100000:0.0:1789708814.188319:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708814.188324:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365609088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.188357:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365609088:12345-0@lo:400:kworker.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708814.188363:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708814.188375:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789708814.188381:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365609600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.188408:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365609600:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708814.188414:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789708814.188424:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789708814.188430:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365609472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.188456:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365609472:12345-0@lo:400:kworker.0 Request processed in 26us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708814.188462:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789708814.188478:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789708814.188481:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708814.188929:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789708814.188959:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086f8000 x1876645365609728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708814.188973:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365609728:0@lo:400:kworker.0 00010000:00080000:3.0:1789708814.189010:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086f9f80 x1876645365609344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708814.189020:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876645365609344:0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.189047:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365608704 00000100:00100000:3.0:1789708814.189050:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365608704 00000100:00100000:3.0:1789708814.189079:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789708814.189085:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3615:x1876645365608704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.189121:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3615:x1876645365608704:12345-0@lo:400:kworker.0 Request processed in 35us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708814.189127:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789708814.189151:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365609216 00000100:00100000:3.0:1789708814.189155:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365609216 00000100:00100000:3.0:1789708814.189178:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365608960 00000100:00100000:3.0:1789708814.189181:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365608960 00000100:00100000:3.0:1789708814.189202:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708814.189208:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365609216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.189238:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365609216:12345-0@lo:400:kworker.0 Request processed in 30us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708814.189244:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708814.189255:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708814.189276:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365608960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.189303:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365608960:12345-0@lo:400:kworker.0 Request processed in 42us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708814.189309:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708814.189326:0:25134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365608832 00000100:00100000:3.0:1789708814.189330:0:25134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365608832 00000100:00100000:3.0:1789708814.189363:0:25134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789708814.189369:0:25134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365608832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.189400:0:25134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365608832:12345-0@lo:400:kworker.0 Request processed in 32us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708814.189406:0:25134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789708814.189434:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365608832:0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.189443:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3615:1876645365608704:0@lo:400:kworker.0 00000100:00100000:3.0:1789708814.189454:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365609216:0@lo:400:kworker.0 00010000:00080000:0.0:1789708814.189720:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086fb480 x1876645365609472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708814.189730:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365609472:0@lo:400:kworker.0 00010000:00080000:0.0:1789708814.189803:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086fb800 x1876645365609088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708814.189825:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365609088:0@lo:400:kworker.0 00010000:00080000:0.0:1789708814.189841:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086fad80 x1876645365609600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708814.189849:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365609600:0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.189871:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365608960:0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.189892:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365609856 00000100:00100000:0.0:1789708814.189895:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365609856 00000100:00100000:0.0:1789708814.189984:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789708814.189991:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365609856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.190036:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876645365609856:12345-0@lo:400:kworker.0 Request processed in 46us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708814.190042:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1789708814.190735:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086f9c00 x1876645365609856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708814.190758:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876645365609856:0@lo:400:kworker.0 00000100:00100000:2.0:1789708814.191359:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365608576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708814.191378:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365608448:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789708814.191524:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789708814.191529:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:0.0:1789708814.257869:0:25590:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708814.258101:0:25590:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789708815.022345:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789708815.083119:0:25640:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789708815.083533:0:25640:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1789708815.227528:0:25183:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:3.0:1789708815.364108:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708815.364204:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357174656 00000100:00100000:2.0:1789708815.364217:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357174656 00000100:00100000:2.0:1789708815.364414:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:2.0:1789708815.364424:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2394:x1876645357174656:12345-192.168.201.52@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789708815.364462:0:22851:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e05fc1a0-5078-439b-8c88-b0181334973b@192.168.201.52@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:2.0:1789708815.364512:0:22851:0:(genops.c:1384:class_connect()) connect: client e05fc1a0-5078-439b-8c88-b0181334973b, cookie 0xf45f43947e47eef7 00000100:00080000:2.0:1789708815.364708:0:22851:0:(import.c:65:import_set_state_nolock()) ffff9bed03209000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708815.364806:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+5:2394:x1876645357174656:12345-192.168.201.52@tcp:250:mount.lustre.0 Request processed in 381us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708815.364815:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:2.0:1789708815.369126:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708815.370080:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357174784 00000100:00100000:3.0:1789708815.370094:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357174784 00000100:00100000:3.0:1789708815.370163:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:3.0:1789708815.370175:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+5:18217:x1876645357174784:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789708815.370196:0:22849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708815.370217:0:22849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47eefe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e5be expref: -99 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708815.370252:0:22849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47eefe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5be expref: 6 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708815.370732:0:22849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb5a00/0xf45f43947e47eefe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5be expref: 6 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708815.370875:0:22849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5a00, rc 0) 00000100:00100000:2.0:1789708815.371880:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+6:18217:x1876645357174784:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 1572us (2632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708815.371901:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:2.0:1789708815.381921:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708815.383767:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357174912 00000100:00100000:3.0:1789708815.383783:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357174912 00000100:00100000:3.0:1789708815.383852:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:3.0:1789708815.383863:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+6:18217:x1876645357174912:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789708815.384030:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+6:18217:x1876645357174912:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 168us (2118us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708815.384039:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:3.0:1789708815.390430:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708815.390637:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357175040 00000100:00100000:0.0:1789708815.390650:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357175040 00000100:00100000:0.0:1789708815.390732:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:0.0:1789708815.390744:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+6:18217:x1876645357175040:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789708815.390765:0:22849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708815.390786:0:22849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d0200/0xf45f43947e47ef05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e5c5 expref: -99 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708815.390840:0:22849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d0200/0xf45f43947e47ef05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5c5 expref: 7 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708815.390853:0:22849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d0200/0xf45f43947e47ef05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5c5 expref: 7 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708815.390865:0:22849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0200, rc 0) 00000100:00100000:0.0:1789708815.390943:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+7:18217:x1876645357175040:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 201us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708815.390951:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:0.0:1789708815.404211:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708815.405358:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357175168 00000100:00100000:3.0:1789708815.405373:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357175168 00000100:00100000:3.0:1789708815.405434:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:3.0:1789708815.405445:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+7:18217:x1876645357175168:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789708815.405644:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+8:18217:x1876645357175168:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 200us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708815.405665:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:2.0:1789708815.427607:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708815.427764:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357175296 00000100:00100000:1.0:1789708815.427777:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357175296 00000100:00100000:1.0:1789708815.427835:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:1.0:1789708815.427845:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36242c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+8:18217:x1876645357175296:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789708815.428028:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36242c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+8:18217:x1876645357175296:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 184us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708815.428037:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:1.0:1789708815.432200:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708815.432760:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357175424 00000100:00100000:0.0:1789708815.432774:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357175424 00000100:00100000:0.0:1789708815.432840:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:0.0:1789708815.432851:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36243450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+8:18235:x1876645357175424:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789708815.433051:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36243450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+8:18235:x1876645357175424:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 201us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708815.433059:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:3.0:1789708815.477312:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708815.477359:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357175552 00000100:00100000:3.0:1789708815.477372:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357175552 00000100:00100000:3.0:1789708815.477440:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:3.0:1789708815.477451:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+8:18235:x1876645357175552:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708815.477696:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+8:18235:x1876645357175552:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 246us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708815.477706:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:2.0:1789708815.510750:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708815.512877:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357175680 00000100:00100000:2.0:1789708815.512893:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357175680 00000100:00100000:2.0:1789708815.512964:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:2.0:1789708815.512976:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee36243050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+8:18235:x1876645357175680:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708815.513251:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee36243050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+8:18235:x1876645357175680:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 275us (2513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708815.513274:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:3.0:1789708815.522486:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708815.526621:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357175808 00000100:00100000:0.0:1789708815.526637:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357175808 00000100:00100000:0.0:1789708815.527156:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:0.0:1789708815.527169:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee061a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+8:18217:x1876645357175808:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789708815.527190:0:22849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708815.527213:0:22849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47ef0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e5f6 expref: -99 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708815.527284:0:22849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47ef0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5f6 expref: 9 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708815.527369:0:22849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d0e00/0xf45f43947e47ef0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5f6 expref: 9 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708815.527381:0:22849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0e00, rc 0) 00000100:00100000:0.0:1789708815.527459:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee061a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+9:18217:x1876645357175808:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 293us (4982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708815.527467:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:2.0:1789708815.550772:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708815.550848:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357175936 00000100:00100000:3.0:1789708815.550860:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357175936 00000100:00100000:3.0:1789708815.550934:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:3.0:1789708815.550946:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+9:18217:x1876645357175936:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789708815.550979:0:22851:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789708815.551013:0:22851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789708815.551017:0:22851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789708815.551021:0:22851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789708815.551024:0:22851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789708815.551026:0:22851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1789708815.561221:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+9:18217:x1876645357175936:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 10263us (10447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708815.561240:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:3.0:1789708815.565931:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708815.566035:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357176064 00000100:00100000:1.0:1789708815.566058:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357176064 00000100:00100000:1.0:1789708815.566190:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:1.0:1789708815.566202:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+9:18217:x1876645357176064:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789708815.566239:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708815.566301:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509200/0xf45f43947e47ef13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e5fd expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708815.566338:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509200/0xf45f43947e47ef13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5fd expref: 10 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708815.566350:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509200/0xf45f43947e47ef13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5fd expref: 10 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708815.566361:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509200, rc 0) 00000100:00100000:1.0:1789708815.566425:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+10:18217:x1876645357176064:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 225us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708815.566434:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:3.0:1789708815.569542:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708815.570765:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357176192 00000100:00100000:2.0:1789708815.570779:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357176192 00000100:00100000:3.0:1789708815.571022:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:3.0:1789708815.571033:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+10:18217:x1876645357176192:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789708815.571465:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+10:18217:x1876645357176192:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 431us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708815.571476:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:0.0:1789708815.575853:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708815.576115:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357176320 00000100:00100000:3.0:1789708815.576127:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357176320 00000100:00100000:3.0:1789708815.576184:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:3.0:1789708815.576195:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+10:18217:x1876645357176320:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789708815.576791:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+10:18217:x1876645357176320:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 596us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708815.576808:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:0.0:1789708815.581791:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708815.589528:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357176448 00000100:00100000:3.0:1789708815.589550:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357176448 00000100:00100000:3.0:1789708815.589945:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:3.0:1789708815.589958:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+10:18240:x1876645357176448:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708815.590315:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+10:18240:x1876645357176448:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 353us (8529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708815.590324:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:2.0:1789708815.603929:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708815.604007:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357176576 00000100:00100000:1.0:1789708815.604020:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357176576 00000100:00100000:1.0:1789708815.604138:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:1.0:1789708815.604150:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+10:18240:x1876645357176576:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708815.604400:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+10:18240:x1876645357176576:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 252us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708815.604410:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:2.0:1789708815.625851:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708815.625992:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708815.626372:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357176704 00000100:00100000:3.0:1789708815.626386:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357176704 00000100:00100000:0.0:1789708815.626426:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357176960 00000100:00100000:0.0:1789708815.626439:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357176960 00000100:00100000:3.0:1789708815.626458:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789708815.626468:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1876645357176704:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789708815.626506:0:24389:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f0477c79-9289-4814-b031-7f11416b686f@192.168.201.52@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:3.0:1789708815.626569:0:24389:0:(genops.c:1384:class_connect()) connect: client f0477c79-9289-4814-b031-7f11416b686f, cookie 0xf45f43947e47ef1a 00000004:00100000:3.0:1789708815.626597:0:24389:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789708815.627171:0:24389:0:(import.c:65:import_set_state_nolock()) ffff9bee10925800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708815.627427:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+6:2394:x1876645357176704:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 957us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708815.635257:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1789708815.635287:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1876645357176960:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789708815.635336:0:22859:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from f0477c79-9289-4814-b031-7f11416b686f@192.168.201.52@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:0.0:1789708815.635586:0:22859:0:(genops.c:1384:class_connect()) connect: client f0477c79-9289-4814-b031-7f11416b686f, cookie 0xf45f43947e47ef21 00000004:00100000:0.0:1789708815.635618:0:22859:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789708815.636249:0:22859:0:(import.c:65:import_set_state_nolock()) ffff9bed02d2d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708815.638836:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789708815.642956:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+6:2394:x1876645357176960:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 7652us (16945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708815.642976:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:2.0:1789708815.661514:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708815.661573:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708815.661699:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357176832 00000100:00100000:1.0:1789708815.661721:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357176832 00000100:00100000:1.0:1789708815.661803:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357177216 00000100:00100000:1.0:1789708815.661806:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357177216 00000100:00100000:1.0:1789708815.661830:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789708815.661840:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+7:0:x1876645357176832:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789708815.661909:0:22857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789708815.662011:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+7:0:x1876645357176832:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 171us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708815.662018:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789708815.662048:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1789708815.662054:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+6:18217:x1876645357177216:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789708815.662067:0:22857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789708815.662089:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+6:18217:x1876645357177216:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 35us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708815.662095:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00080000:2.0:1789708815.662398:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708815.679641:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708815.679702:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708815.679858:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357177344 00000100:00100000:2.0:1789708815.679871:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357177344 00000100:00100000:2.0:1789708815.679934:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357177088 00000100:00100000:2.0:1789708815.679937:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357177088 00000100:00100000:2.0:1789708815.679985:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1789708815.679996:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+6:18217:x1876645357177344:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789708815.680112:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+6:18217:x1876645357177344:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 117us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708815.680120:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1789708815.680138:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:2.0:1789708815.680144:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+6:0:x1876645357177088:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789708815.680168:0:22859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789708815.680218:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+6:0:x1876645357177088:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 74us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708815.680225:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00080000:0.0:1789708815.680555:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708815.689518:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708815.689568:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708815.689693:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357177472 00000100:00100000:0.0:1789708815.689718:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357177472 00000100:00100000:0.0:1789708815.689789:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357177600 00000100:00100000:0.0:1789708815.689794:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357177600 00000100:00100000:0.0:1789708815.689821:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1789708815.689832:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1876645357177472:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789708815.689877:0:24365:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f0477c79-9289-4814-b031-7f11416b686f@192.168.201.52@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:0.0:1789708815.689923:0:24365:0:(genops.c:1384:class_connect()) connect: client f0477c79-9289-4814-b031-7f11416b686f, cookie 0xf45f43947e47ef28 00002000:00100000:0.0:1789708815.689938:0:24365:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f0477c79-9289-4814-b031-7f11416b686f/ffff9bed02d2b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789708815.689960:0:24365:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789708815.690195:0:24365:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789708815.690231:0:24365:0:(import.c:65:import_set_state_nolock()) ffff9bed02d2f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708815.690369:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0477c79-9289-4814-b031-7f11416b686f+6:2394:x1876645357177472:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 537us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708815.690379:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1789708815.690401:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:0.0:1789708815.690407:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1876645357177600:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789708815.690426:0:24365:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f0477c79-9289-4814-b031-7f11416b686f@192.168.201.52@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:0.0:1789708815.690446:0:24365:0:(genops.c:1384:class_connect()) connect: client f0477c79-9289-4814-b031-7f11416b686f, cookie 0xf45f43947e47ef2f 00002000:00100000:0.0:1789708815.690452:0:24365:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f0477c79-9289-4814-b031-7f11416b686f/ffff9bed05551800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789708815.690465:0:24365:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789708815.690595:0:24365:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789708815.690612:0:24365:0:(import.c:65:import_set_state_nolock()) ffff9bed05556000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708815.690635:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0477c79-9289-4814-b031-7f11416b686f+6:2394:x1876645357177600:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 227us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708815.690642:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1789708815.696873:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708815.705367:0:22869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357177728 00000100:00100000:3.0:1789708815.705387:0:22869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357177728 00000100:00100000:3.0:1789708815.705502:0:22869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1789708815.705515:0:22869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f0477c79-9289-4814-b031-7f11416b686f+6:18217:x1876645357177728:12345-192.168.201.52@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789708815.705678:0:22869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f0477c79-9289-4814-b031-7f11416b686f+6:18217:x1876645357177728:12345-192.168.201.52@tcp:900:mount.lustre.0 Request processed in 165us (8818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708815.705688:0:22869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1789708815.708735:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708815.708954:0:22860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357177856 00000100:00100000:1.0:1789708815.708966:0:22860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357177856 00000100:00100000:1.0:1789708815.709028:0:22860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789708815.709039:0:22860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+6:18217:x1876645357177856:12345-192.168.201.52@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789708815.711499:0:22860:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2325us 00000004:00200000:3.0:1789708815.766104:0:22860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789708815.766305:0:22860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+6:18217:x1876645357177856:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 57259us (57574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708815.766323:0:22860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00010000:00010000:0.0:1789708816.039110:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708816.040569:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708816.043145:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357177984 00000100:00100000:2.0:1789708816.043162:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357177984 00000100:00100000:2.0:1789708816.044081:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1789708816.044097:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+6:18263:x1876645357177984:12345-192.168.201.52@tcp:101:mkdir.0 00010000:00010000:2.0:1789708816.044125:0:22859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708816.047299:0:22859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47ef36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e62e expref: -99 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708816.047391:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47ef3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708816.047419:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47ef3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708816.047434:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47ef3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708816.047486:0:22859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789708816.047490:0:22859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708816.047525:0:22859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47ef3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708816.047553:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47ef36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e62e expref: 8 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708816.047573:0:22859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47ef3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e62e expref: 7 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708816.047582:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769500) 00010000:00010000:2.0:1789708816.047585:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708816.047589:0:22859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc600, rc 0) 00000100:00100000:2.0:1789708816.049946:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+7:18263:x1876645357177984:12345-192.168.201.52@tcp:101:mkdir.0 Request processed in 5844us (9374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708816.049959:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00010000:00010000:0.0:1789708817.065035:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708817.255064:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365609984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708817.255205:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708817.255394:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365609984 00000100:00100000:0.0:1789708817.255406:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365609984 00000100:00100000:0.0:1789708817.255495:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708817.255507:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365609984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789708817.255548:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1789708817.255746:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708817.255923:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365609984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 418us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708817.255932:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708817.255998:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365609984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708817.257464:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365610112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789708817.257538:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708817.261879:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365610112 00000100:00100000:3.0:1789708817.261913:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365610112 00000100:00100000:3.0:1789708817.262113:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789708817.262125:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365610112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789708817.262167:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789708817.262291:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365610112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (4721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708817.262299:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789708817.265103:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365610112:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789708818.086588:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708818.280760:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365610240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708818.280838:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708818.280928:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365610240 00000100:00100000:2.0:1789708818.280938:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365610240 00000100:00100000:2.0:1789708818.281012:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708818.281022:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365610240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789708818.281043:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789708818.281126:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708818.281356:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365610240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 335us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708818.281364:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708818.281458:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365610240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708818.790815:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708818.790838:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365610368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708818.790904:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708818.791652:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365610368 00000100:00100000:2.0:1789708818.791662:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365610368 00000100:00100000:2.0:1789708818.791721:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789708818.791730:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365610368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789708818.791764:0:22863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789708818.791819:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365610368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708818.791826:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789708818.791904:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365610368:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789708819.111087:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789708819.111492:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708819.260581:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708819.260724:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357178112 00000100:00100000:1.0:1789708819.260736:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357178112 00000100:00100000:1.0:1789708819.260822:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1789708819.260834:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+7:18316:x1876645357178112:12345-192.168.201.52@tcp:41:lfs.0 00000004:00000024:1.0:1789708819.260873:0:22857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789708819.260970:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+7:18316:x1876645357178112:12345-192.168.201.52@tcp:41:lfs.0 Request processed in 138us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708819.260997:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00080000:3.0:1789708819.261357:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708819.271152:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708819.271376:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357178240 00000100:00100000:2.0:1789708819.271386:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357178240 00000100:00100000:2.0:1789708819.271476:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789708819.271487:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+6:18316:x1876645357178240:12345-192.168.201.52@tcp:41:lfs.0 00000004:00000024:2.0:1789708819.271524:0:22858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789708819.271618:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+6:18316:x1876645357178240:12345-192.168.201.52@tcp:41:lfs.0 Request processed in 133us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.271625:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00080000:3.0:1789708819.272178:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708819.283409:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708819.283572:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357178368 00000100:00100000:3.0:1789708819.283593:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357178368 00000100:00100000:3.0:1789708819.283681:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1789708819.283693:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0477c79-9289-4814-b031-7f11416b686f+6:18316:x1876645357178368:12345-192.168.201.52@tcp:13:lfs.0 00002000:00000024:3.0:1789708819.283725:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708819.283810:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0477c79-9289-4814-b031-7f11416b686f+6:18316:x1876645357178368:12345-192.168.201.52@tcp:13:lfs.0 Request processed in 120us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.283818:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00080000:2.0:1789708819.286029:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708819.296200:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708819.296367:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357178496 00000100:00100000:3.0:1789708819.296378:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357178496 00000100:00100000:3.0:1789708819.296524:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:3.0:1789708819.296536:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0477c79-9289-4814-b031-7f11416b686f+6:18316:x1876645357178496:12345-192.168.201.52@tcp:13:lfs.0 00002000:00000024:3.0:1789708819.296571:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789708819.296682:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0477c79-9289-4814-b031-7f11416b686f+6:18316:x1876645357178496:12345-192.168.201.52@tcp:13:lfs.0 Request processed in 148us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.296689:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:0.0:1789708819.304458:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365610752:0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.304529:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708819.304617:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365611264:0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.304654:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708819.304673:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365611776:0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.304698:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708819.304721:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789708819.304727:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365610880:0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.304749:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708819.304769:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365611392:0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.304790:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708819.305002:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365610752 00000100:00100000:1.0:1789708819.305011:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365610752 00000100:00100000:3.0:1789708819.305072:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365611264 00000100:00100000:3.0:1789708819.305077:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365611264 00000100:00100000:3.0:1789708819.305121:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365610880 00000100:00100000:3.0:1789708819.305125:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365610880 00000100:00080000:2.0:1789708819.305203:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708819.305220:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708819.305231:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365611264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.305321:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365611264:12345-0@lo:400:kworker.0 Request processed in 92us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708819.305694:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365611904:0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.305723:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708819.305759:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365611264:0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.305788:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365611392 00000100:00100000:0.0:1789708819.305803:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365611392 00000100:00100000:0.0:1789708819.305827:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708819.305834:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365611392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.305870:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365611392:12345-0@lo:400:kworker.0 Request processed in 37us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708819.305876:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708819.305933:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365611776 00000100:00100000:0.0:1789708819.305937:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365611776 00000100:00100000:0.0:1789708819.305983:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365611904 00000100:00100000:0.0:1789708819.305987:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365611904 00000100:00100000:0.0:1789708819.306012:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789708819.306017:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365611776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.306049:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876645365611776:12345-0@lo:400:kworker.0 Request processed in 32us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708819.306055:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789708819.306066:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789708819.306071:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365611904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.306093:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876645365611904:12345-0@lo:400:kworker.0 Request processed in 23us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708819.306099:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789708819.306121:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365612288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708819.306146:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708819.306173:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365611392:0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.306185:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876645365611904:0@lo:400:kworker.0 00010000:00080000:0.0:1789708819.306197:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a24f480 x1876645365611776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708819.306207:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876645365611776:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.308806:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789708819.308877:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708819.308883:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708819.308886:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708819.308928:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365610624:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309003:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708819.309044:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365611136:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309063:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708819.309079:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365611648:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309108:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708819.309125:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365612160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708819.309150:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708819.309181:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789708819.309189:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365610496:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309482:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708819.309515:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365611008:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309539:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708819.309551:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365611520:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309566:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708819.309574:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365612032:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309604:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708819.309626:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365610624 00000100:00100000:2.0:1789708819.309633:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365610624 00000100:00100000:2.0:1789708819.309742:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365611136 00000100:00100000:2.0:1789708819.309746:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365611136 00000100:00100000:2.0:1789708819.309760:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789708819.309766:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365610624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309817:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365610624:12345-0@lo:400:kworker.0 Request processed in 50us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.309824:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789708819.309838:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789708819.309844:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365611136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309869:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365611136:12345-0@lo:400:kworker.0 Request processed in 26us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.309874:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789708819.309903:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365610624:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309912:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365611136:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.309942:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365610496 00000100:00100000:2.0:1789708819.309945:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365610496 00000100:00100000:2.0:1789708819.309967:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789708819.311728:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3618:x1876645365610496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.311911:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee222de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3618:x1876645365610496:12345-0@lo:400:kworker.0 Request processed in 1938us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.311919:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789708819.312026:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365610496:0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.312056:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365612288 00000100:00100000:2.0:1789708819.312061:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365612288 00000100:00100000:2.0:1789708819.312086:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365612160 00000100:00100000:2.0:1789708819.312089:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365612160 00000100:00100000:2.0:1789708819.312133:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708819.312139:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365612288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789708819.312156:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789708819.312195:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365612288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (6048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.312201:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708819.312213:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708819.312598:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365612160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789708819.312610:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789708819.312709:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876645365612160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (3492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.312717:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708819.312857:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789708819.312877:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365612160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708819.313059:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365611648 00000100:00100000:2.0:1789708819.313063:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365611648 00000100:00100000:2.0:1789708819.313093:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365611008 00000100:00100000:2.0:1789708819.313095:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365611008 00000100:00100000:0.0:1789708819.313310:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365611520 00000100:00100000:0.0:1789708819.313315:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365611520 00000100:00100000:0.0:1789708819.313347:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365612032 00000100:00100000:0.0:1789708819.313350:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365612032 00000100:00100000:0.0:1789708819.313369:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789708819.313376:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365611648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.313448:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365611648:12345-0@lo:400:kworker.0 Request processed in 72us (4347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708819.313454:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789708819.313467:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789708819.313473:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365611520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.313514:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365611520:12345-0@lo:400:kworker.0 Request processed in 41us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708819.313520:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789708819.313533:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789708819.313539:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365612032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.313566:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365612032:12345-0@lo:400:kworker.0 Request processed in 28us (3961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708819.313572:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789708819.313626:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365611520:0@lo:400:kworker.0 00010000:00080000:0.0:1789708819.313657:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bed0a24c000 x1876645365612032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708819.313669:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365612032:0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.313683:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365611648:0@lo:400:kworker.0 00000100:00100000:0.0:1789708819.313730:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365612288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708819.314639:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789708819.314713:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365611008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708819.314765:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365611008:12345-0@lo:400:kworker.0 Request processed in 55us (5224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.314771:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789708819.314912:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708819.314918:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708819.316965:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365611008:0@lo:400:kworker.0 00000100:00100000:1.0:1789708819.317509:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789708819.317522:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365610752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708819.317611:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365610752:12345-0@lo:400:kworker.0 Request processed in 92us (13081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708819.317619:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708819.318086:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365610752:0@lo:400:kworker.0 00000100:00100000:3.0:1789708819.318688:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708819.318697:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365610880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708819.318764:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365610880:12345-0@lo:400:kworker.0 Request processed in 68us (14014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.318770:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708819.318956:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365610880:0@lo:400:kworker.0 00000100:00100000:3.0:1789708819.576164:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708819.576450:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357178624 00000100:00100000:0.0:1789708819.576475:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357178624 00000100:00100000:0.0:1789708819.576617:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:0.0:1789708819.576627:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+10:18349:x1876645357178624:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789708819.576655:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708819.576675:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee2f7d1a00/0xf45f43947e47ef44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e635 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708819.576706:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee2f7d1a00/0xf45f43947e47ef44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e635 expref: 11 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708819.576717:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee2f7d1a00/0xf45f43947e47ef44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e635 expref: 11 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708819.576725:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1a00, rc 0) 00000100:00100000:0.0:1789708819.576789:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+11:18349:x1876645357178624:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 163us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708819.576796:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:1.0:1789708819.584719:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708819.598464:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357178752 00000100:00100000:2.0:1789708819.598482:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357178752 00000100:00100000:2.0:1789708819.598628:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:2.0:1789708819.600660:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+11:18349:x1876645357178752:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789708819.600976:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+11:18349:x1876645357178752:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 2337us (16266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708819.600985:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:1.0:1789708819.605248:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708819.605423:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357178880 00000100:00100000:3.0:1789708819.605434:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357178880 00000100:00100000:3.0:1789708819.605488:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:3.0:1789708819.605499:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+11:18349:x1876645357178880:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789708819.605668:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+11:18349:x1876645357178880:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 170us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.605676:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:2.0:1789708819.638478:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708819.638604:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357179008 00000100:00100000:3.0:1789708819.640756:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357179008 00000100:00100000:3.0:1789708819.640896:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:3.0:1789708819.640908:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+11:18356:x1876645357179008:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708819.641093:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+11:18356:x1876645357179008:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 187us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.641102:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:0.0:1789708819.703945:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708819.705470:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357179136 00000100:00100000:1.0:1789708819.705482:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357179136 00000100:00100000:1.0:1789708819.705547:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:1.0:1789708819.705557:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+11:18356:x1876645357179136:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708819.705758:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+11:18356:x1876645357179136:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 200us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708819.705767:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:2.0:1789708819.711361:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708819.711534:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357179264 00000100:00100000:3.0:1789708819.711545:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357179264 00000100:00100000:3.0:1789708819.711672:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:3.0:1789708819.711684:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+11:18356:x1876645357179264:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708819.711852:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+11:18356:x1876645357179264:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 169us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.711861:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:2.0:1789708819.732996:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708819.733169:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357179392 00000100:00100000:3.0:1789708819.733179:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357179392 00000100:00100000:3.0:1789708819.733240:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:3.0:1789708819.733249:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+11:18349:x1876645357179392:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789708819.733307:0:22849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708819.733333:0:22849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb4e00/0xf45f43947e47ef4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e666 expref: -99 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708819.733363:0:22849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb4e00/0xf45f43947e47ef4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e666 expref: 12 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708819.733376:0:22849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb4e00/0xf45f43947e47ef4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e666 expref: 12 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708819.733385:0:22849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4e00, rc 0) 00000100:00100000:3.0:1789708819.733458:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+12:18349:x1876645357179392:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 209us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.733465:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:0.0:1789708819.738933:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708819.739252:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357179520 00000100:00100000:3.0:1789708819.739892:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357179520 00000100:00100000:3.0:1789708819.739958:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:3.0:1789708819.739967:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+12:18349:x1876645357179520:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789708819.739992:0:22852:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789708819.740017:0:22852:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789708819.740021:0:22852:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789708819.740024:0:22852:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789708819.740027:0:22852:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789708819.740029:0:22852:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1789708819.749146:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+12:18349:x1876645357179520:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 9169us (10212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.749162:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:2.0:1789708819.753667:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708819.753783:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357179648 00000100:00100000:1.0:1789708819.753793:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357179648 00000100:00100000:1.0:1789708819.753844:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:1.0:1789708819.753852:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+12:18349:x1876645357179648:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789708819.753880:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708819.753896:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01508a00/0xf45f43947e47ef52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e66d expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708819.753921:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01508a00/0xf45f43947e47ef52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e66d expref: 13 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708819.753931:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01508a00/0xf45f43947e47ef52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e66d expref: 13 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708819.753940:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508a00, rc 0) 00000100:00100000:1.0:1789708819.753988:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+13:18349:x1876645357179648:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 137us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708819.753995:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:0.0:1789708819.760974:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708819.761053:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357179776 00000100:00100000:3.0:1789708819.761064:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357179776 00000100:00100000:3.0:1789708819.761129:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:3.0:1789708819.761140:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+13:18349:x1876645357179776:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789708819.761456:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+13:18349:x1876645357179776:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 178us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.761467:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:2.0:1789708819.763788:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708819.763862:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357179904 00000100:00100000:3.0:1789708819.763869:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357179904 00000100:00100000:3.0:1789708819.763913:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:3.0:1789708819.763921:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+13:18349:x1876645357179904:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789708819.764055:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+13:18349:x1876645357179904:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 134us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.764064:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:2.0:1789708819.774786:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708819.778675:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357180032 00000100:00100000:1.0:1789708819.778691:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357180032 00000100:00100000:1.0:1789708819.778762:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:1.0:1789708819.778773:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+13:18361:x1876645357180032:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708819.778943:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+13:18361:x1876645357180032:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 170us (4163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708819.778951:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:0.0:1789708819.782357:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708819.784330:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357180160 00000100:00100000:1.0:1789708819.784344:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357180160 00000100:00100000:1.0:1789708819.784414:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:1.0:1789708819.784425:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+13:18361:x1876645357180160:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708819.785422:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+13:18361:x1876645357180160:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 996us (3070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708819.785444:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:2.0:1789708819.818856:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708819.818900:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708819.818989:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357180288 00000100:00100000:1.0:1789708819.819000:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357180288 00000100:00100000:1.0:1789708819.819045:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357180544 00000100:00100000:1.0:1789708819.819049:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357180544 00000100:00100000:1.0:1789708819.819080:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1789708819.819087:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1876645357180288:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789708819.819119:0:22857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a81b64b8-af70-4a00-9ea8-af55bda03a1b@192.168.201.52@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:1.0:1789708819.819156:0:22857:0:(genops.c:1384:class_connect()) connect: client a81b64b8-af70-4a00-9ea8-af55bda03a1b, cookie 0xf45f43947e47ef59 00000004:00100000:1.0:1789708819.819179:0:22857:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789708819.819309:0:22857:0:(import.c:65:import_set_state_nolock()) ffff9bed0392a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708819.819508:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2394:x1876645357180288:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 419us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708819.819516:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1789708819.819533:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1789708819.819538:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1876645357180544:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789708819.819552:0:22857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from a81b64b8-af70-4a00-9ea8-af55bda03a1b@192.168.201.52@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:1.0:1789708819.819572:0:22857:0:(genops.c:1384:class_connect()) connect: client a81b64b8-af70-4a00-9ea8-af55bda03a1b, cookie 0xf45f43947e47ef60 00000004:00100000:1.0:1789708819.819595:0:22857:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789708819.819641:0:22857:0:(import.c:65:import_set_state_nolock()) ffff9bed02d3e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708819.819673:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2394:x1876645357180544:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 133us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708819.819679:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:2.0:1789708819.837406:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708819.838474:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357180672 00000100:00100000:1.0:1789708819.838486:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357180672 00000100:00100000:1.0:1789708819.838590:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:1.0:1789708819.838601:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee073e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:0:x1876645357180672:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789708819.838643:0:22857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789708819.838726:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee073e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:0:x1876645357180672:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 127us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708819.838735:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00080000:2.0:1789708819.839995:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708819.844665:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708819.844711:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708819.844793:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357180800 00000100:00100000:2.0:1789708819.844803:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357180800 00000100:00100000:2.0:1789708819.844873:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357180416 00000100:00100000:2.0:1789708819.844877:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357180416 00000100:00100000:2.0:1789708819.844897:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789708819.844906:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+7:18349:x1876645357180800:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789708819.844936:0:22858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789708819.845002:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+7:18349:x1876645357180800:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 96us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.845010:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789708819.845029:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1789708819.845036:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:0:x1876645357180416:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789708819.845047:0:22858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789708819.845070:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:0:x1876645357180416:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 35us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.845090:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00080000:3.0:1789708819.845685:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708819.847988:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708819.848741:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357180928 00000100:00100000:2.0:1789708819.848751:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357180928 00000100:00100000:2.0:1789708819.849449:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1789708819.849461:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:18349:x1876645357180928:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789708819.849535:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:18349:x1876645357180928:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 76us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.849542:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1789708819.861665:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708819.861703:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708819.861831:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708819.861873:0:22869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357181312 00000100:00100000:3.0:1789708819.861883:0:22869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357181312 00000100:00100000:3.0:1789708819.861948:0:22869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1789708819.861959:0:22869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee073e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:18349:x1876645357181312:12345-192.168.201.52@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789708819.862036:0:22869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee073e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:18349:x1876645357181312:12345-192.168.201.52@tcp:900:mount.lustre.0 Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708819.862044:0:22869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:2.0:1789708819.870003:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708819.870054:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357181440 00000100:00100000:2.0:1789708819.870064:0:22861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357181440 00000100:00100000:2.0:1789708819.870110:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:2.0:1789708819.870136:0:22861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee073e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:18349:x1876645357181440:12345-192.168.201.52@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789708819.870222:0:22861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789708819.870344:0:22861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee073e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:18349:x1876645357181440:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 211us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708819.870352:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:1.0:1789708819.874583:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357181056 00000100:00100000:1.0:1789708819.874599:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357181056 00000100:00100000:0.0:1789708819.879446:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357181184 00000100:00100000:0.0:1789708819.879461:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357181184 00000100:00100000:0.0:1789708819.879525:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1789708819.879534:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee073e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1876645357181184:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789708819.879604:0:24365:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a81b64b8-af70-4a00-9ea8-af55bda03a1b@192.168.201.52@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:0.0:1789708819.879645:0:24365:0:(genops.c:1384:class_connect()) connect: client a81b64b8-af70-4a00-9ea8-af55bda03a1b, cookie 0xf45f43947e47ef67 00002000:00100000:0.0:1789708819.879657:0:24365:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a81b64b8-af70-4a00-9ea8-af55bda03a1b/ffff9bee3ef96000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789708819.879667:0:24365:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789708819.879742:0:24365:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789708819.879776:0:24365:0:(import.c:65:import_set_state_nolock()) ffff9bee3ef92000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708819.879851:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee073e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2394:x1876645357181184:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 316us (18018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708819.879859:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1789708819.879968:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:0.0:1789708819.879974:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee073eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876645357181056:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789708819.879990:0:24366:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a81b64b8-af70-4a00-9ea8-af55bda03a1b@192.168.201.52@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:0.0:1789708819.880008:0:24366:0:(genops.c:1384:class_connect()) connect: client a81b64b8-af70-4a00-9ea8-af55bda03a1b, cookie 0xf45f43947e47ef6e 00002000:00100000:0.0:1789708819.880014:0:24366:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a81b64b8-af70-4a00-9ea8-af55bda03a1b/ffff9bee3ef95000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789708819.880020:0:24366:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789708819.880054:0:24366:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789708819.880069:0:24366:0:(import.c:65:import_set_state_nolock()) ffff9bee3ef91000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708819.880094:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee073eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2394:x1876645357181056:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 118us (18390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708819.880101:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00010000:00010000:0.0:1789708820.145301:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708820.167879:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708820.168151:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357181568 00000100:00100000:1.0:1789708820.168161:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357181568 00000100:00100000:1.0:1789708820.168223:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:1.0:1789708820.168233:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee073ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:18384:x1876645357181568:12345-192.168.201.52@tcp:101:mkdir.0 00010000:00010000:1.0:1789708820.168255:0:22859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708820.168330:0:22859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509600/0xf45f43947e47ef75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e69e expref: -99 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708820.168396:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708820.168595:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708820.168611:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708820.168660:0:22859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789708820.168665:0:22859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708820.168687:0:22859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708820.168732:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509600/0xf45f43947e47ef75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e69e expref: 8 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708820.168750:0:22859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e69e expref: 7 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708820.168759:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769500) 00010000:00010000:1.0:1789708820.168762:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708820.168766:0:22859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508800, rc 0) 00000100:00100000:1.0:1789708820.168835:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee073ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a81b64b8-af70-4a00-9ea8-af55bda03a1b+7:18384:x1876645357181568:12345-192.168.201.52@tcp:101:mkdir.0 Request processed in 604us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708820.168843:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000040:00080000:1.0:1789708820.968539:0:23614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789708821.159357:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789708821.357447:0:24362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a81b64b8-af70-4a00-9ea8-af55bda03a1b 00000001:00100000:3.0:1789708821.357458:0:24362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f0477c79-9289-4814-b031-7f11416b686f 00000001:00100000:3.0:1789708821.358200:0:23594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a81b64b8-af70-4a00-9ea8-af55bda03a1b 00000001:00100000:3.0:1789708821.358209:0:23594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f0477c79-9289-4814-b031-7f11416b686f 00000001:00100000:1.0:1789708821.362361:0:25183:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a81b64b8-af70-4a00-9ea8-af55bda03a1b 00000001:00100000:1.0:1789708821.362375:0:25183:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f0477c79-9289-4814-b031-7f11416b686f 00000001:00100000:3.0:1789708821.366068:0:22837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a81b64b8-af70-4a00-9ea8-af55bda03a1b 00000001:00100000:3.0:1789708821.366086:0:22837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f0477c79-9289-4814-b031-7f11416b686f 00010000:00010000:0.0:1789708822.213029:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708822.374674:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365612416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708822.374749:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708822.374993:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365612416 00000100:00100000:3.0:1789708822.375003:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365612416 00000100:00100000:3.0:1789708822.375068:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708822.375077:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365612416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708822.375105:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708822.375149:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365612416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708822.375156:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708822.375206:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365612416:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789708822.375565:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708822.375743:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365612544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789708822.375774:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708822.376139:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365612544 00000100:00100000:2.0:1789708822.376145:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365612544 00000100:00100000:2.0:1789708822.376186:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789708822.376193:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365612544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789708822.376227:0:22863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789708822.376400:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365612544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 207us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708822.376406:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789708822.376479:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365612544:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789708823.271363:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708823.398640:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708823.398664:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365612672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708823.398729:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708823.398841:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365612672 00000100:00100000:3.0:1789708823.398847:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365612672 00000100:00080000:1.0:1789708823.398898:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708823.399001:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789708823.399009:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365612672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789708823.399029:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708823.399071:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365612672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708823.399078:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708823.399117:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365612672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789708823.910872:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365612800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789708823.910936:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708823.911150:0:25134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365612800 00000100:00100000:1.0:1789708823.911158:0:25134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365612800 00000100:00100000:1.0:1789708823.911219:0:25134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789708823.911226:0:25134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365612800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708823.911279:0:25134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789708823.911321:0:25134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365612800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708823.911328:0:25134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789708823.911408:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365612800:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789708824.294698:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708824.422615:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365612928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789708824.422694:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708824.425883:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365613440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708824.425953:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708824.426013:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708824.426020:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365613312:0@lo:400:kworker.0 00000100:00100000:3.0:1789708824.426049:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708824.426086:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365612928 00000100:00100000:3.0:1789708824.426094:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365612928 00000100:00100000:3.0:1789708824.426139:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365613440 00000100:00100000:3.0:1789708824.426143:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365613440 00000100:00100000:3.0:1789708824.426161:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708824.426169:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365612928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789708824.426197:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789708824.426867:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365613184:0@lo:400:kworker.0 00000100:00100000:0.0:1789708824.426906:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708824.427041:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365613056:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.427075:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708824.427104:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365613568:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.427129:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708824.427147:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365614080:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.427199:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708824.427251:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365613056 00000100:00100000:2.0:1789708824.427257:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365613056 00000100:00100000:3.0:1789708824.427551:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365612928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1381us (4856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708824.427561:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708824.427606:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789708824.427616:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365613440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708824.427634:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789708824.427666:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365613440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708824.427672:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789708824.427831:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708824.428228:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789708824.428238:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3076f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3617:x1876645365613056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.428311:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3076f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3617:x1876645365613056:12345-0@lo:400:kworker.0 Request processed in 75us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708824.428317:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789708824.428346:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365613568 00000100:00100000:2.0:1789708824.428351:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365613568 00000100:00100000:2.0:1789708824.428612:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365614080 00000100:00100000:2.0:1789708824.428617:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365614080 00000100:00100000:2.0:1789708824.428646:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789708824.428653:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee073e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365613568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.428689:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee073e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876645365613568:12345-0@lo:400:kworker.0 Request processed in 37us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708824.428695:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789708824.428716:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789708824.428722:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365614080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.428867:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876645365614080:12345-0@lo:400:kworker.0 Request processed in 144us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708824.428875:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789708824.428898:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708824.429002:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365613056:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.429017:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876645365613568:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.429027:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876645365614080:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.429063:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365613952:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.429093:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708824.429114:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365614464:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.429135:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708824.429167:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365613440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708824.429185:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365612928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708824.429204:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789708824.429210:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365613824:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.429476:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708824.429552:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365613696:0@lo:400:kworker.0 00000100:00100000:0.0:1789708824.429578:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708824.429621:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365614336:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.429656:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708824.429684:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365613952 00000100:00100000:2.0:1789708824.429689:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365613952 00000100:00100000:2.0:1789708824.429710:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365614464 00000100:00100000:2.0:1789708824.429712:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365614464 00000100:00100000:2.0:1789708824.429817:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365614336 00000100:00100000:2.0:1789708824.429821:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365614336 00000100:00100000:2.0:1789708824.429837:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789708824.429844:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365613952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.429884:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876645365613952:12345-0@lo:400:kworker.0 Request processed in 41us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708824.429890:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789708824.429902:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789708824.429908:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365614464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.429935:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876645365614464:12345-0@lo:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708824.429941:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789708824.429951:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789708824.429957:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365614336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.429983:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365614336:12345-0@lo:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708824.429989:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789708824.430008:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708824.430011:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708824.430029:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365614336:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.430040:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876645365613952:0@lo:400:kworker.0 00010000:00080000:2.0:1789708824.430050:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee073eaa00 x1876645365614464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708824.430061:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876645365614464:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.430623:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365613312 00000100:00100000:2.0:1789708824.430639:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365613312 00000100:00100000:2.0:1789708824.430900:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365613824 00000100:00100000:2.0:1789708824.430904:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365613824 00000100:00100000:2.0:1789708824.430923:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708824.430930:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365613312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.430984:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365613312:12345-0@lo:400:kworker.0 Request processed in 53us (4933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708824.430991:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708824.431002:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708824.431009:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365613824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.431034:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365613824:12345-0@lo:400:kworker.0 Request processed in 27us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708824.431040:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708824.431123:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365613824:0@lo:400:kworker.0 00000100:00100000:2.0:1789708824.431136:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365613312:0@lo:400:kworker.0 00000100:00100000:0.0:1789708824.431422:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee073e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365614208:0@lo:400:kworker.0 00000100:00100000:0.0:1789708824.431454:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708824.431487:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365614208 00000100:00100000:0.0:1789708824.431504:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365614208 00000100:00080000:3.0:1789708824.431548:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708824.431553:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708824.431717:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365613184 00000100:00100000:1.0:1789708824.431723:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365613184 00000100:00100000:1.0:1789708824.431775:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365613696 00000100:00100000:1.0:1789708824.431779:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365613696 00000100:00100000:1.0:1789708824.431794:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789708824.431800:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365613184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708824.431844:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365613184:12345-0@lo:400:kworker.0 Request processed in 44us (4937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708824.431850:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789708824.431863:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789708824.431870:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365613696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708824.431898:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365613696:12345-0@lo:400:kworker.0 Request processed in 29us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708824.431904:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789708824.435631:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365613184:0@lo:400:kworker.0 00000100:00100000:3.0:1789708824.435649:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365613696:0@lo:400:kworker.0 00000100:00100000:1.0:1789708824.459531:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789708824.459551:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365614208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708824.459659:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876645365614208:12345-0@lo:400:kworker.0 Request processed in 114us (28203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708824.459667:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789708824.459895:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee073e8000 x1876645365614208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708824.459912:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee073e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876645365614208:0@lo:400:kworker.0 00000001:02000400:3.0:1789708824.936343:0:25739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789708825.314367:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708825.314416:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708825.314439:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708825.314459:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708825.314497:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708825.314519:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708825.314769:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357181824 00000100:00100000:0.0:1789708825.314780:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357181824 00000100:00100000:1.0:1789708825.314828:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708825.314835:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357182336 00000100:00100000:0.0:1789708825.314839:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357182336 00000100:00100000:0.0:1789708825.314853:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357181952 00000100:00100000:0.0:1789708825.314856:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357181952 00000100:00100000:0.0:1789708825.314873:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:0.0:1789708825.314883:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+6:2396:x1876645357181824:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708825.315205:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708825.316092:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+6:2396:x1876645357181824:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 1205us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708825.316110:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:0.0:1789708825.316134:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357182464 00000100:00100000:0.0:1789708825.316140:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357182464 00000100:00100000:0.0:1789708825.316166:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:0.0:1789708825.316173:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2396:x1876645357182336:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708825.316212:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2396:x1876645357182336:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 39us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708825.316219:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:0.0:1789708825.316231:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:0.0:1789708825.316237:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357181952:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708825.316274:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357181952:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708825.316286:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:0.0:1789708825.316299:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:0.0:1789708825.316306:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357182464:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708825.316328:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357182464:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708825.316333:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00080000:0.0:1789708825.316350:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789708825.316353:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708825.318338:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357182080 00000100:00100000:2.0:1789708825.318351:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357182080 00000100:00100000:2.0:1789708825.318402:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357182592 00000100:00100000:2.0:1789708825.318406:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357182592 00000100:00100000:2.0:1789708825.318420:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357182208 00000100:00100000:2.0:1789708825.318422:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357182208 00000100:00100000:2.0:1789708825.318441:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1789708825.318450:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357182080:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708825.319087:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357182080:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 634us (4666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708825.319097:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1789708825.319117:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1789708825.319137:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357182592:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708825.319164:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357182592:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 30us (4705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708825.319169:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1789708825.319180:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789708825.319186:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357182208:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708825.319204:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357182208:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 19us (4378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708825.319210:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1789708825.320484:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708825.320518:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357182720 00000100:00100000:1.0:1789708825.320526:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357182720 00000100:00100000:1.0:1789708825.320814:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1789708825.320822:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357182720:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708825.320994:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357182720:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 172us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708825.321001:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1789708825.321025:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357181696 00000100:00100000:1.0:1789708825.321030:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357181696 00000100:00100000:1.0:1789708825.321058:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00100000:1.0:1789708825.321064:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+13:2396:x1876645357181696:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708825.321087:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+13:2396:x1876645357181696:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 24us (6591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708825.321093:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00080000:0.0:1789708825.322588:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789708825.322595:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789708825.339323:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708826.349695:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708827.374355:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708827.494490:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365614592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708827.494561:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708827.494618:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365614592 00000100:00100000:3.0:1789708827.494625:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365614592 00000100:00100000:3.0:1789708827.494676:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789708827.494684:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365614592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708827.494713:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708827.494756:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365614592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708827.494764:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789708827.494785:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708827.494819:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365614592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708827.522213:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee0734c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365614720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708827.522344:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708827.522554:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365614720 00000100:00100000:1.0:1789708827.522579:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365614720 00000100:00100000:1.0:1789708827.522645:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789708827.522655:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365614720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789708827.522704:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789708827.522762:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365614720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708827.522771:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789708827.522833:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee0734c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365614720:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789708828.391890:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708828.529878:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365614848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789708828.529954:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708828.530069:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365614848 00000100:00100000:3.0:1789708828.530078:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365614848 00000100:00100000:3.0:1789708828.530192:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789708828.530204:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365614848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789708828.530380:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708828.530454:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365614848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 252us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708828.530463:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789708828.530684:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708828.534373:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365614848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708829.038010:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708829.038033:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365614976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708829.038108:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708829.038187:0:25134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365614976 00000100:00100000:1.0:1789708829.038195:0:25134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365614976 00000100:00100000:1.0:1789708829.038249:0:25134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789708829.038257:0:25134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365614976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708829.038315:0:25134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789708829.038372:0:25134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365614976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708829.038379:0:25134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789708829.038449:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365614976:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789708829.352944:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789708829.425760:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708829.544291:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee0734ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365615104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708829.544380:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708829.544487:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365615104 00000100:00100000:2.0:1789708829.544497:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365615104 00000100:00100000:2.0:1789708829.544558:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708829.544569:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365615104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789708829.544602:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789708829.544707:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708829.544718:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365615360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708829.544751:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708829.550806:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365615488:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.550876:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708829.550929:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365616000:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.550956:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708829.550984:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365616512:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.551008:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708829.551033:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789708829.551039:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365615872:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.551076:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708829.551095:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365616384:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.551117:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708829.551152:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365616512 00000100:00100000:0.0:1789708829.551160:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365616512 00000100:00100000:0.0:1789708829.551206:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365616384 00000100:00100000:0.0:1789708829.551209:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365616384 00000100:00100000:0.0:1789708829.551231:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708829.551240:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365616512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.551314:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365616512:12345-0@lo:400:kworker.0 Request processed in 74us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708829.551321:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708829.551337:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789708829.551359:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365616384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.551388:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365616384:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708829.551590:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789708829.551611:0:25134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365615488 00000100:00100000:0.0:1789708829.551615:0:25134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365615488 00000100:00100000:0.0:1789708829.551638:0:25134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365615872 00000100:00100000:0.0:1789708829.551640:0:25134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365615872 00000100:00100000:0.0:1789708829.551652:0:25134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789708829.551657:0:25134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365615488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.551691:0:25134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365615488:12345-0@lo:400:kworker.0 Request processed in 33us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708829.551698:0:25134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789708829.551709:0:25134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789708829.551714:0:25134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365615872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.551741:0:25134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365615872:12345-0@lo:400:kworker.0 Request processed in 26us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708829.551746:0:25134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789708829.551796:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365615872:0@lo:400:kworker.0 00010000:00080000:0.0:1789708829.551809:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee107e6300 x1876645365616384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708829.551819:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365616384:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.551827:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365615488:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.551835:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365616512:0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.551996:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365616000 00000100:00100000:1.0:1789708829.552002:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365616000 00000100:00100000:1.0:1789708829.552035:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708829.552041:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365616000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.552142:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365616000:12345-0@lo:400:kworker.0 Request processed in 101us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708829.552148:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708829.552170:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365615232:0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.552201:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708829.552225:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365615744:0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.552247:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708829.552283:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365616256:0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.552304:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708829.552334:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365615616:0@lo:400:kworker.0 00000100:00100000:3.0:1789708829.552446:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365615232 00000100:00100000:3.0:1789708829.552450:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365615232 00000100:00100000:3.0:1789708829.552482:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789708829.552489:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3618:x1876645365615232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708829.552533:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3618:x1876645365615232:12345-0@lo:400:kworker.0 Request processed in 44us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708829.552539:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789708829.552578:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365616000:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.552670:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365615744 00000100:00100000:0.0:1789708829.552674:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365615744 00000100:00100000:0.0:1789708829.552707:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365616256 00000100:00100000:0.0:1789708829.552717:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365616256 00000100:00100000:0.0:1789708829.552737:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789708829.552744:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365615744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.552776:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365615744:12345-0@lo:400:kworker.0 Request processed in 32us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708829.552781:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789708829.552793:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789708829.552798:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365616256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.552825:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365616256:12345-0@lo:400:kworker.0 Request processed in 27us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708829.552831:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789708829.553170:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365615232:0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.553181:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365615744:0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.553191:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365616256:0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.553233:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708829.553327:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365616128:0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.553431:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708829.553454:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365616640:0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.553475:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708829.553541:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365616128 00000100:00100000:0.0:1789708829.553546:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365616128 00000100:00100000:0.0:1789708829.553571:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365616640 00000100:00100000:0.0:1789708829.553574:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365616640 00000100:00100000:0.0:1789708829.553590:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789708829.553595:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365616128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.553630:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365616128:12345-0@lo:400:kworker.0 Request processed in 34us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708829.553636:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789708829.553648:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789708829.553654:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365616640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.553681:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365616640:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708829.553687:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789708829.555504:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365615104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10930us (11116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708829.555517:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789708829.555559:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708829.555564:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708829.555567:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708829.555579:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365615360 00000100:00100000:2.0:1789708829.555602:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365615360 00000100:00100000:2.0:1789708829.555651:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789708829.555657:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365615360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789708829.555678:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789708829.555737:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365615360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (10985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708829.555744:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789708829.558156:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708829.560531:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365615360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708829.561202:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee0734ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365615104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708829.562144:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365615616 00000100:00100000:3.0:1789708829.562154:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365615616 00000100:00080000:2.0:1789708829.562300:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708829.562501:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789708829.562511:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365615616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.562621:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365615616:12345-0@lo:400:kworker.0 Request processed in 112us (9388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708829.562628:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708829.566234:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365615616:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.566292:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365616128:0@lo:400:kworker.0 00010000:00080000:0.0:1789708829.566308:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee107e4380 x1876645365616640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708829.566320:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365616640:0@lo:400:kworker.0 00000040:00080000:2.0:1789708830.249995:0:23614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789708830.444475:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708830.755287:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708830.755330:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708830.755454:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708830.756301:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357182848 00000100:00100000:1.0:1789708830.756313:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357182848 00000100:00100000:1.0:1789708830.756386:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00100000:1.0:1789708830.756397:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+13:2396:x1876645357182848:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708830.756483:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+13:2396:x1876645357182848:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 88us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708830.756490:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00100000:2.0:1789708830.764668:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708830.764705:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708830.764726:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708830.773734:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357183232 00000100:00100000:0.0:1789708830.773749:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357183232 00000100:00100000:0.0:1789708830.773823:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357183360 00000100:00100000:0.0:1789708830.773826:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357183360 00000100:00100000:0.0:1789708830.773858:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1789708830.773870:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0477c79-9289-4814-b031-7f11416b686f+5:2395:x1876645357183232:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708830.773967:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357182976 00000100:00100000:3.0:1789708830.773972:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357182976 00000100:00100000:3.0:1789708830.774743:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357183104 00000100:00100000:3.0:1789708830.774749:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357183104 00000100:00100000:3.0:1789708830.774775:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:3.0:1789708830.774784:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+6:2395:x1876645357182976:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708830.774924:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0477c79-9289-4814-b031-7f11416b686f+5:2395:x1876645357183232:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 1055us (10262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708830.774934:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1789708830.774953:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:0.0:1789708830.774960:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee402b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357183360:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789708830.778357:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357183488 00000100:00100000:1.0:1789708830.778386:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357183488 00000100:00100000:1.0:1789708830.778559:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:1.0:1789708830.778571:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357183104:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708830.778797:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+6:2395:x1876645357182976:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 4012us (23463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708830.778807:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:3.0:1789708830.778833:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:3.0:1789708830.778841:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2395:x1876645357183488:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708830.778885:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2395:x1876645357183488:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 45us (14158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708830.778893:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00080000:2.0:1789708830.783507:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789708830.783519:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708830.783523:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789708830.783525:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708830.783637:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708830.783673:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357183616 00000100:00100000:2.0:1789708830.783684:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357183616 00000100:00100000:2.0:1789708830.783740:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:2.0:1789708830.783750:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357183616:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708830.783815:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357183616:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708830.783822:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00080000:2.0:1789708830.783849:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789708830.783889:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708830.783946:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708830.783963:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357183744 00000100:00100000:2.0:1789708830.783967:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357183744 00000100:00100000:2.0:1789708830.783988:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357183872 00000100:00100000:2.0:1789708830.783991:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357183872 00000100:00100000:2.0:1789708830.784006:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1789708830.784012:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2395:x1876645357183744:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708830.784062:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2395:x1876645357183744:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708830.784070:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1789708830.784081:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:2.0:1789708830.784087:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357183872:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708830.784112:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357183872:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 25us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708830.784593:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00080000:2.0:1789708830.784615:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789708830.784618:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708830.786338:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee402b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357183360:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 11369us (21623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708830.786352:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:1.0:1789708830.791657:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357183104:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 13074us (36188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708830.791674:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00010000:00010000:1.0:1789708831.467322:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789708831.488009:0:25886:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8043a220 20000000:00000080:3.0:1789708831.488028:0:25886:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bee073aec00 uarg=0000000000000000 20000000:01000000:3.0:1789708831.488073:0:25886:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789708831.488080:0:25886:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789708831.488085:0:25886:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789708831.490968:0:25887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789708831.496405:0:25886:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789708831.503878:0:25886:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789708831.503912:0:25886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.503933:0:25886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee029c9600/0xf45f43947e47ebe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ebe0 expref: 23 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.503942:0:25886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee30492800/0xf45f43947e47ebf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ebee expref: 23 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.503950:0:25886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ec34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ec2d expref: 23 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.503957:0:25886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee029c8000/0xf45f43947e47edae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47eda7 expref: 23 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.503967:0:25886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01509200/0xf45f43947e47ef13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5fd expref: 12 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.503975:0:25886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bee01508a00/0xf45f43947e47ef52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e66d expref: 12 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.503998:0:25886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.504042:0:25886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01508a00/0xf45f43947e47ef52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e66d expref: 12 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.504058:0:25886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee01508a00/0xf45f43947e47ef52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e66d expref: 12 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.504074:0:25886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365616768:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708831.504761:0:25886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee01509200/0xf45f43947e47ef13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5fd expref: 12 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.504773:0:25886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee01509200/0xf45f43947e47ef13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5fd expref: 12 pid: 22852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.504783:0:25886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365616896:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708831.504818:0:25886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee029c8000/0xf45f43947e47edae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47eda7 expref: 23 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.504827:0:25886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee029c8000/0xf45f43947e47edae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47eda7 expref: 23 pid: 22852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.504836:0:25886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365617024:0@lo:104: 00000100:00100000:3.0:1789708831.504874:0:25886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708831.504932:0:22840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365617024 00000100:00100000:3.0:1789708831.504940:0:22840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365617024 00000100:00100000:3.0:1789708831.504988:0:22840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708831.505006:0:22840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:25886:x1876645365617024:12345-0@lo:104: 00010000:00010000:3.0:1789708831.505019:0:22840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.505066:0:22840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789708831.505072:0:22840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:25886:x1876645365617024:12345-0@lo:104: Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708831.505079:0:22840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789708831.507117:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708831.507127:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.507138:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebca00 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708831.507142:0:22846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.507152:0:22846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708831.507159:0:22846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708831.507165:0:22846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789708831.507216:0:22846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.507223:0:22846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708831.507246:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708831.507344:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708831.507378:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365617152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708831.507457:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708831.507504:0:22843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365617152 00000100:00100000:0.0:1789708831.507512:0:22843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365617152 00010000:00010000:0.0:1789708831.507540:0:22843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee029c8000/0xf45f43947e47edae lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47eda7 expref: 24 pid: 22852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708831.507578:0:22843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708831.507586:0:22843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3617:x1876645365617152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708831.507599:0:22843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708831.507605:0:22843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee029c8000/0xf45f43947e47edae lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47eda7 expref: 24 pid: 22852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.507614:0:22843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee029c8000/0xf45f43947e47edae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47eda7 expref: 24 pid: 22852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.507632:0:22843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708831.507664:0:22843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3617:x1876645365617152:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708831.507671:0:22843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708831.507713:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3617:1876645365617152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708831.507924:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47eda7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47edae expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.507941:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708831.507943:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708831.507945:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708831.507974:0:25886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ec34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ec2d expref: 23 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.507985:0:25886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ec34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ec2d expref: 23 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.507995:0:25886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365617280:0@lo:104: 00000100:00100000:3.0:1789708831.508026:0:25886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708831.508057:0:25886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee30492800/0xf45f43947e47ebf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ebee expref: 23 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.508065:0:25886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee30492800/0xf45f43947e47ebf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ebee expref: 23 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.508073:0:25886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365617408:0@lo:104: 00000100:00100000:3.0:1789708831.508094:0:25886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708831.508547:0:25886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bee029c9600/0xf45f43947e47ebe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45f43947e47ebe0 expref: 23 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.508556:0:25886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bee029c9600/0xf45f43947e47ebe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45f43947e47ebe0 expref: 23 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.508565:0:25886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365617536:0@lo:104: 00000100:00100000:3.0:1789708831.508599:0:25886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708831.513323:0:25886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9240 going to sleep for 11 seconds 00000100:00100000:2.0:1789708831.513391:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708831.513459:0:22844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357184000 00000100:00100000:2.0:1789708831.513466:0:22844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357184000 00010000:00010000:2.0:1789708831.513502:0:22844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01508a00/0xf45f43947e47ef52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e66d expref: 13 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708831.513535:0:22844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789708831.513544:0:22844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05fc1a0-5078-439b-8c88-b0181334973b+13:2395:x1876645357184000:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708831.513574:0:22844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708831.513587:0:22844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01508a00/0xf45f43947e47ef52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e66d expref: 13 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708831.513599:0:22844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01508a00/0xf45f43947e47ef52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e66d expref: 13 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708831.513617:0:22844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01508a00/0xf45f43947e47ef52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e66d expref: 13 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708831.513632:0:22844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708831.513679:0:22844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05fc1a0-5078-439b-8c88-b0181334973b+12:2395:x1876645357184000:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 136us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708831.513687:0:22844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1789708831.513822:0:22841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365617280 00000100:00100000:1.0:1789708831.513826:0:22841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365617280 00000100:00100000:1.0:1789708831.513846:0:22841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365617408 00000100:00100000:1.0:1789708831.513848:0:22841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365617408 00000100:00100000:1.0:1789708831.513854:0:22841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365617536 00000100:00100000:1.0:1789708831.513856:0:22841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365617536 00000100:00100000:1.0:1789708831.513863:0:22841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708831.513868:0:22841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+5:25886:x1876645365617280:12345-0@lo:104: 00010000:00010000:1.0:1789708831.513882:0:22841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.513987:0:25886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365616768:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708831.514003:0:25886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365616896:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708831.514009:0:25886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee029c8000/0xf45f43947e47edae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47eda7 expref: 23 pid: 22852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.514017:0:25886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365617024:0@lo:104: 00000100:00100000:3.0:1789708831.514022:0:25886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365617280:0@lo:104: 00010000:00010000:1.0:1789708831.514458:0:22841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789708831.514466:0:22841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+5:25886:x1876645365617280:12345-0@lo:104: Request processed in 597us (6439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708831.514473:0:22841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708831.514492:0:22841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708831.514500:0:22841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+4:25886:x1876645365617408:12345-0@lo:104: 00010000:00010000:1.0:1789708831.514509:0:22841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.514578:0:25886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365617408:0@lo:104: 00010000:00010000:2.0:1789708831.514704:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708831.514711:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708831.514719:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b200 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:2.0:1789708831.514723:0:22845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708831.514731:0:22845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708831.514739:0:22845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708831.514745:0:22845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789708831.514907:0:22841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789708831.514914:0:22841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+4:25886:x1876645365617408:12345-0@lo:104: Request processed in 415us (6819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708831.514922:0:22841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789708831.514948:0:22845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.514956:0:22845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708831.514977:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.514985:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103b200/0xf45f43947e47ec2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ec34 expref: -99 pid: 24361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.514997:0:22845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708831.515000:0:22845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.515006:0:22845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c8800 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:3.0:1789708831.515009:0:22845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.515016:0:22845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708831.515030:0:22845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708831.515031:0:22841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:01000000:3.0:1789708831.515035:0:22845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789708831.515039:0:22841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:25886:x1876645365617536:12345-0@lo:104: 00010000:00010000:1.0:1789708831.515047:0:22841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.515049:0:22845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.515055:0:22845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708831.515061:0:22845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.515067:0:22845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee029c8800/0xf45f43947e47ebee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebf5 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.515076:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708831.515078:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708831.515099:0:25066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708831.515105:0:25066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515111:0:25066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b600 already unused, calling callback (ffffffffc13d2d20) 10000000:00010000:0.0:1789708831.515114:0:25066:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515121:0:25066:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708831.515128:0:25066:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708831.515145:0:25066:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789708831.515174:0:25066:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515180:0:25066:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708831.515196:0:25066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515201:0:25066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff9bee1103b600/0xf45f43947e47ebe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45f43947e47ebe7 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515214:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708831.515216:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708831.515218:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708831.515226:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708831.515238:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365617920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708831.515313:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708831.515338:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708831.515348:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365617920 00000100:00100000:3.0:1789708831.515349:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365617792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708831.515353:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365617920 00010000:00010000:0.0:1789708831.515383:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee029c9600/0xf45f43947e47ebe7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ebe0 expref: 23 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.515386:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708831.515402:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365617792 00000100:00100000:3.0:1789708831.515405:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708831.515405:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365617792 00010000:00010000:0.0:1789708831.515416:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee30492800/0xf45f43947e47ebf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ebee expref: 24 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708831.515428:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708831.515435:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3618:x1876645365617920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708831.515453:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708831.515458:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee029c9600/0xf45f43947e47ebe7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ebe0 expref: 24 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515467:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee029c9600/0xf45f43947e47ebe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ebe0 expref: 24 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515481:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708831.515509:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3618:x1876645365617920:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708831.515516:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789708831.515530:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365617664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708831.515530:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708831.515536:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:3616:x1876645365617792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708831.515543:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708831.515546:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee30492800/0xf45f43947e47ebf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ebee expref: 23 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708831.515555:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708831.515555:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee30492800/0xf45f43947e47ebf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ebee expref: 23 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515565:0:22842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee30492800/0xf45f43947e47ebf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ebee expref: 23 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515573:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708831.515574:0:22844:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789708831.515581:0:22844:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789708831.515596:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:3616:x1876645365617792:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708831.515602:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789708831.515607:0:25886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee029c9600/0xf45f43947e47ebe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ebe0 expref: 22 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708831.515612:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365617664 00000100:00100000:0.0:1789708831.515615:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365617664 00000100:00100000:3.0:1789708831.515617:0:25886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25886:1876645365617536:0@lo:104: 00010000:00010000:0.0:1789708831.515632:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ec34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ec2d expref: 21 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708831.515643:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708831.515648:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fab9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:3616:x1876645365617664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708831.515651:0:25886:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515654:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708831.515657:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ec34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45f43947e47ec2d expref: 21 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515665:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ec34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45f43947e47ec2d expref: 21 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515674:0:22842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ec34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45f43947e47ec2d expref: 21 pid: 22851 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.515682:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708831.515705:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fab9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:3616:x1876645365617664:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708831.515711:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708831.515757:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365617920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708831.515963:0:22841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789708831.516059:0:22841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+3:25886:x1876645365617536:12345-0@lo:104: Request processed in 1021us (7459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708831.516066:0:22841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708831.516193:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365617664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708831.516201:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365617792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708831.516232:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708831.520478:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708831.520547:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357184128 00000100:00100000:0.0:1789708831.520557:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357184128 00010000:00010000:0.0:1789708831.520590:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bee01509200/0xf45f43947e47ef13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5fd expref: 12 pid: 22852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708831.520626:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:0.0:1789708831.520645:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05fc1a0-5078-439b-8c88-b0181334973b+12:2395:x1876645357184128:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708831.520660:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708831.520665:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bee01509200/0xf45f43947e47ef13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5fd expref: 12 pid: 22852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.520678:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bee01509200/0xf45f43947e47ef13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5fd expref: 12 pid: 22852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.520696:0:22842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bee01509200/0xf45f43947e47ef13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e5fd expref: 12 pid: 22852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.520711:0:22842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.520720:0:22842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.520735:0:22842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.520741:0:22842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.520748:0:22842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.520755:0:22842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.520761:0:22842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4200 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:0.0:1789708831.520765:0:22842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.520779:0:22842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.520880:0:25886:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708831.520889:0:25886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.521096:0:22842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.521105:0:22842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bed09bb4200/0xf45f43947e47ef83 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708831.521168:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708831.521222:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05fc1a0-5078-439b-8c88-b0181334973b+11:2395:x1876645357184128:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 577us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708831.521230:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00010000:00010000:0.0:1789708832.486633:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708832.614814:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365618048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708832.614888:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708832.616022:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365618048 00000100:00100000:2.0:1789708832.616036:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365618048 00000100:00100000:2.0:1789708832.616117:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789708832.616127:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365618048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708832.616157:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1789708832.616226:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708832.616231:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365618048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.616238:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708832.616537:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365618048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708832.617171:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee0734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365618176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708832.617219:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708832.617613:0:25134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365618176 00000100:00100000:2.0:1789708832.617621:0:25134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365618176 00000100:00100000:2.0:1789708832.617666:0:25134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789708832.617673:0:25134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365618176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789708832.617699:0:25134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789708832.617813:0:25134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365618176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.617820:0:25134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789708832.628049:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee0734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365618176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789708832.671575:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708832.671677:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357184256 00000100:00100000:1.0:1789708832.671688:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357184256 00000100:00100000:1.0:1789708832.671745:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 153 00000100:00100000:1.0:1789708832.671755:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+11:18232:x1876645357184256:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708832.671772:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708832.671791:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509600/0xf45f43947e47ef8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6a5 expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.671832:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509600/0xf45f43947e47ef8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6a5 expref: 12 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.671844:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509600/0xf45f43947e47ef8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6a5 expref: 12 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.671854:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509600, rc 0) 00000100:00100000:1.0:1789708832.671911:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+12:18232:x1876645357184256:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 158us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708832.671919:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 153 00000100:00100000:2.0:1789708832.673751:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708832.674992:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357184384 00000100:00100000:1.0:1789708832.675004:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357184384 00000100:00100000:1.0:1789708832.675122:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 154 00000100:00100000:1.0:1789708832.675131:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+12:18232:x1876645357184384:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708832.675320:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+12:18232:x1876645357184384:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 189us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708832.675328:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 154 00000100:00100000:0.0:1789708832.691409:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708832.691730:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357184512 00000100:00100000:2.0:1789708832.691741:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357184512 00000100:00100000:2.0:1789708832.691815:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00100000:2.0:1789708832.691826:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+12:18232:x1876645357184512:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708832.691998:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+12:18232:x1876645357184512:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 172us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.692006:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00100000:0.0:1789708832.698669:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708832.698786:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357184640 00000100:00100000:2.0:1789708832.698804:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357184640 00000100:00100000:2.0:1789708832.698864:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 156 00000100:00100000:2.0:1789708832.698887:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+12:18232:x1876645357184640:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708832.698906:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708832.698923:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebce00/0xf45f43947e47ef91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6ac expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708832.698951:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebce00/0xf45f43947e47ef91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6ac expref: 13 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708832.698962:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebce00/0xf45f43947e47ef91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6ac expref: 13 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708832.698971:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebce00, rc 0) 00000100:00100000:2.0:1789708832.699028:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e05fc1a0-5078-439b-8c88-b0181334973b+13:18232:x1876645357184640:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 143us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.699035:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 156 00000100:00100000:0.0:1789708832.701829:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708832.701967:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357184768 00000100:00100000:3.0:1789708832.701977:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357184768 00000100:00100000:3.0:1789708832.702029:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 157 00000100:00100000:3.0:1789708832.702039:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+13:18232:x1876645357184768:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708832.702196:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+13:18232:x1876645357184768:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 157us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.702204:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 157 00000100:00100000:0.0:1789708832.705522:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708832.710562:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357184896 00000100:00100000:1.0:1789708832.710578:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357184896 00000100:00100000:0.0:1789708832.716685:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 158 00000100:00100000:0.0:1789708832.716700:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+13:18232:x1876645357184896:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708832.716891:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+13:18232:x1876645357184896:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 194us (11631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708832.716910:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 158 10000000:01000000:0.0:1789708833.320463:0:22855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789708833.320473:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee10920800 from 13 10000000:01000000:0.0:1789708833.320478:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708833.320539:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1c00/0xf45f43947e47ef98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.320551:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1c00/0xf45f43947e47ef98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.320562:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1c00/0xf45f43947e47ef98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708833.320589:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708833.320661:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708833.320709:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e872a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708833.321795:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365618304 00000100:00100000:2.0:1789708833.321805:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365618304 00000100:00100000:2.0:1789708833.321869:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789708833.321878:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+20:22855:x1876645365618304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708833.321892:0:22851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708833.321909:0:22851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ef9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47ef98 expref: -99 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.321948:0:22851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ef9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47ef98 expref: 21 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.321960:0:22851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee40ebc800/0xf45f43947e47ef9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47ef98 expref: 21 pid: 22851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.321988:0:22851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc800, rc 0) 00000100:00100000:2.0:1789708833.322217:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:22855:x1876645365618304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 338us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708833.322224:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789708833.322500:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708833.322516:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1c00/0xf45f43947e47ef98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ef9f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.322537:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1c00/0xf45f43947e47ef98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47ef9f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708833.322618:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708833.322649:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708833.322855:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e872a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708833.332349:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365618432 00000100:00100000:1.0:1789708833.332382:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365618432 00000100:00100000:1.0:1789708833.332464:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789708833.332681:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:22855:x1876645365618432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708833.332859:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:22855:x1876645365618432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (10208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708833.332868:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789708833.336465:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708833.336578:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708833.336655:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708833.336862:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e872a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708833.336949:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365618560 00000100:00100000:1.0:1789708833.336958:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365618560 00000100:00100000:1.0:1789708833.337019:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789708833.337029:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:22855:x1876645365618560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708833.337181:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:22855:x1876645365618560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708833.337190:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789708833.337381:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789708833.340973:0:25901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789708833.359463:0:22855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789708833.359523:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708833.359888:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1c00/0xf45f43947e47ef98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ef9f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.359901:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee2f7d1c00/0xf45f43947e47ef98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47ef9f expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708833.359912:0:22855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789708833.359915:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee2f445800 from 13 10000000:01000000:2.0:1789708833.359918:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708833.359959:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47efa6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.359968:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47efa6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.359981:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47efa6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708833.360007:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee0734c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708833.360444:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708833.360558:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0883e9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789708833.510596:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708833.522474:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365618688 00000100:00100000:1.0:1789708833.522516:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365618688 00000100:00100000:3.0:1789708833.522728:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789708833.522740:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+21:22855:x1876645365618688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708833.522760:0:22849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708833.522793:0:22849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb5c00/0xf45f43947e47efad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47efa6 expref: -99 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.522841:0:22849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb5c00/0xf45f43947e47efad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47efa6 expref: 22 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.522853:0:22849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb5c00/0xf45f43947e47efad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47efa6 expref: 22 pid: 22849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.522863:0:22849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5c00, rc 0) 00000100:00100000:3.0:1789708833.523483:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:22855:x1876645365618688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 743us (163095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708833.523492:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789708833.523519:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee0734c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708833.523543:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47efa6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47efad expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.523554:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47efa6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47efad expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708833.523905:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708833.524393:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708833.524574:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708833.524692:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365618816 00000100:00100000:1.0:1789708833.524700:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365618816 00000100:00100000:1.0:1789708833.524750:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789708833.524758:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee37011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:22855:x1876645365618816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708833.526059:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee37011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:22855:x1876645365618816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1296us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708833.526070:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789708833.527556:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708833.527636:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708833.527702:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708833.527746:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708833.528028:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365618944 00000100:00100000:0.0:1789708833.528035:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365618944 00000100:00100000:0.0:1789708833.528085:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789708833.528093:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:22855:x1876645365618944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708833.528590:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:22855:x1876645365618944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 496us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708833.528599:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789708833.528661:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365618944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789708833.529662:0:25902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789708833.529855:0:22855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789708833.529884:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708833.529894:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47efa6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47efad expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.529906:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee40ebca00/0xf45f43947e47efa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47efad expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708833.529927:0:22855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708833.529929:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bee2d93d800 from 13 10000000:01000000:3.0:1789708833.529932:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708833.529961:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5600/0xf45f43947e47efb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.529967:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5600/0xf45f43947e47efb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.529976:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5600/0xf45f43947e47efb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708833.530006:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708833.530051:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708833.530132:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708833.530432:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365619072 00000100:00100000:1.0:1789708833.530439:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365619072 00000100:00100000:1.0:1789708833.530513:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789708833.530522:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+22:22855:x1876645365619072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708833.530534:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708833.530551:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bee01509200/0xf45f43947e47efbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47efb4 expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.530571:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bee01509200/0xf45f43947e47efbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47efb4 expref: 23 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.530581:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bee01509200/0xf45f43947e47efbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47efb4 expref: 23 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.530589:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509200, rc 0) 00000100:00100000:1.0:1789708833.530630:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:22855:x1876645365619072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708833.530637:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789708833.530695:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708833.530707:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5600/0xf45f43947e47efb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47efbb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.530715:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5600/0xf45f43947e47efb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47efbb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708833.530761:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708833.530783:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708833.530903:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708833.530943:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365619200 00000100:00100000:2.0:1789708833.530953:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365619200 00000100:00100000:0.0:1789708833.530982:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789708833.530999:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:22855:x1876645365619200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708833.531110:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:22855:x1876645365619200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708833.531117:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789708833.531292:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708833.531339:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708833.531388:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708833.531402:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708833.531500:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365619328 00000100:00100000:1.0:1789708833.531504:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365619328 00000100:00100000:1.0:1789708833.531523:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789708833.531528:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:22855:x1876645365619328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708833.531609:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:22855:x1876645365619328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708833.531615:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789708833.531685:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789708833.532715:0:25903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789708833.532869:0:22855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789708833.532896:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708833.532905:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5600/0xf45f43947e47efb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47efbb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.532915:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bed09bb5600/0xf45f43947e47efb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47efbb expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708833.532924:0:22855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789708833.532933:0:22855:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bed0343c000 from 13 10000000:01000000:1.0:1789708833.532935:0:22855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708833.532964:0:22855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47efc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.532972:0:22855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47efc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.532980:0:22855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47efc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708833.533009:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789708833.533064:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708833.533110:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02bdd600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708833.533349:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365619456 00000100:00100000:3.0:1789708833.533356:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365619456 00000100:00100000:3.0:1789708833.533403:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789708833.533412:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+23:22855:x1876645365619456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708833.533424:0:22852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708833.533439:0:22852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bed09bb5400/0xf45f43947e47efc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45f43947e47efc2 expref: -99 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.533458:0:22852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bed09bb5400/0xf45f43947e47efc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45f43947e47efc2 expref: 24 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.533467:0:22852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bed09bb5400/0xf45f43947e47efc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45f43947e47efc2 expref: 24 pid: 22852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.533475:0:22852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5400, rc 0) 00000100:00100000:3.0:1789708833.533505:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:22855:x1876645365619456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708833.533511:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789708833.533602:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708833.533614:0:22855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47efc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47efc9 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.533622:0:22855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47efc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45f43947e47efc9 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708833.533668:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708833.533691:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708833.533714:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02bdd600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708833.533750:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365619584 00000100:00100000:3.0:1789708833.533754:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365619584 00000100:00100000:3.0:1789708833.533800:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789708833.533805:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:22855:x1876645365619584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708833.533894:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:22855:x1876645365619584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708833.533908:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789708833.534099:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708833.534140:0:22855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708833.534182:0:22855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708833.534314:0:22855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee02bdd600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708833.534491:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365619712 00000100:00100000:2.0:1789708833.534497:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365619712 00000100:00100000:2.0:1789708833.534527:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789708833.534534:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:22855:x1876645365619712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708833.534685:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:22855:x1876645365619712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708833.534691:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789708833.537503:0:22855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:22855:1876645365619712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789708833.539611:0:25904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789708833.539851:0:22855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789708833.539881:0:22855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708833.539892:0:22855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47efc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47efc9 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.539902:0:22855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff9bee01508a00/0xf45f43947e47efc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45f43947e47efc9 expref: -99 pid: 22855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708833.639565:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708833.639588:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365619840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708833.639662:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708833.639819:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365619840 00000100:00100000:3.0:1789708833.639829:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365619840 00000100:00100000:3.0:1789708833.639903:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708833.639913:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365619840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789708833.639936:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708833.639985:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365619840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708833.639992:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708833.640057:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365619840:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789708833.640312:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708833.655944:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708833.656083:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357185024 00000100:00100000:2.0:1789708833.656093:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357185024 00000100:00100000:2.0:1789708833.656183:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789708833.656194:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+6:18854:x1876645357185024:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708833.656216:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708833.656239:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47efd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6b3 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656530:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47efd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656548:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47efd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656560:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47efd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656577:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47efde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656584:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47efde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656605:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47efde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656686:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47efe5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656695:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47efe5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656702:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47efe5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708833.656731:0:24389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789708833.656734:0:24389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708833.656774:0:24389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47efe5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656786:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47efd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656792:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47efd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656799:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47efd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656806:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708833.656810:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47efd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656818:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47efd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656838:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769500) 00010000:00010000:2.0:1789708833.656841:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708833.656846:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47efd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656852:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47efd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656867:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47efde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656873:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47efde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656879:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47efde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656884:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebde00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708833.656888:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47efde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656893:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47efde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656901:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bee2c769800) 00010000:00010000:2.0:1789708833.656903:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708833.656906:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47efde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656912:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47efde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656958:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47efd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6b3 expref: 8 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656973:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc200/0xf45f43947e47efe5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6b3 expref: 7 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708833.656981:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bee2c769100) 00010000:00010000:2.0:1789708833.656984:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708833.656987:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc200, rc 0) 00000100:00080000:0.0:1789708833.657366:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708833.657677:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+7:18854:x1876645357185024:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1481us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708833.657692:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:3.0:1789708833.666809:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708833.666899:0:22868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357185152 00000100:00100000:0.0:1789708833.666911:0:22868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357185152 00000100:00100000:0.0:1789708833.666988:0:22868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1789708833.666999:0:22868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f0477c79-9289-4814-b031-7f11416b686f+7:18854:x1876645357185152:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789708833.674647:0:22868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f0477c79-9289-4814-b031-7f11416b686f+7:18854:x1876645357185152:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 Request processed in 7635us (7833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708833.674666:0:22868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789708833.694780:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708833.694951:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357185408 00000100:00100000:0.0:1789708833.694962:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357185408 00000100:00100000:0.0:1789708833.695028:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:0.0:1789708833.695039:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+7:18854:x1876645357185408:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708833.695060:0:22859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708833.695647:0:22859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47efec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6ba expref: -99 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.695728:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47eff3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.695743:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47eff3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.695756:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47eff3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.695812:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47effa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.695839:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47effa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.695847:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47effa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.695960:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47f001 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.695969:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47f001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.695976:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47f001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708833.695986:0:22859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789708833.697449:0:22859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47eff3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697462:0:22859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47eff3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697470:0:22859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47eff3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697476:0:22859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708833.697481:0:22859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47eff3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697488:0:22859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47eff3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697514:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bee2c769100) 00010000:00010000:0.0:1789708833.697517:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708833.697640:0:22859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47eff3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697647:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1200/0xf45f43947e47eff3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697663:0:22859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47effa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697671:0:22859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47effa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697677:0:22859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47effa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697683:0:22859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:0.0:1789708833.697686:0:22859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47effa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697692:0:22859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47effa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697701:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bed097e1a00) 00010000:00010000:0.0:1789708833.697704:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708833.697707:0:22859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47effa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.697712:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47effa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.700997:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47efec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6ba expref: 10 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.701026:0:22859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1800/0xf45f43947e47f001 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6ba expref: 9 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.701036:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bed097e1400) 00010000:00010000:0.0:1789708833.701039:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708833.701043:0:22859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1800, rc 0) 00000100:00100000:0.0:1789708833.701297:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+9:18854:x1876645357185408:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 6106us (6373us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789708833.701310:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:3.0:1789708833.705610:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708833.709494:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357185536 00000100:00100000:2.0:1789708833.709512:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357185536 00000100:00100000:2.0:1789708833.709724:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1789708833.709736:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+9:18854:x1876645357185536:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789708833.709861:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+9:18854:x1876645357185536:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 126us (4258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708833.709869:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:0.0:1789708833.730618:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708833.734490:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357185664 00000100:00100000:1.0:1789708833.734507:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357185664 00000100:00100000:0.0:1789708833.739164:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:0.0:1789708833.739182:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+5:18854:x1876645357185664:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789708833.742314:0:22858:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3086us 00000100:00080000:2.0:1789708833.744452:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708833.763458:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+5:18854:x1876645357185664:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 24270us (32838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708833.763474:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:2.0:1789708833.794309:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708833.794526:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357185792 00000100:00100000:3.0:1789708833.794544:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357185792 00000100:00100000:3.0:1789708833.794626:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:3.0:1789708833.794641:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+9:18860:x1876645357185792:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708833.794670:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708833.794700:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f00f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6c1 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.794780:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f016 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.794927:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f016 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.794960:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f016 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.794980:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f01d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.794988:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f01d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.794995:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f01d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795052:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f016 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795060:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f016 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795068:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f016 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795074:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708833.795080:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f016 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795088:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f016 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795104:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769500) 00010000:00010000:3.0:1789708833.795107:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708833.795113:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f016 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795127:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f016 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795144:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f01d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795151:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f01d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795158:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f01d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795163:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708833.795167:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f01d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795173:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f01d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795181:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bee18087100) 00010000:00010000:3.0:1789708833.795184:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708833.795187:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f01d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795193:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f01d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795230:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f00f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6c1 expref: 10 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795254:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769500) 00010000:00010000:3.0:1789708833.795257:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708833.795298:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f00f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6c1 expref: 10 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.795311:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5e00, rc 0) 00000100:00100000:3.0:1789708833.795944:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+9:18860:x1876645357185792:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1306us (1640us total) trans 0 rc 301/301 00000100:00100000:3.0:1789708833.795954:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:0.0:1789708833.847528:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708833.847714:0:22866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357185920 00000100:00100000:2.0:1789708833.847725:0:22866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357185920 00000100:00100000:2.0:1789708833.847823:0:22866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:2.0:1789708833.847835:0:22866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f0477c79-9289-4814-b031-7f11416b686f+9:18860:x1876645357185920:12345-192.168.201.52@tcp:700:lfs.0 00000100:00100000:2.0:1789708833.847931:0:22866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f0477c79-9289-4814-b031-7f11416b686f+9:18860:x1876645357185920:12345-192.168.201.52@tcp:700:lfs.0 Request processed in 99us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708833.847940:0:22866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789708833.850544:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708833.850772:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357186176 00000100:00100000:0.0:1789708833.850781:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357186176 00000100:00100000:0.0:1789708833.850871:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:0.0:1789708833.850882:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+9:18860:x1876645357186176:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:0.0:1789708833.850933:0:22859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708833.850970:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47ef3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e62e expref: 9 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.850989:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769500) 00010000:00010000:0.0:1789708833.850994:0:22859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708833.851055:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.851079:0:22859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e69e expref: 5 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.851088:0:22859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.851130:0:22859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e69e expref: 5 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.851154:0:22859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e69e expref: 5 pid: 22859 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708833.851168:0:22859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a24f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22859:1876645365619968:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789708833.851245:0:22859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e872840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708833.860062:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708833.860414:0:22844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357186304 00000100:00100000:3.0:1789708833.860435:0:22844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357186304 00010000:00010000:3.0:1789708833.860530:0:22844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e69e expref: 6 pid: 22859 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708833.860581:0:22844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:3.0:1789708833.860591:0:22844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2395:x1876645357186304:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708833.860607:0:22844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708833.860614:0:22844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e69e expref: 6 pid: 22859 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.860628:0:22844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e69e expref: 6 pid: 22859 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.860660:0:22844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769500) 00010000:00010000:3.0:1789708833.860667:0:22844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.860698:0:22844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.860708:0:22844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.860732:0:22844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708833.860890:0:22844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2395:x1876645357186304:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 300us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708833.860903:0:22844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00080000:2.0:1789708833.861052:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789708833.861351:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47ef7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e69e expref: 5 pid: 22859 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708833.861386:0:22859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a24f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22859:1876645365619968:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708833.861417:0:22859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.861432:0:22859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.861440:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.861477:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.861503:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.861644:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863018:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863032:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863042:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708833.863059:0:22859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f521c66 reply state 00000000bce648c5 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863083:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863089:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:1.0:1789708833.863227:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708833.863231:0:22859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789708833.863237:0:22859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789708833.863245:0:22859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863252:0:22859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863283:0:22859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863295:0:22859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708833.863300:0:22859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863308:0:22859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863357:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769500) 00010000:00010000:1.0:1789708833.863360:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708833.863364:0:22859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863370:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f024 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708833.863386:0:22859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f521c66 reply state 00000000bce648c5 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863393:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.863399:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bed08844800) 00010000:00010000:1.0:1789708833.863401:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789708833.863403:0:22859:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789708833.863468:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+10:18860:x1876645357186176:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 12587us (12930us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789708833.863477:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1789708834.084703:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708834.084798:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357186432 00000100:00100000:2.0:1789708834.084808:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357186432 00000100:00100000:2.0:1789708834.084894:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:2.0:1789708834.084903:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+10:18868:x1876645357186432:12345-192.168.201.52@tcp:101:lctl.0 00010000:00010000:2.0:1789708834.084926:0:22857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708834.084947:0:22857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6c8 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.085011:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47f040 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.085024:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47f040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.085035:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47f040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708834.085072:0:22857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789708834.085076:0:22857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789708834.085110:0:22857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47f040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.085130:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6c8 expref: 12 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.085172:0:22857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebde00/0xf45f43947e47f040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6c8 expref: 11 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.085180:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769800) 00010000:00010000:2.0:1789708834.085183:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708834.085185:0:22857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebde00, rc 0) 00000100:00100000:2.0:1789708834.085240:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+11:18868:x1876645357186432:12345-192.168.201.52@tcp:101:lctl.0 Request processed in 339us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.085247:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1789708834.120453:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708834.124979:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357186560 00000100:00100000:3.0:1789708834.124997:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357186560 00000100:00100000:3.0:1789708834.125095:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:3.0:1789708834.125108:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:18869:x1876645357186560:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708834.125129:0:22858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708834.125160:0:22858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f047 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6cf expref: -99 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.125222:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f04e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.125235:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f04e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.125246:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f04e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708834.125309:0:22858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789708834.125325:0:22858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708834.125368:0:22858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f04e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.125529:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f047 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6cf expref: 7 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.125549:0:22858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4200/0xf45f43947e47f04e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6cf expref: 6 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.125558:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769800) 00010000:00010000:3.0:1789708834.125561:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708834.125565:0:22858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4200, rc 0) 00000100:00100000:3.0:1789708834.125708:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:18869:x1876645357186560:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 601us (5263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708834.125716:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:0.0:1789708834.128463:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708834.128631:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357186688 00000100:00100000:3.0:1789708834.128640:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357186688 00000100:00100000:3.0:1789708834.128700:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:3.0:1789708834.128709:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:18869:x1876645357186688:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708834.128729:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708834.128747:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f055 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6d6 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.128810:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f05c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.128823:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f05c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.128833:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f05c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.128858:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f063 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.128866:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.128872:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.128942:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f06a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.128951:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f06a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.128958:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f06a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708834.128995:0:24389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789708834.128999:0:24389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708834.129020:0:24389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f06a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129033:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f05c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129051:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f05c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129114:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f05c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129132:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708834.129197:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f05c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129206:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f05c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129219:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769800) 00010000:00010000:3.0:1789708834.129222:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708834.129227:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f05c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129234:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f05c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129249:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129255:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f063 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129356:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129362:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4a00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708834.129364:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129380:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f063 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129399:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bed08844800) 00010000:00010000:3.0:1789708834.129401:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708834.129405:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f063 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129411:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f063 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129438:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f055 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6d6 expref: 8 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129451:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f06a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6d6 expref: 7 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.129458:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:3.0:1789708834.129460:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708834.129462:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4800, rc 0) 00000100:00100000:3.0:1789708834.129666:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+7:18869:x1876645357186688:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 956us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708834.129674:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:0.0:1789708834.139033:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708834.142228:0:22869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357186816 00000100:00100000:2.0:1789708834.142244:0:22869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357186816 00000100:00100000:2.0:1789708834.142742:0:22869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1789708834.142753:0:22869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:18869:x1876645357186816:12345-192.168.201.52@tcp:900:lfs.0 00000100:00100000:2.0:1789708834.142843:0:22869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:18869:x1876645357186816:12345-192.168.201.52@tcp:900:lfs.0 Request processed in 92us (3820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.142851:0:22869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00080000:0.0:1789708834.150280:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708834.150659:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708834.155685:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708834.157178:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357187072 00000100:00100000:3.0:1789708834.157192:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357187072 00000100:00100000:3.0:1789708834.157292:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:3.0:1789708834.157303:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+7:18869:x1876645357187072:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708834.157339:0:22858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708834.157360:0:22858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6dd expref: -99 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708834.157819:0:22858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789708834.157914:0:22858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f071 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6dd expref: 9 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.157928:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769800) 00010000:00010000:3.0:1789708834.157931:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708834.157937:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6dd expref: 9 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.157951:0:22858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5000, rc 0) 00000100:00100000:3.0:1789708834.158021:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+8:18869:x1876645357187072:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 720us (2346us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1789708834.158029:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789708834.161881:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365620096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789708834.161959:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708834.162076:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365620096 00000100:00100000:3.0:1789708834.162086:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365620096 00000100:00100000:3.0:1789708834.162145:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789708834.162154:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365620096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789708834.162186:0:22863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789708834.162231:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876645365620096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708834.162237:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708834.162617:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876645365620096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789708834.169361:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708834.169611:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357187328 00000100:00100000:3.0:1789708834.169622:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357187328 00000100:00100000:3.0:1789708834.169677:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:3.0:1789708834.169687:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+8:18869:x1876645357187328:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:3.0:1789708834.169766:0:24389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708834.169794:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f06a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6d6 expref: 8 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.169815:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:3.0:1789708834.169820:0:24389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708834.169840:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.169854:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.169864:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708834.170069:0:24389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002031176d reply state 00000000135e0c5b transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.170082:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.170089:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:3.0:1789708834.170092:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789708834.170095:0:24389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789708834.170102:0:24389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789708834.170232:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+9:18869:x1876645357187328:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 545us (881us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1789708834.170240:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:0.0:1789708834.178239:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708834.178367:0:22860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357187584 00000100:00100000:3.0:1789708834.178387:0:22860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357187584 00000100:00100000:3.0:1789708834.178461:0:22860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:3.0:1789708834.178472:0:22860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+9:18869:x1876645357187584:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708834.178682:0:22860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+10:18869:x1876645357187584:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 213us (452us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789708834.178691:0:22860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789708834.181931:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708834.182027:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357187840 00000100:00100000:1.0:1789708834.182050:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357187840 00000100:00100000:1.0:1789708834.182160:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:1.0:1789708834.182170:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a81b64b8-af70-4a00-9ea8-af55bda03a1b+10:18869:x1876645357187840:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789708834.182193:0:22859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708834.182212:0:22859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509800/0xf45f43947e47f086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6e4 expref: -99 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182502:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f08d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182528:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f08d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182539:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f08d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182550:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f094 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182557:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182564:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708834.182653:0:22859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789708834.182721:0:22859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f08d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182729:0:22859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f08d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182745:0:22859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f08d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182752:0:22859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708834.182756:0:22859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f08d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182764:0:22859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f08d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182776:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769800) 00010000:00010000:1.0:1789708834.182779:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708834.182784:0:22859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f08d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182791:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f08d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182803:0:22859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182810:0:22859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f094 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182816:0:22859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182821:0:22859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708834.182824:0:22859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182838:0:22859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f094 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182846:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bed08844800) 00010000:00010000:1.0:1789708834.182849:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708834.182852:0:22859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f094 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182859:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f094 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182888:0:22859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509800/0xf45f43947e47f086 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6e4 expref: 12 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182898:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769800) 00010000:00010000:1.0:1789708834.182900:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708834.182903:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509800/0xf45f43947e47f086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6e4 expref: 12 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.182912:0:22859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509800, rc 0) 00000100:00100000:1.0:1789708834.183068:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a81b64b8-af70-4a00-9ea8-af55bda03a1b+11:18869:x1876645357187840:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 899us (1144us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1789708834.183076:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:1.0:1789708834.186837:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708834.186933:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357187968 00000100:00100000:3.0:1789708834.186945:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357187968 00000100:00100000:3.0:1789708834.187069:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1789708834.187082:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+11:18869:x1876645357187968:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708834.187109:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708834.187130:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f0a2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6eb expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.187502:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.187595:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.187607:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708834.187636:0:24389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789708834.187640:0:24389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708834.187658:0:24389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.187686:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f0a2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6eb expref: 13 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.187724:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6eb expref: 12 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.187733:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:3.0:1789708834.187736:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708834.187740:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4a00, rc 0) 00000100:00100000:3.0:1789708834.187809:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+12:18869:x1876645357187968:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 730us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708834.187816:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:0.0:1789708834.192301:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708834.192502:0:22860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357188096 00000100:00100000:3.0:1789708834.192525:0:22860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357188096 00000100:00100000:3.0:1789708834.192585:0:22860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1789708834.192597:0:22860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+12:18869:x1876645357188096:12345-192.168.201.52@tcp:37:lfs.0 00000100:00100000:3.0:1789708834.206456:0:22860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+12:18869:x1876645357188096:12345-192.168.201.52@tcp:37:lfs.0 Request processed in 13846us (14188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708834.206471:0:22860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1789708834.227450:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708834.227630:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357188352 00000100:00100000:2.0:1789708834.227641:0:22861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357188352 00000100:00100000:2.0:1789708834.227703:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:2.0:1789708834.227714:0:22861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2d985050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+12:18869:x1876645357188352:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789708834.227942:0:22861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2d985050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+13:18869:x1876645357188352:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 228us (500us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789708834.227967:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:0.0:1789708834.302241:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708834.302577:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357188480 00000100:00100000:3.0:1789708834.302590:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357188480 00000100:00100000:3.0:1789708834.302657:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:3.0:1789708834.302668:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+11:18875:x1876645357188480:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708834.302688:0:22858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708834.302709:0:22858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f0b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6f2 expref: -99 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.302774:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f0b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.302800:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f0b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.302813:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f0b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.302988:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f0be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.302999:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f0be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.303007:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f0be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.303095:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47f0c5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.303104:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47f0c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.303111:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47f0c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708834.304063:0:22858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789708834.304070:0:22858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708834.304117:0:22858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47f0c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304141:0:22858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f0b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304164:0:22858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f0b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304170:0:22858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f0b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304176:0:22858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708834.304182:0:22858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f0b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304189:0:22858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f0b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304205:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769800) 00010000:00010000:3.0:1789708834.304208:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708834.304213:0:22858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f0b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304219:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f0b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304233:0:22858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f0be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304239:0:22858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f0be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304245:0:22858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f0be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304249:0:22858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708834.304725:0:22858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f0be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304737:0:22858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f0be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304747:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bed08844800) 00010000:00010000:3.0:1789708834.304750:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708834.304754:0:22858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f0be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304760:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f0be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304798:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f0b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f2 expref: 13 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304813:0:22858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b600/0xf45f43947e47f0c5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f2 expref: 12 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.304821:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:3.0:1789708834.304823:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789708834.304826:0:22858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103b600, rc 0) 00000100:00100000:2.0:1789708834.304973:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+12:18875:x1876645357188480:12345-192.168.201.52@tcp:101:bash.0 Request processed in 2305us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.304984:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:0.0:1789708834.309164:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708834.309642:0:22869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357188608 00000100:00100000:2.0:1789708834.309653:0:22869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357188608 00000100:00100000:2.0:1789708834.309741:0:22869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789708834.309753:0:22869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f0477c79-9289-4814-b031-7f11416b686f+5:18875:x1876645357188608:12345-192.168.201.52@tcp:900:bash.0 00000100:00100000:2.0:1789708834.309844:0:22869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f0477c79-9289-4814-b031-7f11416b686f+5:18875:x1876645357188608:12345-192.168.201.52@tcp:900:bash.0 Request processed in 93us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.309852:0:22869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789708834.312405:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708834.312637:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357188864 00000100:00100000:3.0:1789708834.312647:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357188864 00000100:00100000:3.0:1789708834.312738:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:3.0:1789708834.312747:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+12:18875:x1876645357188864:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708834.312765:0:22857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708834.312784:0:22857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f0cc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e6f9 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.312904:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.312920:0:22857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6eb expref: 12 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.312929:0:22857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.312960:0:22857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6eb expref: 12 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.312973:0:22857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6eb expref: 12 pid: 24389 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708834.312986:0:22857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365620224:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708834.313457:0:22857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee40ef9540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708834.316941:0:22857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365620224:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708834.316969:0:22857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708834.318062:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708834.318163:0:22843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357188992 00000100:00100000:2.0:1789708834.318172:0:22843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357188992 00010000:00010000:2.0:1789708834.318213:0:22843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6eb expref: 13 pid: 24389 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708834.318255:0:22843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:2.0:1789708834.318302:0:22843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+13:2395:x1876645357188992:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708834.318324:0:22843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708834.318331:0:22843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6eb expref: 13 pid: 24389 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.318344:0:22843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6eb expref: 13 pid: 24389 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.318368:0:22843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f0a9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6eb expref: 13 pid: 24389 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.318407:0:22843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:2.0:1789708834.318413:0:22843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.318424:0:22843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.318433:0:22843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.318461:0:22843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708834.318506:0:22843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+12:2395:x1876645357188992:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 206us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.318523:0:22843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00010000:00010000:3.0:1789708834.318638:0:22857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.318647:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.318670:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.318687:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.318694:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319151:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319160:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319166:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708834.319176:0:22857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789708834.319200:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319207:0:22857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319213:0:22857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319218:0:22857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ae00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708834.319223:0:22857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319230:0:22857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319251:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:3.0:1789708834.319254:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708834.319292:0:22857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319300:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f0d3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708834.319322:0:22857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000201f6e1c reply state 000000004c954dad transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319333:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319340:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9bee18087100) 00010000:00010000:3.0:1789708834.319343:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708834.319345:0:22857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789708834.319380:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f0cc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f9 expref: 15 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319396:0:22857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f9 expref: 14 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.319403:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708834.319406:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789708834.319408:0:22857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103a800, rc 0) 00000100:00100000:3.0:1789708834.319442:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+15:18875:x1876645357188864:12345-192.168.201.52@tcp:101:bash.0 Request processed in 6697us (7045us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1789708834.319450:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:0.0:1789708834.332896:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708834.332988:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357189120 00000100:00100000:1.0:1789708834.332997:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357189120 00000100:00100000:1.0:1789708834.333113:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1789708834.333125:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+15:18875:x1876645357189120:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708834.333218:0:22859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708834.333239:0:22859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f0ef lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e700 expref: -99 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.333352:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f0f6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.333365:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f0f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.333468:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f0f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708834.333582:0:22859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789708834.333587:0:22859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789708834.333609:0:22859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f0f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.333621:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f0f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.333645:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508200/0xf45f43947e47f0ef lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e700 expref: 17 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.333662:0:22859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f0f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e700 expref: 16 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708834.333670:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:1.0:1789708834.333673:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708834.333676:0:22859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01509e00, rc 0) 00000100:00100000:1.0:1789708834.333779:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+16:18875:x1876645357189120:12345-192.168.201.52@tcp:101:bash.0 Request processed in 657us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708834.333787:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1789708834.336855:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708834.336937:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357189376 00000100:00100000:2.0:1789708834.336947:0:22861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357189376 00000100:00100000:2.0:1789708834.337029:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789708834.337040:0:22861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0477c79-9289-4814-b031-7f11416b686f+16:18875:x1876645357189376:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:2.0:1789708834.337381:0:22861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0477c79-9289-4814-b031-7f11416b686f+17:18875:x1876645357189376:12345-192.168.201.52@tcp:35:bash.0 Request processed in 342us (535us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1789708834.337389:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000040:00080000:1.0:1789708834.347655:0:23614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789708834.452868:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708834.453491:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357189632 00000100:00100000:2.0:1789708834.453504:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357189632 00000100:00100000:3.0:1789708834.453815:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:3.0:1789708834.453826:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+17:18885:x1876645357189632:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708834.453851:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708834.453870:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f0fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e707 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708834.453962:0:24389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789708834.454057:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f0fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e707 expref: 19 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.454071:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769800) 00010000:00010000:3.0:1789708834.454074:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708834.454080:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f0fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e707 expref: 19 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708834.454093:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103b200, rc 0) 00000100:00100000:3.0:1789708834.454211:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+18:18885:x1876645357189632:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 387us (1353us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1789708834.454219:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:0.0:1789708834.462203:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708834.462456:0:22860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357189888 00000100:00100000:3.0:1789708834.462466:0:22860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357189888 00000100:00100000:3.0:1789708834.462528:0:22860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:3.0:1789708834.462538:0:22860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+18:18885:x1876645357189888:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708834.462773:0:22860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+19:18885:x1876645357189888:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 235us (580us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1789708834.462781:0:22860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000040:00080000:2.0:1789708834.535738:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789708834.535924:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708834.552124:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708834.553331:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357190144 00000100:00100000:0.0:1789708834.553344:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357190144 00000100:00100000:0.0:1789708834.553761:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:0.0:1789708834.553773:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+19:18888:x1876645357190144:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708834.553802:0:22859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708834.553824:0:22859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f10b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e70e expref: -99 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708834.553931:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47f112 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708834.553961:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47f112 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708834.553971:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47f112 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708834.553983:0:22859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789708834.554104:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f10b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e70e expref: 22 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708834.554123:0:22859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47f112 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e70e expref: 21 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708834.554131:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:0.0:1789708834.554134:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708834.554137:0:22859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0a00, rc 0) 00000100:00100000:0.0:1789708834.554625:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+21:18888:x1876645357190144:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 852us (2508us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1789708834.554634:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:0.0:1789708834.566865:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708834.566976:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357190272 00000100:00100000:2.0:1789708834.566985:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357190272 00000100:00100000:2.0:1789708834.567076:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:2.0:1789708834.567088:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+21:18888:x1876645357190272:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:2.0:1789708834.567169:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f120 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.567186:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f120 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.567197:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f120 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.567229:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f120 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.567236:0:22857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f120 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.567242:0:22857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f120 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.567247:0:22857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708834.567252:0:22857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f120 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.567293:0:22857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f120 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.567450:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708834.567454:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708834.567460:0:22857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f120 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708834.567466:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f120 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708834.567627:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+21:18888:x1876645357190272:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 541us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.567636:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:1.0:1789708834.575814:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708834.575896:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357190528 00000100:00100000:2.0:1789708834.575906:0:22861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357190528 00000100:00100000:2.0:1789708834.576070:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789708834.576081:0:22861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0477c79-9289-4814-b031-7f11416b686f+21:18888:x1876645357190528:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789708834.576344:0:22861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0477c79-9289-4814-b031-7f11416b686f+22:18888:x1876645357190528:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 265us (538us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1789708834.576352:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:1.0:1789708834.581929:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708834.592479:0:25888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357190656 00000100:00100000:0.0:1789708834.592497:0:25888:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357190656 00000100:00100000:0.0:1789708834.592723:0:25888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:0.0:1789708834.592734:0:25888:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0477c79-9289-4814-b031-7f11416b686f+22:2397:x1876645357190656:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708834.592752:0:25888:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708834.592777:0:25888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47f112 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e70e expref: 22 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708834.592796:0:25888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:0.0:1789708834.592802:0:25888:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708834.592872:0:25888:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0477c79-9289-4814-b031-7f11416b686f+21:2397:x1876645357190656:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 140us (10952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708834.592880:0:25888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1789708834.662859:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365620608:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.663052:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365620736:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.663104:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365620480:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.663131:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708834.663165:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365620992:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.663187:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708834.663204:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365621504:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.663228:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708834.663285:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365620480 00000100:00100000:1.0:1789708834.663292:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365620480 00000100:00100000:1.0:1789708834.663348:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365620992 00000100:00100000:1.0:1789708834.663352:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365620992 00000100:00100000:1.0:1789708834.663381:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789708834.663391:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365620480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.663445:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365620480:12345-0@lo:400:kworker.0 Request processed in 55us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708834.663453:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789708834.663470:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789708834.663477:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365620992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.663532:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365620992:12345-0@lo:400:kworker.0 Request processed in 55us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708834.663539:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789708834.663579:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365620480:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.663588:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365620992:0@lo:400:kworker.0 00000100:00100000:3.0:1789708834.663888:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708834.663915:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365621120:0@lo:400:kworker.0 00000100:00100000:3.0:1789708834.663954:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708834.663971:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365621632:0@lo:400:kworker.0 00000100:00100000:3.0:1789708834.663992:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708834.664665:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365620608 00000100:00100000:0.0:1789708834.664682:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365620608 00000100:00100000:0.0:1789708834.664744:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365621120 00000100:00100000:0.0:1789708834.664747:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365621120 00000100:00100000:0.0:1789708834.664769:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708834.664777:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365620608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708834.664831:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365620608:12345-0@lo:400:kworker.0 Request processed in 54us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708834.664839:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708834.664853:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789708834.664859:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365621120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708834.664889:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365621120:12345-0@lo:400:kworker.0 Request processed in 30us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708834.664895:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789708834.664922:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365620352:0@lo:400:kworker.0 00000100:00100000:0.0:1789708834.664968:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708834.664999:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365620864:0@lo:400:kworker.0 00000100:00100000:0.0:1789708834.665023:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708834.665207:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365621376:0@lo:400:kworker.0 00000100:00100000:0.0:1789708834.665234:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708834.665251:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365621888:0@lo:400:kworker.0 00000100:00100000:0.0:1789708834.665299:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708834.665339:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365620352 00000100:00100000:0.0:1789708834.665344:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365620352 00000100:00100000:2.0:1789708834.665563:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee0734df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365622016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708834.665595:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708834.665619:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708834.665625:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee0734e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365622144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708834.665648:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708834.665674:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365622016 00000100:00100000:2.0:1789708834.665678:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365622016 00000100:00100000:2.0:1789708834.665701:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365622144 00000100:00100000:2.0:1789708834.665704:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365622144 00000100:00100000:2.0:1789708834.665718:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708834.665725:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365622016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789708834.665747:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789708834.665785:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365622016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.665791:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708834.665815:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708834.665822:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365622144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789708834.665832:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789708834.665858:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365622144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.665864:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708834.665902:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee0734e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365622144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789708834.665914:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee0734df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365622016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708834.666175:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789708834.666185:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3618:x1876645365620352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708834.666227:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3618:x1876645365620352:12345-0@lo:400:kworker.0 Request processed in 44us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708834.666240:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789708834.666298:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3618:1876645365620352:0@lo:400:kworker.0 00000100:00100000:2.0:1789708834.666335:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365621504 00000100:00100000:2.0:1789708834.666341:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365621504 00000100:00100000:2.0:1789708834.666433:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365621632 00000100:00100000:2.0:1789708834.666438:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365621632 00000100:00100000:2.0:1789708834.666454:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365620864 00000100:00100000:2.0:1789708834.666457:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365620864 00000100:00100000:2.0:1789708834.666468:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365621376 00000100:00100000:2.0:1789708834.666471:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365621376 00000100:00100000:2.0:1789708834.666481:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365621888 00000100:00100000:2.0:1789708834.666483:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365621888 00000100:00100000:1.0:1789708834.666608:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708834.666636:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee107e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365621248:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.666662:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708834.666682:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876645365621760:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.666703:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708834.666727:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365620736 00000100:00100000:1.0:1789708834.666730:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365620736 00000100:00100000:1.0:1789708834.666754:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365621248 00000100:00100000:1.0:1789708834.666757:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365621248 00000100:00100000:1.0:1789708834.666774:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708834.666781:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365620736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.666818:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365620736:12345-0@lo:400:kworker.0 Request processed in 38us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708834.666825:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708834.666838:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708834.666844:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365621248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.666872:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365621248:12345-0@lo:400:kworker.0 Request processed in 28us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708834.666877:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708834.666907:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365620736:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.666927:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365621248:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.666985:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365621760 00000100:00100000:1.0:1789708834.666989:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365621760 00000100:00100000:2.0:1789708834.667056:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789708834.667066:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365621504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708834.667108:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876645365621504:12345-0@lo:400:kworker.0 Request processed in 45us (3879us total) trans 0 rc 0/0 00000100:00080000:3.0:1789708834.667160:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789708834.667165:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789708834.667168:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789708834.667170:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708834.667195:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365620608:0@lo:400:kworker.0 00000100:00100000:3.0:1789708834.667207:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365621120:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.672789:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789708834.672817:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365621632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.672932:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365621632:12345-0@lo:400:kworker.0 Request processed in 130us (8938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.673626:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789708834.673659:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789708834.673670:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365620864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708834.673722:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876645365620864:12345-0@lo:400:kworker.0 Request processed in 57us (8698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.673746:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789708834.673760:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789708834.673767:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed098d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365621376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708834.673797:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed098d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876645365621376:12345-0@lo:400:kworker.0 Request processed in 32us (8563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.673802:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789708834.673813:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789708834.673819:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365621888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708834.673845:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876645365621888:12345-0@lo:400:kworker.0 Request processed in 27us (8546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.673850:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789708834.673863:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789708834.673869:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876645365621760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708834.673907:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876645365621760:12345-0@lo:400:kworker.0 Request processed in 39us (7203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708834.673914:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789708834.673980:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876645365621760:0@lo:400:kworker.0 00000100:00100000:2.0:1789708834.674019:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876645365621504:0@lo:400:kworker.0 00010000:00080000:2.0:1789708834.674188:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee107e6300 x1876645365621632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708834.674199:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365621632:0@lo:400:kworker.0 00000100:00100000:2.0:1789708834.674235:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876645365620864:0@lo:400:kworker.0 00000100:00100000:2.0:1789708834.674339:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee107e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876645365621376:0@lo:400:kworker.0 00010000:00080000:2.0:1789708834.674376:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee18002680 x1876645365621888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708834.674385:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876645365621888:0@lo:400:kworker.0 00000100:00100000:1.0:1789708834.674524:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789708835.118327:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708835.118518:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357190912 00000100:00100000:2.0:1789708835.118529:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357190912 00000100:00100000:2.0:1789708835.118657:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:2.0:1789708835.118669:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+21:18919:x1876645357190912:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:2.0:1789708835.118693:0:22858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708835.118714:0:22858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f127 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e715 expref: -99 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.118820:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f12e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.118834:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f12e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.118846:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f12e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708835.118858:0:22858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789708835.118976:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f127 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e715 expref: 24 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.118992:0:22858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f12e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e715 expref: 23 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.119001:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708835.119017:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708835.119021:0:22858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd400, rc 0) 00000100:00100000:2.0:1789708835.119096:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+23:18919:x1876645357190912:12345-192.168.201.52@tcp:101:cat.0 Request processed in 430us (837us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1789708835.119103:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00080000:3.0:1789708835.119152:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789708835.558651:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708835.568751:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708835.568793:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708835.568879:0:22843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357191296 00000100:00100000:2.0:1789708835.568890:0:22843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357191296 00000100:00100000:2.0:1789708835.568953:0:22843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:2.0:1789708835.568962:0:22843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0477c79-9289-4814-b031-7f11416b686f+23:2398:x1876645357191296:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708835.568980:0:22843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708835.569003:0:22843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f12e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e715 expref: 23 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.569021:0:22843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708835.569026:0:22843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708835.569089:0:22843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0477c79-9289-4814-b031-7f11416b686f+22:2398:x1876645357191296:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 128us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708835.569097:0:22843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:3.0:1789708835.569464:0:22860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357191168 00000100:00100000:3.0:1789708835.569469:0:22860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357191168 00000100:00100000:3.0:1789708835.569509:0:22860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1789708835.569517:0:22860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+22:18919:x1876645357191168:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:3.0:1789708835.569753:0:22860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+23:18919:x1876645357191168:12345-192.168.201.52@tcp:35:cat.0 Request processed in 237us (1011us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1789708835.569760:0:22860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:1.0:1789708835.624661:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708835.624734:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357191552 00000100:00100000:3.0:1789708835.624743:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357191552 00000100:00100000:3.0:1789708835.624813:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:3.0:1789708835.624821:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+23:18925:x1876645357191552:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:3.0:1789708835.624843:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708835.624869:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f13c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e71c expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708835.624956:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f143 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708835.624967:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f143 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708835.624974:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f143 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708835.624981:0:24389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789708835.625090:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f13c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e71c expref: 26 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708835.625103:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f143 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e71c expref: 25 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708835.625109:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708835.625111:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708835.625113:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103ae00, rc 0) 00000100:00100000:3.0:1789708835.625304:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+25:18925:x1876645357191552:12345-192.168.201.52@tcp:101:dd.0 Request processed in 441us (608us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1789708835.625311:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1789708835.628749:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708835.628848:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708835.628915:0:22844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357191808 00000100:00100000:3.0:1789708835.628924:0:22844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357191808 00000100:00100000:3.0:1789708835.629022:0:22844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:3.0:1789708835.629033:0:22844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0477c79-9289-4814-b031-7f11416b686f+25:2395:x1876645357191808:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708835.629062:0:22844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708835.629085:0:22844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f143 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e71c expref: 25 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708835.629102:0:22844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708835.629107:0:22844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708835.629163:0:22844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0477c79-9289-4814-b031-7f11416b686f+24:2395:x1876645357191808:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 132us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708835.629170:0:22844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789708835.629213:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357191680 00000100:00100000:0.0:1789708835.629217:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357191680 00000100:00100000:0.0:1789708835.629249:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:0.0:1789708835.629256:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+24:18925:x1876645357191680:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:0.0:1789708835.629306:0:22859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708835.629321:0:22859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47f151 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e723 expref: -99 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708835.629352:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708835.629363:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708835.629373:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708835.629680:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0a00/0xf45f43947e47f151 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e723 expref: 26 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708835.629695:0:22859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e723 expref: 25 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708835.629702:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:0.0:1789708835.629710:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708835.629713:0:22859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d1600, rc 0) 00000100:00100000:0.0:1789708835.629762:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+25:18925:x1876645357191680:12345-192.168.201.52@tcp:101:dd.0 Request processed in 506us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708835.629769:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:1.0:1789708835.631682:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708835.631773:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357192064 00000100:00100000:2.0:1789708835.631783:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357192064 00000100:00100000:2.0:1789708835.631862:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:2.0:1789708835.631872:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+25:18925:x1876645357192064:12345-192.168.201.52@tcp:36:dd.0 00010000:00010000:2.0:1789708835.631917:0:22857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708835.631939:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509e00/0xf45f43947e47f0f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e700 expref: 25 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.631955:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708835.631969:0:22857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708835.632128:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.632141:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.632152:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708835.632195:0:22857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789708835.632218:0:22857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003972fc3c reply state 0000000054b9a2f2 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.632230:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708835.632237:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708835.632239:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789708835.632242:0:22857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708835.633649:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+27:18925:x1876645357192064:12345-192.168.201.52@tcp:36:dd.0 Request processed in 1774us (1967us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1789708835.633659:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000020:00080000:2.0:1789708835.633666:0:22857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789708835.702661:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708835.702758:0:22860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357192320 00000100:00100000:3.0:1789708835.702769:0:22860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357192320 00000100:00100000:3.0:1789708835.702855:0:22860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1789708835.702866:0:22860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+27:18925:x1876645357192320:12345-192.168.201.52@tcp:35:dd.0 00000100:00100000:3.0:1789708835.703096:0:22860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+28:18925:x1876645357192320:12345-192.168.201.52@tcp:35:dd.0 Request processed in 231us (442us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1789708835.703105:0:22860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789708836.064712:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708836.064846:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708836.064939:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708836.064976:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.065035:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357192960 00000100:00100000:3.0:1789708836.065045:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357192960 00000100:00080000:3.0:1789708836.065076:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708836.065123:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:3.0:1789708836.065132:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+12:2396:x1876645357192960:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708836.065221:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+12:2396:x1876645357192960:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.065229:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:0.0:1789708836.065461:0:22849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357192448 00000100:00100000:0.0:1789708836.065467:0:22849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357192448 00000100:00100000:0.0:1789708836.065515:0:22849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 172 00000100:00100000:0.0:1789708836.065522:0:22849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+13:2396:x1876645357192448:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708836.065556:0:22849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e05fc1a0-5078-439b-8c88-b0181334973b+13:2396:x1876645357192448:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 34us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.065563:0:22849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 172 00000100:00100000:1.0:1789708836.066507:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708836.066533:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.066598:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357192576 00000100:00100000:3.0:1789708836.066604:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357192576 00000100:00080000:3.0:1789708836.066636:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789708836.066663:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:3.0:1789708836.066670:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357192576:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708836.066710:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357192576:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 40us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.066717:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:1.0:1789708836.066987:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708836.067020:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.067057:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357192704 00000100:00100000:0.0:1789708836.067062:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357192704 00000100:00100000:0.0:1789708836.067092:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357193216 00000100:00100000:0.0:1789708836.067095:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357193216 00000100:00100000:0.0:1789708836.067107:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357192832 00000100:00100000:0.0:1789708836.067109:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357192832 00000100:00100000:0.0:1789708836.067124:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:0.0:1789708836.067130:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357192704:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708836.067163:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357192704:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 33us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.067170:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:0.0:1789708836.067182:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:0.0:1789708836.067188:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357193216:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708836.067209:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357193216:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 21us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.067224:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:0.0:1789708836.067235:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1789708836.067240:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357192832:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708836.067291:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357192832:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 38us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.067298:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1789708836.067377:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357193088 00000100:00100000:0.0:1789708836.067382:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357193088 00000100:00100000:0.0:1789708836.067407:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:0.0:1789708836.067414:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357193088:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708836.067443:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357193088:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 30us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.067450:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00080000:0.0:1789708836.067472:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789708836.067540:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789708836.067543:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708836.067747:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357193344 00000100:00100000:2.0:1789708836.067753:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357193344 00000100:00080000:3.0:1789708836.067813:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708836.067883:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:0.0:1789708836.067892:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357193344:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789708836.067966:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357193344:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 75us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.067973:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:0.0:1789708836.131005:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.131816:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357193472 00000100:00100000:3.0:1789708836.131827:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357193472 00000100:00100000:3.0:1789708836.131897:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:3.0:1789708836.131908:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+28:18939:x1876645357193472:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:3.0:1789708836.131936:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708836.131961:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f166 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e72a expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132046:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f16d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132059:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f16d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132068:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f16d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132169:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f174 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132178:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f174 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132199:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f174 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132322:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f17b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132331:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f17b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132406:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f17b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708836.132452:0:24389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789708836.132456:0:24389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708836.132498:0:24389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f17b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132511:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f17b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132520:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f16d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132526:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f16d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132532:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f16d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132538:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708836.132542:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f16d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132556:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f16d lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132569:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:3.0:1789708836.132572:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708836.132577:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f16d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132582:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f16d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132597:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f174 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132603:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f174 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132608:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f174 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132613:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ac00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708836.132615:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f174 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132620:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f174 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132626:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9bee18087100) 00010000:00010000:3.0:1789708836.132628:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708836.132631:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f174 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132646:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f174 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132674:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f166 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e72a expref: 30 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132687:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f17b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e72a expref: 29 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.132694:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708836.132696:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708836.132699:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4a00, rc 0) 00000100:00100000:3.0:1789708836.133500:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+29:18939:x1876645357193472:12345-192.168.201.52@tcp:101:stat.0 Request processed in 1591us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.133508:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:1.0:1789708836.240827:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.240962:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357193728 00000100:00100000:0.0:1789708836.240974:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357193728 00000100:00100000:0.0:1789708836.241038:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:0.0:1789708836.241055:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+29:18945:x1876645357193728:12345-192.168.201.52@tcp:36:truncate.0 00010000:00010000:0.0:1789708836.241106:0:22858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708836.241133:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f17b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e72a expref: 29 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.241151:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:0.0:1789708836.241155:0:22858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708836.241387:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.241401:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.241409:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789708836.241444:0:22858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:0.0:1789708836.241461:0:22858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000120f4611 reply state 0000000090ce7b0d transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.241471:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.241476:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:0.0:1789708836.241478:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789708836.241481:0:22858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708836.241585:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+31:18945:x1876645357193728:12345-192.168.201.52@tcp:36:truncate.0 Request processed in 531us (765us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1789708836.241591:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000020:00080000:0.0:1789708836.241595:0:22858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789708836.377535:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.377621:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357193856 00000100:00100000:3.0:1789708836.377632:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357193856 00000100:00100000:3.0:1789708836.377696:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:3.0:1789708836.377718:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+31:18959:x1876645357193856:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:3.0:1789708836.377743:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708836.377766:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f189 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e731 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.377832:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f190 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.377848:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f190 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.377874:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f190 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.377886:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f197 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.377893:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.377901:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.377971:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.377981:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.377987:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708836.378040:0:24389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1789708836.378045:0:24389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708836.378065:0:24389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378078:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378087:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f190 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378103:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f190 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378111:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f190 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378117:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708836.378121:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f190 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378130:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f190 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378142:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:3.0:1789708836.378145:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708836.378150:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f190 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378156:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f190 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378170:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378177:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f197 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378183:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f197 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378189:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4c00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708836.378198:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f197 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378205:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f197 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378213:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9bee18087100) 00010000:00010000:3.0:1789708836.378216:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708836.378219:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f197 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378225:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f197 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378253:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f189 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e731 expref: 33 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378568:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e731 expref: 32 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.378577:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708836.378579:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708836.378581:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4a00, rc 0) 00000100:00100000:3.0:1789708836.378647:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+32:18959:x1876645357193856:12345-192.168.201.52@tcp:101:stat.0 Request processed in 941us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.378659:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:1.0:1789708836.464356:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.464646:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357194112 00000100:00100000:0.0:1789708836.464669:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357194112 00000100:00100000:0.0:1789708836.464734:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:0.0:1789708836.464744:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+32:18969:x1876645357194112:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789708836.464763:0:22858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708836.464785:0:22858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47f1a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e738 expref: -99 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708836.464886:0:22858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789708836.464986:0:22858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47f1a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e738 expref: 34 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.465001:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769800) 00010000:00010000:0.0:1789708836.465004:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708836.465010:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0600/0xf45f43947e47f1a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e738 expref: 34 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.465252:0:22858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0600, rc 0) 00000100:00100000:0.0:1789708836.465358:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+33:18969:x1876645357194112:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 615us (1011us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1789708836.465366:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:1.0:1789708836.468911:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.469002:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357194368 00000100:00100000:2.0:1789708836.469012:0:22861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357194368 00000100:00100000:2.0:1789708836.469075:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789708836.469086:0:22861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee2d987050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0477c79-9289-4814-b031-7f11416b686f+33:18969:x1876645357194368:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789708836.470593:0:22861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee2d987050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0477c79-9289-4814-b031-7f11416b686f+34:18969:x1876645357194368:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 1503us (1685us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1789708836.470603:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1789708836.525109:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.525256:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357194624 00000100:00100000:2.0:1789708836.525315:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357194624 00000100:00100000:2.0:1789708836.525394:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:2.0:1789708836.525403:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+34:18975:x1876645357194624:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708836.525429:0:22857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708836.525449:0:22857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f1b3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e73f expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.525555:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.525568:0:22857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f9 expref: 35 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.525577:0:22857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e731 expref: 35 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.525585:0:22857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.525621:0:22857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e731 expref: 35 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.525634:0:22857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e731 expref: 35 pid: 24389 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.525664:0:22857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee0734df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365622272:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708836.525755:0:22857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f9 expref: 35 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.525764:0:22857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f9 expref: 35 pid: 22857 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.525773:0:22857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee0734e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365622400:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708836.525795:0:22857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708836.530224:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708836.530319:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.530462:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357194752 00000100:00100000:3.0:1789708836.530472:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357194752 00010000:00010000:3.0:1789708836.530524:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e731 expref: 36 pid: 24389 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708836.530582:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357194880 00000100:00100000:3.0:1789708836.530587:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357194880 00010000:00010000:3.0:1789708836.530600:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f9 expref: 37 pid: 22857 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708836.530622:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789708836.530631:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0477c79-9289-4814-b031-7f11416b686f+37:2397:x1876645357194752:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708836.530645:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708836.530651:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e731 expref: 37 pid: 24389 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.530663:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e731 expref: 37 pid: 24389 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.530683:0:22842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708836.530688:0:22842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.530696:0:22842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.530703:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708836.530749:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0477c79-9289-4814-b031-7f11416b686f+37:2397:x1876645357194752:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 119us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.530757:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789708836.530800:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1789708836.530806:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0477c79-9289-4814-b031-7f11416b686f+36:2397:x1876645357194880:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708836.530820:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708836.530825:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f9 expref: 36 pid: 22857 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.530834:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f9 expref: 36 pid: 22857 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.530844:0:22842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708836.530847:0:22842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.530855:0:22842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.530864:0:22842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.530884:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708836.530904:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0477c79-9289-4814-b031-7f11416b686f+36:2397:x1876645357194880:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 98us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.530925:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00010000:00010000:2.0:1789708836.533185:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f19e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e731 expref: 35 pid: 24389 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.533210:0:22857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee0734df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365622272:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708836.533224:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f0e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e6f9 expref: 34 pid: 22857 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.533234:0:22857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee0734e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365622400:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789708836.533258:0:22857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.533377:0:22857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.533382:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708836.533422:0:22857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1789708836.533559:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f1b3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e73f expref: 35 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.533573:0:22857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e73f expref: 34 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.533580:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708836.533583:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708836.533586:0:22857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc600, rc 0) 00000100:00100000:2.0:1789708836.533644:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+34:18975:x1876645357194624:12345-192.168.201.52@tcp:101:bash.0 Request processed in 8242us (8544us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1789708836.533652:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:1.0:1789708836.536228:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.536651:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357195136 00000100:00100000:3.0:1789708836.536661:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357195136 00000100:00100000:3.0:1789708836.536720:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1789708836.536729:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+34:18975:x1876645357195136:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:3.0:1789708836.536982:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.536999:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.537026:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708836.537073:0:22859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:3.0:1789708836.537095:0:22859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d772a050 reply state 00000000d3a5862c transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.537108:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.537115:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708836.537118:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708836.537121:0:22859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708836.537204:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+37:18975:x1876645357195136:12345-192.168.201.52@tcp:36:bash.0 Request processed in 474us (981us total) trans 12884901914 rc 0/0 00000100:00100000:3.0:1789708836.537211:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000020:00080000:3.0:1789708836.537215:0:22859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789708836.540351:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.540660:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357195264 00000100:00100000:3.0:1789708836.540672:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357195264 00000100:00100000:3.0:1789708836.540735:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:3.0:1789708836.540744:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+37:18975:x1876645357195264:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708836.540771:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708836.540792:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f1cf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e746 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.540847:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f1cf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e746 expref: 38 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.540862:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f1cf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e746 expref: 38 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.540896:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708836.540899:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708836.540903:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4c00, rc 0) 00000100:00100000:3.0:1789708836.540965:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+38:18975:x1876645357195264:12345-192.168.201.52@tcp:101:bash.0 Request processed in 220us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.540971:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:2.0:1789708836.546602:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.546697:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357195392 00000100:00100000:3.0:1789708836.546708:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357195392 00000100:00100000:3.0:1789708836.546818:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:3.0:1789708836.546830:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+38:18975:x1876645357195392:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789708836.546850:0:22859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708836.546871:0:22859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f1d6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e74d expref: -99 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.546964:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.546980:0:22859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e73f expref: 39 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.546989:0:22859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.547041:0:22859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e73f expref: 39 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.547056:0:22859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e73f expref: 39 pid: 22857 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708836.547085:0:22859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18000700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22859:1876645365622528:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708836.547168:0:22859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee189e5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789708836.550809:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.550912:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357195520 00000100:00100000:2.0:1789708836.550922:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357195520 00010000:00010000:2.0:1789708836.550960:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e73f expref: 40 pid: 22857 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.550992:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789708836.551002:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0477c79-9289-4814-b031-7f11416b686f+40:2396:x1876645357195520:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708836.551017:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708836.551033:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e73f expref: 40 pid: 22857 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.551047:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e73f expref: 40 pid: 22857 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.551084:0:22842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708836.551090:0:22842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.551100:0:22842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.551107:0:22842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.551127:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708836.551179:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0477c79-9289-4814-b031-7f11416b686f+40:2396:x1876645357195520:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 177us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708836.551187:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00010000:00010000:3.0:1789708836.551826:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f1ba lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e73f expref: 39 pid: 22857 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708836.551845:0:22859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18000700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22859:1876645365622528:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708836.551866:0:22859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.551874:0:22859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.551879:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708836.551939:0:22859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789708836.551945:0:22859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708836.551962:0:22859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.551998:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f1d6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e74d expref: 39 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.552023:0:22859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e74d expref: 38 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.552031:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708836.552051:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708836.552054:0:22859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee1103ae00, rc 0) 00000100:00100000:3.0:1789708836.552102:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+38:18975:x1876645357195392:12345-192.168.201.52@tcp:101:bash.0 Request processed in 5275us (5509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.552110:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1789708836.556317:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.556520:0:22843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357195776 00000100:00100000:2.0:1789708836.556530:0:22843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357195776 00000100:00100000:2.0:1789708836.556605:0:22843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:2.0:1789708836.556615:0:22843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0477c79-9289-4814-b031-7f11416b686f+38:18975:x1876645357195776:12345-192.168.201.52@tcp:103:bash.0 00010000:00010000:2.0:1789708836.556630:0:22843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789708836.556657:0:22843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f1cf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e746 expref: 38 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.556677:0:22843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1dd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e74d expref: 37 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.556688:0:22843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708836.556693:0:22843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708836.556760:0:22843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0477c79-9289-4814-b031-7f11416b686f+36:18975:x1876645357195776:12345-192.168.201.52@tcp:103:bash.0 Request processed in 148us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708836.556768:0:22843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1789708836.560107:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.560231:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357195904 00000100:00100000:3.0:1789708836.560244:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357195904 00000100:00100000:3.0:1789708836.560354:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:3.0:1789708836.560375:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+36:18975:x1876645357195904:12345-192.168.201.52@tcp:58:bash.0 00010000:00010000:3.0:1789708836.560682:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.560699:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.560711:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708836.562202:0:24389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708836.562235:0:24389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789708836.562765:0:24389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1789708836.563113:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+36:18975:x1876645357195904:12345-192.168.201.52@tcp:58:bash.0 Request processed in 2746us (3010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.563135:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:2.0:1789708836.567111:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708836.567201:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357196032 00000100:00100000:1.0:1789708836.567212:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357196032 00000100:00100000:1.0:1789708836.567615:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:1.0:1789708836.567628:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee0734df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+36:18975:x1876645357196032:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789708836.567649:0:22858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708836.567670:0:22858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47f1eb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e754 expref: -99 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.567723:0:22858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.567733:0:22858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47f1eb lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e754 expref: 37 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.567752:0:22858:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.567765:0:22858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47f1eb lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e754 expref: 37 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.567779:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:1.0:1789708836.567783:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708836.567786:0:22858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47f1eb lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e754 expref: 37 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.567812:0:22858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508800, rc 0) 00000100:00100000:1.0:1789708836.567873:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee0734df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+37:18975:x1876645357196032:12345-192.168.201.52@tcp:101:bash.0 Request processed in 248us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708836.567880:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000040:00080000:2.0:1789708836.582530:0:22893:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789708836.582540:0:22893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708836.582577:0:22893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789708836.582594:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789708836.582734:0:22893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee3622ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22893:1876645365622656:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708836.582821:0:22893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d840 going to sleep for 11 seconds 00010000:00010000:0.0:1789708836.584496:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708836.593756:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.593836:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357196160 00000100:00100000:3.0:1789708836.593846:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357196160 00000100:00100000:3.0:1789708836.593917:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:3.0:1789708836.593928:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+38:18976:x1876645357196160:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789708836.593959:0:22857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789708836.594083:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+38:18976:x1876645357196160:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 156us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.594092:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:1.0:1789708836.597176:0:22893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee3622ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22893:1876645365622656:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789708836.599424:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.599739:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357196288 00000100:00100000:3.0:1789708836.599749:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357196288 00000100:00100000:3.0:1789708836.599821:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:3.0:1789708836.599830:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+37:18976:x1876645357196288:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789708836.599926:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f1f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.599942:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f1f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.599954:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f1f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600018:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600026:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600033:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600057:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600065:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600071:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708836.600114:0:22859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789708836.600119:0:22859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708836.600135:0:22859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600153:0:22859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f1f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600160:0:22859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f1f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600167:0:22859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600173:0:22859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103b200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708836.600178:0:22859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600185:0:22859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f1f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600198:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bed097e1400) 00010000:00010000:3.0:1789708836.600201:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708836.600206:0:22859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f1f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600211:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103b200/0xf45f43947e47f1f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600225:0:22859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600230:0:22859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600234:0:22859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600244:0:22859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ae00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708836.600247:0:22859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600252:0:22859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600311:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9bee18087a00) 00010000:00010000:3.0:1789708836.600315:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708836.600318:0:22859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600323:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ae00/0xf45f43947e47f1f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600338:0:22859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600344:0:22859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600349:0:22859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600353:0:22859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708836.600356:0:22859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600371:0:22859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600390:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708836.600393:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708836.600396:0:22859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.600401:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a800/0xf45f43947e47f200 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708836.600953:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+37:18976:x1876645357196288:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 1120us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.600964:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:1.0:1789708836.615387:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.615970:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357196544 00000100:00100000:3.0:1789708836.615982:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357196544 00000100:00100000:3.0:1789708836.616052:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:3.0:1789708836.616062:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+37:18976:x1876645357196544:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708836.616085:0:22857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708836.616107:0:22857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f207 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e75b expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616214:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f20e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616232:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f20e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616243:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f20e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708836.616255:0:22857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789708836.616395:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f20e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616403:0:22857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f20e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616409:0:22857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f20e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616416:0:22857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:3.0:1789708836.616421:0:22857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f20e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616428:0:22857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f20e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616441:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:3.0:1789708836.616444:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708836.616449:0:22857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f20e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616455:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f20e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616508:0:22857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f207 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e75b expref: 39 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616519:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bed097e1400) 00010000:00010000:3.0:1789708836.616521:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708836.616525:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f207 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e75b expref: 39 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.616546:0:22857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30492800, rc 0) 00000100:00100000:3.0:1789708836.616623:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+38:18976:x1876645357196544:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 561us (1246us total) trans 12884901915 rc 301/301 00000100:00100000:3.0:1789708836.616631:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:2.0:1789708836.622434:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708836.622662:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357196672 00000100:00100000:1.0:1789708836.622673:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357196672 00000100:00100000:1.0:1789708836.622739:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:1.0:1789708836.622749:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+38:18976:x1876645357196672:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789708836.622789:0:22858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789708836.623052:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+38:18976:x1876645357196672:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 303us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708836.623061:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:0.0:1789708836.639317:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.639650:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357196928 00000100:00100000:3.0:1789708836.639661:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357196928 00000100:00100000:3.0:1789708836.639724:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:3.0:1789708836.639735:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+38:18976:x1876645357196928:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708836.639756:0:22857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708836.639777:0:22857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f21c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e762 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708836.640175:0:22857:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:3.0:1789708836.640183:0:22857:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1789708836.640206:0:22857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1789708836.640399:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f223 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.640414:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f223 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.640426:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f223 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.640493:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f21c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e762 expref: 41 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.640529:0:22857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f223 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e762 expref: 40 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.640537:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087a00) 00010000:00010000:3.0:1789708836.640541:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708836.640543:0:22857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30493000, rc 0) 00000100:00100000:3.0:1789708836.640610:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+40:18976:x1876645357196928:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 876us (1301us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1789708836.640618:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1789708836.654436:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.662682:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357197184 00000100:00100000:3.0:1789708836.662804:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357197184 00000100:00100000:3.0:1789708836.662888:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:3.0:1789708836.662898:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3fabe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+40:18976:x1876645357197184:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789708836.665377:0:22859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708836.665415:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493000/0xf45f43947e47f223 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e762 expref: 40 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665439:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087a00) 00010000:00010000:2.0:1789708836.665451:0:22859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708836.665476:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f231 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665491:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f231 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665502:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f231 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665519:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f238 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3d5e55e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665541:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f238 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3d5e55e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665549:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f238 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3d5e55e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665603:0:22859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f231 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665611:0:22859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f231 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665618:0:22859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f231 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665625:0:22859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708836.665630:0:22859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f231 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665638:0:22859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f231 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665646:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:2.0:1789708836.665649:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708836.665654:0:22859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f231 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665660:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc600/0xf45f43947e47f231 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665671:0:22859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f238 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3d5e55e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665683:0:22859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f238 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3d5e55e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665690:0:22859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f238 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3d5e55e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665696:0:22859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708836.665699:0:22859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f238 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3d5e55e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665706:0:22859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f238 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3d5e55e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665714:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x3d5e55e2 (ffff9bee2c769b00) 00010000:00010000:2.0:1789708836.665717:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708836.665720:0:22859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f238 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3d5e55e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.665726:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f238 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3d5e55e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.665873:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3fabe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+39:18976:x1876645357197184:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 2974us (11446us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708836.665882:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:2.0:1789708836.669679:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.669819:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357197312 00000100:00100000:3.0:1789708836.669831:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357197312 00000100:00100000:3.0:1789708836.669962:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:3.0:1789708836.669974:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+39:18976:x1876645357197312:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708836.669997:0:22857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708836.671342:0:22857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f23f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e769 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.671388:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f246 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.671421:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f246 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.671435:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f246 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.671541:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f23f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e769 expref: 41 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.671560:0:22857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5e00/0xf45f43947e47f246 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e769 expref: 40 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.671568:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:2.0:1789708836.671571:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789708836.671574:0:22857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb5e00, rc 0) 00000100:00100000:2.0:1789708836.671641:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+40:18976:x1876645357197312:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1670us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708836.671649:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:1.0:1789708836.685655:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.685749:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357197568 00000100:00100000:0.0:1789708836.685770:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357197568 00000100:00100000:0.0:1789708836.685830:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:0.0:1789708836.685840:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee107e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+40:18976:x1876645357197568:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789708836.685934:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.685951:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.685961:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708836.686135:0:22858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1789708836.686145:0:22858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407495884314ns, next at 408495881530ns, rc = 0 00000004:00010000:0.0:1789708836.686193:0:22858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000423dd877 reply state 000000001cb45faa transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.686206:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.686213:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:0.0:1789708836.686216:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789708836.686220:0:22858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708836.686364:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee107e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+42:18976:x1876645357197568:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 524us (717us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1789708836.686389:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:3.0:1789708836.689241:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708836.692367:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357197696 00000100:00100000:1.0:1789708836.692383:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357197696 00000100:00100000:0.0:1789708836.694478:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:0.0:1789708836.694502:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+42:18976:x1876645357197696:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708836.694529:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708836.694551:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47f254 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e770 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.694612:0:24389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47f254 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e770 expref: 43 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.694626:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47f254 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e770 expref: 43 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.694645:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:0.0:1789708836.694649:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708836.694653:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0c00, rc 0) 00000100:00100000:0.0:1789708836.694723:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+43:18976:x1876645357197696:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 233us (5491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.694731:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:3.0:1789708836.705234:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.705308:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357197824 00000100:00100000:0.0:1789708836.705320:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357197824 00000100:00100000:0.0:1789708836.705384:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:0.0:1789708836.705395:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0477c79-9289-4814-b031-7f11416b686f+5:2396:x1876645357197824:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789708836.705689:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0477c79-9289-4814-b031-7f11416b686f+6:2396:x1876645357197824:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 294us (462us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1789708836.705708:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:1.0:1789708836.707787:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.708079:0:22860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357198080 00000100:00100000:3.0:1789708836.708089:0:22860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357198080 00000100:00100000:3.0:1789708836.708145:0:22860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789708836.708156:0:22860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+43:18976:x1876645357198080:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789708836.708448:0:22860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+44:18976:x1876645357198080:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 293us (668us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1789708836.708455:0:22860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789708836.710465:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.710604:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357198336 00000100:00100000:0.0:1789708836.710613:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357198336 00000100:00100000:0.0:1789708836.710669:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:0.0:1789708836.710679:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+44:18976:x1876645357198336:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789708836.710910:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+44:18976:x1876645357198336:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 232us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.710919:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:0.0:1789708836.717369:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.718007:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357198464 00000100:00100000:2.0:1789708836.718020:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357198464 00000100:00100000:2.0:1789708836.718097:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:2.0:1789708836.718107:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+44:18976:x1876645357198464:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708836.718130:0:22857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708836.718158:0:22857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f25b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e777 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.718232:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f262 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.718830:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f262 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.718845:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f262 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708836.728421:0:22857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789708836.728464:0:22857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f262 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.728517:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4a00/0xf45f43947e47f25b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e777 expref: 46 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.728539:0:22857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f262 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e777 expref: 45 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.728548:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:3.0:1789708836.728551:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789708836.728555:0:22857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bed09bb4c00, rc 0) 00000100:00100000:3.0:1789708836.728643:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+45:18976:x1876645357198464:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 10536us (11284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.728654:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:2.0:1789708836.734019:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.734222:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357198592 00000100:00100000:0.0:1789708836.734233:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357198592 00000100:00100000:0.0:1789708836.734326:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:0.0:1789708836.734337:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0477c79-9289-4814-b031-7f11416b686f+6:2398:x1876645357198592:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708836.734356:0:24367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708836.734375:0:24367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47f269 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e77e expref: -99 pid: 24367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708836.734401:0:24367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacca24, blocks: 0x0 00010000:00010000:0.0:1789708836.734420:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1789708836.734425:0:24367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708836.734433:0:24367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47f269 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e77e expref: 7 pid: 24367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.734450:0:24367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47f269 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e77e expref: 7 pid: 24367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.734480:0:24367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee2f7d0400, rc 0) 00000100:00100000:0.0:1789708836.734529:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0477c79-9289-4814-b031-7f11416b686f+7:2398:x1876645357198592:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 194us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.734536:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1789708836.739364:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.739519:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357198848 00000100:00100000:3.0:1789708836.739529:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357198848 00000100:00100000:3.0:1789708836.739581:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:3.0:1789708836.739591:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee10fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+45:18976:x1876645357198848:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789708836.739703:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee10fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+45:18976:x1876645357198848:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 113us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.739722:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:3.0:1789708836.742378:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.752586:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357198976 00000100:00100000:0.0:1789708836.752605:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357198976 00000100:00100000:0.0:1789708836.752690:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:0.0:1789708836.752701:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+45:18976:x1876645357198976:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789708836.755531:0:22837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1789708836.755550:0:22837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789708836.755791:0:22837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:3.0:1789708836.759873:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+20:18976:x1876645357198976:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 7165us (17602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.759888:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:3.0:1789708836.762818:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365622784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789708836.762887:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708836.763670:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365622784 00000100:00100000:1.0:1789708836.763680:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365622784 00000100:00100000:1.0:1789708836.763756:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708836.763787:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365622784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789708836.763965:0:24366:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789708836.763969:0:24366:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789708836.763971:0:24366:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789708836.763973:0:24366:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789708836 -> 1789708836 00002000:00010000:1.0:1789708836.763975:0:24366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789708836.764191:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1876645365622784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 406us (1302us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1789708836.764200:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789708836.764453:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789708836.764499:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bee18000000/2, rc 0, transno 12884901892 00000100:00100000:3.0:1789708836.764506:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365622784:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789708836.764798:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.764809:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.764817:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.764824:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01508e00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708836.764829:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.764836:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.764854:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bed08844800) 00010000:00010000:1.0:1789708836.764858:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708836.764863:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.764882:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508e00/0xf45f43947e47f02b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.764903:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765444:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765450:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765455:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee01509400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708836.765459:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765465:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765474:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:1.0:1789708836.765476:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708836.765479:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765484:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01509400/0xf45f43947e47f032 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765499:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765505:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765519:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765524:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103a200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708836.765527:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765532:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765540:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9bee18087100) 00010000:00010000:1.0:1789708836.765543:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708836.765546:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765552:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103a200/0xf45f43947e47f0da lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765569:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765575:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765581:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765585:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708836.765588:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765604:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765613:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:1.0:1789708836.765615:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708836.765618:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765623:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f15f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765637:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765642:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765648:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765653:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d0000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708836.765656:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765660:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765667:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:1.0:1789708836.765669:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708836.765672:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765686:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0000/0xf45f43947e47f182 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765698:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765703:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765707:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765711:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb4800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708836.765714:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765720:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765728:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:1.0:1789708836.765730:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708836.765733:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765738:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4800/0xf45f43947e47f1c8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765747:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765753:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765764:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765769:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee2f7d1000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708836.765771:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765778:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765785:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:1.0:1789708836.765788:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789708836.765792:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.765797:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1000/0xf45f43947e47f24d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708836.769460:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.769678:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357199104 00000100:00100000:0.0:1789708836.769687:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357199104 00000100:00100000:0.0:1789708836.769760:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:0.0:1789708836.769772:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0477c79-9289-4814-b031-7f11416b686f+7:2396:x1876645357199104:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789708836.769878:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0477c79-9289-4814-b031-7f11416b686f+7:2396:x1876645357199104:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 108us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.769886:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00010000:00010000:2.0:1789708836.770328:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.770341:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.770350:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.770357:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bed09bb5000 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708836.770361:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.770368:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.770385:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:2.0:1789708836.770388:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789708836.770392:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.770399:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb5000/0xf45f43947e47f07f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708836.780047:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708836.788570:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357199360 00000100:00100000:3.0:1789708836.788588:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357199360 00000100:00100000:3.0:1789708836.788658:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1789708836.788669:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+14:18976:x1876645357199360:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708836.788721:0:22859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708836.788748:0:22859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bed09bb4c00/0xf45f43947e47f262 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e777 expref: 14 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.788768:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:3.0:1789708836.788774:0:22859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708836.789179:0:22859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.789195:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.789205:0:22859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708836.789494:0:22859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d56a36b reply state 000000005a325251 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.789507:0:22859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.789513:0:22859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:3.0:1789708836.789516:0:22859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789708836.789518:0:22859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708836.789640:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+15:18976:x1876645357199360:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 970us (9600us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1789708836.789648:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1789708836.793858:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708836.794836:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357199488 00000100:00100000:1.0:1789708836.794848:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357199488 00000100:00100000:1.0:1789708836.794916:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1789708836.794926:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0477c79-9289-4814-b031-7f11416b686f+7:18976:x1876645357199488:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708836.794945:0:24366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708836.794965:0:24366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e785 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.794998:0:24366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47f269 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e77e expref: 8 pid: 24367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.795023:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708836.795028:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708836.795033:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 8 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.795095:0:24366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47f269 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e77e expref: 8 pid: 24367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708836.795111:0:24366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47f269 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e77e expref: 8 pid: 24367 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708836.795126:0:24366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24366:1876645365622912:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789708836.795214:0:24366:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bed08a91b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708836.799815:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.799936:0:24366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24366:1876645365622912:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789708836.799970:0:24366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 8 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.799992:0:24366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee01508e00, rc 0) 00000100:00100000:0.0:1789708836.800057:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0477c79-9289-4814-b031-7f11416b686f+8:18976:x1876645357199488:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 5132us (6206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.800075:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1789708836.801920:0:22842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357199616 00000100:00100000:2.0:1789708836.801931:0:22842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357199616 00010000:00010000:2.0:1789708836.801976:0:22842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47f269 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e77e expref: 8 pid: 24367 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.802010:0:22842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1789708836.802020:0:22842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0477c79-9289-4814-b031-7f11416b686f+8:2395:x1876645357199616:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708836.802037:0:22842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708836.802059:0:22842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47f269 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e77e expref: 8 pid: 24367 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.802081:0:22842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47f269 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e77e expref: 8 pid: 24367 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.802210:0:22842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a276957/0xf45f43947e47f269 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e77e expref: 8 pid: 24367 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.802228:0:22842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708836.802233:0:22842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708836.802240:0:22842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 7 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.802250:0:22842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 7 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.802493:0:22842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 7 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.802507:0:22842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a299500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22842:1876645365623040:192.168.201.52@tcp:105: 00000100:00100000:2.0:1789708836.802709:0:22842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789708836.813168:0:22842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a299500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22842:1876645365623040:192.168.201.52@tcp:105: 00010000:00010000:2.0:1789708836.813196:0:22842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708836.813306:0:22842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0477c79-9289-4814-b031-7f11416b686f+7:2395:x1876645357199616:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 11239us (13453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708836.813320:0:22842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1789708836.814968:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.819311:0:24367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357199744 00000100:00100000:0.0:1789708836.819327:0:24367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357199744 00000100:00100000:1.0:1789708836.825674:0:24367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1789708836.825687:0:24367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0477c79-9289-4814-b031-7f11416b686f+7:2395:x1876645357199744:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789708836.826185:0:24367:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789708836.826189:0:24367:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789708836 00002000:00010000:1.0:1789708836.826192:0:24367:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789708834 00002000:00010000:1.0:1789708836.826195:0:24367:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789708836 -> 1789708836 00002000:00010000:1.0:1789708836.826197:0:24367:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789708836.826326:0:24367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0477c79-9289-4814-b031-7f11416b686f+8:2395:x1876645357199744:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 639us (11360us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789708836.826352:0:24367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:3.0:1789708836.835698:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.837074:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357199872 00000100:00100000:2.0:1789708836.837296:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357199872 00000100:00100000:2.0:1789708836.837370:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:2.0:1789708836.837381:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0477c79-9289-4814-b031-7f11416b686f+8:2396:x1876645357199872:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789708836.837428:0:24365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.837447:0:24365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 8 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.837457:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708836.837461:0:24365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708836.837466:0:24365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.837522:0:24365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 8 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.837535:0:24365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 8 pid: 24366 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.837665:0:24365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a299500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24365:1876645365623168:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708836.837767:0:24365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708836.840533:0:24365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a299500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24365:1876645365623168:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789708836.840572:0:24365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708836.854350:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.854463:0:22843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357200000 00000100:00100000:2.0:1789708836.854474:0:22843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357200000 00010000:00010000:2.0:1789708836.854537:0:22843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 9 pid: 24366 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.854577:0:22843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1789708836.854587:0:22843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0477c79-9289-4814-b031-7f11416b686f+9:2395:x1876645357200000:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708836.854605:0:22843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708836.854625:0:22843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 9 pid: 24366 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.854639:0:22843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 9 pid: 24366 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.854660:0:22843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025ac837c/0xf45f43947e47f277 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e785 expref: 9 pid: 24366 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.854696:0:22843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708836.854700:0:22843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708836.854706:0:22843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.854716:0:22843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.854756:0:22843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708836.854815:0:22843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0477c79-9289-4814-b031-7f11416b686f+8:2395:x1876645357200000:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 229us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708836.854823:0:22843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00010000:00010000:3.0:1789708836.856058:0:24365:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.856082:0:24365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.856212:0:24365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.856221:0:24365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.856243:0:24365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.856251:0:24365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc600 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708836.856255:0:24365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.856306:0:24365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.856321:0:24365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.856330:0:24365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f27e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708836.856402:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0477c79-9289-4814-b031-7f11416b686f+7:2396:x1876645357199872:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 19021us (20711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708836.856410:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:3.0:1789708836.860246:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.860507:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357200256 00000100:00100000:2.0:1789708836.860525:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357200256 00000100:00100000:2.0:1789708836.860593:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:2.0:1789708836.860603:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+15:18976:x1876645357200256:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789708836.861072:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.861191:0:22857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e723 expref: 15 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.861202:0:22857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.861240:0:22857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e723 expref: 15 pid: 22859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.861300:0:22857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e723 expref: 15 pid: 22859 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.861315:0:22857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a29b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365623296:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789708836.861400:0:22857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee2f78d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789708836.866704:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.866792:0:22844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357200384 00000100:00100000:0.0:1789708836.866801:0:22844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357200384 00010000:00010000:0.0:1789708836.866843:0:22844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e723 expref: 16 pid: 22859 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708836.866886:0:22844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:0.0:1789708836.866895:0:22844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0477c79-9289-4814-b031-7f11416b686f+16:2396:x1876645357200384:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708836.866910:0:22844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708836.866916:0:22844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e723 expref: 16 pid: 22859 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.866929:0:22844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e723 expref: 16 pid: 22859 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.866952:0:22844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:0.0:1789708836.866959:0:22844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47f1eb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e754 expref: 16 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.866969:0:22844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.866977:0:22844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.866985:0:22844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708836.867002:0:22844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708836.867099:0:22844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0477c79-9289-4814-b031-7f11416b686f+16:2396:x1876645357200384:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 203us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.867107:0:22844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00010000:00010000:3.0:1789708836.867800:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d1600/0xf45f43947e47f158 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e723 expref: 15 pid: 22859 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708836.867817:0:22857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a29b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365623296:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708836.867848:0:22857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.867858:0:22857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.867864:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.868096:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.868109:0:22857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47f254 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e770 expref: 15 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.868116:0:22857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.868146:0:22857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47f254 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e770 expref: 15 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.868158:0:22857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47f254 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e770 expref: 15 pid: 24389 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708836.868170:0:22857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18003480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365623424:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789708836.868227:0:22857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee189e5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708836.874255:0:22857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18003480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365623424:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789708836.874346:0:22857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708836.889463:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.889983:0:22843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357200512 00000100:00100000:2.0:1789708836.889994:0:22843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357200512 00010000:00010000:2.0:1789708836.890051:0:22843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47f254 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e770 expref: 16 pid: 24389 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.890335:0:22843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789708836.890347:0:22843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3faba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0477c79-9289-4814-b031-7f11416b686f+16:2395:x1876645357200512:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708836.890362:0:22843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708836.890369:0:22843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47f254 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e770 expref: 16 pid: 24389 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.890382:0:22843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47f254 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e770 expref: 16 pid: 24389 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.890404:0:22843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee2f7d0c00/0xf45f43947e47f254 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e770 expref: 16 pid: 24389 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.890420:0:22843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:2.0:1789708836.890425:0:22843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.890449:0:22843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.890457:0:22843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.890492:0:22843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708836.890563:0:22843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3faba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0477c79-9289-4814-b031-7f11416b686f+15:2395:x1876645357200512:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 218us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708836.890572:0:22843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00010000:00010000:3.0:1789708836.890665:0:22857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.890674:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708836.890793:0:22857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:3.0:1789708836.890902:0:22857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:3.0:1789708836.890939:0:22857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:3.0:1789708836.891033:0:22857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18003480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22857:1876645365623552:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789708836.891614:0:22857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708836.891644:0:22857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee10fa4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708836.897373:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365623552 00000100:00100000:1.0:1789708836.897388:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365623552 00000100:00100000:1.0:1789708836.897456:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789708836.897465:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22857:x1876645365623552:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789708836.898314:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22857:x1876645365623552:12345-0@lo:1000:mdt00_000.0 Request processed in 848us (6698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708836.898331:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789708836.902444:0:22857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18003480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22857:1876645365623552:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789708836.902785:0:22857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:0.0:1789708836.902863:0:22857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22857:1876645365623680:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789708836.902931:0:22857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708836.903034:0:22857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee3e872000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708836.903850:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365623680 00000100:00100000:1.0:1789708836.903858:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365623680 00000100:00100000:1.0:1789708836.903922:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789708836.903932:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22857:x1876645365623680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789708836.904450:0:22857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22857:1876645365623680:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789708836.904493:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904503:0:22857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904511:0:22857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904528:0:22857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493200 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708836.904532:0:22857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904549:0:22857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904564:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:2.0:1789708836.904567:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708836.904582:0:22857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904589:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493200/0xf45f43947e47f28c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904619:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904626:0:22857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904631:0:22857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904637:0:22857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee1103ac00 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708836.904640:0:22857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904646:0:22857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904654:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708836.904656:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708836.904663:0:22857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47f1eb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e754 expref: 18 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904673:0:22857:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47f1eb lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e754 expref: 18 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904681:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47f1eb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e754 expref: 18 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.904748:0:22857:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bee01508800/0xf45f43947e47f1eb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e754 expref: 18 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708836.904761:0:22857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a29ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365623808:192.168.201.52@tcp:105: 00000100:00100000:2.0:1789708836.904826:0:22857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bee0883e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708836.904965:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22857:x1876645365623680:12345-0@lo:1000:mdt00_000.0 Request processed in 1033us (2031us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1789708836.904975:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789708836.909077:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.909166:0:22857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a29ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22857:1876645365623808:192.168.201.52@tcp:105: 00010000:00010000:2.0:1789708836.909197:0:22857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909209:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee1103ac00/0xf45f43947e47f1e4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 24389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909241:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f293 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909254:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f293 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909297:0:22857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f293 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909307:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f293 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909314:0:22857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f293 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909320:0:22857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f293 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909352:0:22857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708836.909356:0:22857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f293 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909363:0:22857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f293 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909375:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708836.909378:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708836.909382:0:22857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f293 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909388:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f293 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909400:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909407:0:22857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909413:0:22857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909418:0:22857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708836.909422:0:22857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909428:0:22857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909447:0:22857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708836.909449:0:22857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789708836.909453:0:22857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.909460:0:22857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f285 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708836.910315:0:22860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357200640 00000100:00100000:0.0:1789708836.910335:0:22860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357200640 00000100:00100000:0.0:1789708836.910390:0:22860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1789708836.910400:0:22860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+19:18975:x1876645357200640:12345-192.168.201.52@tcp:49:bash.0 00000100:00100000:2.0:1789708836.916474:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0477c79-9289-4814-b031-7f11416b686f+19:18976:x1876645357200256:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 55860us (56224us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1789708836.916490:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000020:00080000:2.0:1789708836.916499:0:22857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789708836.916756:0:22860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+18:18975:x1876645357200640:12345-192.168.201.52@tcp:49:bash.0 Request processed in 6356us (7697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708836.916766:0:22860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000040:00080000:2.0:1789708836.917647:0:22893:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789708836.917653:0:22893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708836.917680:0:22893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789708836.917694:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789708836.945536:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789708836.945769:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.945841:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357200768 00000100:00100000:2.0:1789708836.945852:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357200768 00000100:00100000:2.0:1789708836.945914:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:2.0:1789708836.945924:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0477c79-9289-4814-b031-7f11416b686f+7:18975:x1876645357200768:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708836.945943:0:25061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708836.945967:0:25061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f29a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e78c expref: -99 pid: 25061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708836.945995:0:25061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aacca24, atime: 0x6aacca22, ctime: 0x6aacca24, blocks: 0x0 00010000:00010000:2.0:1789708836.946019:0:25061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=407s v=(0 0) 00010000:00010000:2.0:1789708836.946024:0:25061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708836.946047:0:25061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f29a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e78c expref: 8 pid: 25061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.946074:0:25061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033a957f6/0xf45f43947e47f29a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e78c expref: 8 pid: 25061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.946229:0:25061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebc600, rc 0) 00000100:00100000:3.0:1789708836.946383:0:22860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357201024 00000100:00100000:3.0:1789708836.946389:0:22860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357201024 00000100:00100000:3.0:1789708836.946419:0:22860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:3.0:1789708836.946427:0:22860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+18:18976:x1876645357201024:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789708836.946692:0:22860:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789708836.946725:0:22860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:3.0:1789708836.946756:0:22860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946769:0:22860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946779:0:22860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946799:0:22860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946806:0:22860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946812:0:22860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946831:0:22860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708836.946863:0:22846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708836.946868:0:22846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946875:0:22846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30493e00 already unused, calling callback (ffffffffc0d676c0) 00010000:00010000:3.0:1789708836.946879:0:22846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946886:0:22846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946897:0:22846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:3.0:1789708836.946900:0:22846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789708836.946904:0:22846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946911:0:22846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2a1 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708836.946925:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708836.946927:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708836.946934:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708836.947410:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0477c79-9289-4814-b031-7f11416b686f+8:18975:x1876645357200768:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1484us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708836.947418:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:3.0:1789708836.948569:0:22860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+20:18976:x1876645357201024:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 2139us (2796us total) trans 12884901926 rc 0/0 00000100:00100000:3.0:1789708836.948580:0:22860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000020:00080000:3.0:1789708836.948586:0:22860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789708836.954760:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.954857:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357201152 00000100:00100000:2.0:1789708836.954868:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357201152 00000100:00100000:2.0:1789708836.954933:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:2.0:1789708836.954944:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+20:18975:x1876645357201152:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789708836.954967:0:22858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708836.954987:0:22858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2a8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e793 expref: -99 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.955031:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f2af lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.955045:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f2af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.955057:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f2af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.955181:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2a8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e793 expref: 22 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.955213:0:22858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd600/0xf45f43947e47f2af lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e793 expref: 21 pid: 22858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708836.955221:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708836.955224:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789708836.955228:0:22858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee40ebd600, rc 0) 00000100:00100000:2.0:1789708836.955327:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+21:18975:x1876645357201152:12345-192.168.201.52@tcp:101:bash.0 Request processed in 385us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708836.955335:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:0.0:1789708836.971994:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708836.972450:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357201408 00000100:00100000:2.0:1789708836.972462:0:22861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357201408 00000100:00100000:2.0:1789708836.972518:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1789708836.972529:0:22861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0477c79-9289-4814-b031-7f11416b686f+21:18975:x1876645357201408:12345-192.168.201.52@tcp:35:bash.0 00000001:00080000:2.0:1789708836.972844:0:22861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000100:00100000:2.0:1789708836.973710:0:22861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0477c79-9289-4814-b031-7f11416b686f+23:18975:x1876645357201408:12345-192.168.201.52@tcp:35:bash.0 Request processed in 1178us (1720us total) trans 12884901928 rc 0/0 00000100:00100000:2.0:1789708836.973721:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000020:00080000:2.0:1789708836.973727:0:22861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789708837.054741:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708837.054888:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357201664 00000100:00100000:3.0:1789708837.054899:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357201664 00000100:00100000:3.0:1789708837.054981:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:3.0:1789708837.054992:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+23:18986:x1876645357201664:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789708837.055025:0:24389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708837.055045:0:24389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7e9f5a06715e79a expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708837.055380:0:24389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789708837.055475:0:24389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e79a expref: 25 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.055489:0:24389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bee2c769800) 00010000:00010000:3.0:1789708837.055493:0:24389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708837.055498:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30493e00/0xf45f43947e47f2b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xe7e9f5a06715e79a expref: 25 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.055510:0:24389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bee30493e00, rc 0) 00000100:00080000:0.0:1789708837.055626:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708837.057931:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0477c79-9289-4814-b031-7f11416b686f+24:18986:x1876645357201664:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 2932us (3191us total) trans 12884901929 rc 301/301 00000100:00100000:3.0:1789708837.057943:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:0.0:1789708837.061191:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789708837.061456:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357201792 00000100:00100000:2.0:1789708837.061467:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357201792 00000100:00100000:2.0:1789708837.061551:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:2.0:1789708837.061562:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+24:18986:x1876645357201792:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:2.0:1789708837.061639:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2c4 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061655:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2c4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061684:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2c4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061702:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f2cb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061710:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f2cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061717:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f2cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061793:0:22858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061802:0:22858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061809:0:22858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708837.061849:0:22858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061860:0:22858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2c4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061866:0:22858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2c4 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061873:0:22858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2c4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061889:0:22858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebc400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708837.061894:0:22858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2c4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061902:0:22858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2c4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061914:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bed08844000) 00010000:00010000:2.0:1789708837.061917:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708837.061922:0:22858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2c4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061928:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebc400/0xf45f43947e47f2c4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061940:0:22858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f2cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061945:0:22858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f2cb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061951:0:22858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f2cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061956:0:22858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee40ebd400 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708837.061959:0:22858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f2cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061965:0:22858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f2cb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061982:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9bee2c769d00) 00010000:00010000:2.0:1789708837.061985:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708837.061988:0:22858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f2cb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.061994:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee40ebd400/0xf45f43947e47f2cb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.062009:0:22858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.062014:0:22858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.062020:0:22858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.062025:0:22858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee029c9600 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:2.0:1789708837.062028:0:22858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.062034:0:22858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.062041:0:22858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bee18087300) 00010000:00010000:2.0:1789708837.062043:0:22858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708837.062046:0:22858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.062051:0:22858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee029c9600/0xf45f43947e47f2d2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708837.063023:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+24:18986:x1876645357201792:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 1458us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708837.063035:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:0.0:1789708837.075851:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708837.076108:0:22860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357202048 00000100:00100000:3.0:1789708837.076118:0:22860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357202048 00000100:00100000:3.0:1789708837.076307:0:22860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:3.0:1789708837.076329:0:22860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+24:18986:x1876645357202048:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789708837.076694:0:22860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0477c79-9289-4814-b031-7f11416b686f+25:18986:x1876645357202048:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 377us (852us total) trans 12884901930 rc 0/0 00000100:00100000:3.0:1789708837.076701:0:22860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00010000:00010000:0.0:1789708837.606794:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708837.736370:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789708837.736397:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365623936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708837.736488:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708837.736543:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365623936 00000100:00100000:3.0:1789708837.736553:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365623936 00000100:00100000:3.0:1789708837.736616:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789708837.736626:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1876645365623936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708837.736665:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708837.736713:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1876645365623936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708837.736721:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789708837.736777:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365623936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708837.737131:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708837.737143:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365624064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789708837.737181:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708837.737215:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365624064 00000100:00100000:1.0:1789708837.737220:0:22862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365624064 00000100:00100000:1.0:1789708837.737329:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708837.737337:0:22862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365624064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789708837.737367:0:22862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789708837.737405:0:22862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876645365624064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708837.737412:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708837.737443:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876645365624064:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789708838.630738:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708838.759454:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee18002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365624192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789708838.759529:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708838.759668:0:24368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365624192 00000100:00100000:3.0:1789708838.759677:0:24368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365624192 00000100:00100000:3.0:1789708838.759787:0:24368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789708838.759797:0:24368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed08bea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365624192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789708838.759820:0:24368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789708838.759873:0:24368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed08bea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365624192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708838.759881:0:24368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789708838.759931:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee18002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365624192:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789708838.759993:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789708839.030963:0:25943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1789708839.271759:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365624320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789708839.271852:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708839.271949:0:25134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365624320 00000100:00100000:1.0:1789708839.271962:0:25134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365624320 00000100:00100000:1.0:1789708839.272029:0:25134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789708839.272041:0:25134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365624320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789708839.272215:0:25134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1789708839.280599:0:25134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876645365624320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8544us (8732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708839.280621:0:25134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789708839.288845:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876645365624320:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789708839.654498:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708839.782880:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed08be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365624576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789708839.782955:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708839.783176:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365624576 00000100:00100000:1.0:1789708839.783185:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365624576 00000100:00100000:1.0:1789708839.783278:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708839.783290:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365624576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789708839.783319:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789708839.783366:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876645365624576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708839.783373:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789708839.783457:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365624448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708839.783490:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789708839.783618:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708839.783659:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed08be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876645365624576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789708839.783718:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365624448 00000100:00100000:1.0:1789708839.783723:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365624448 00000100:00100000:1.0:1789708839.783754:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789708839.783760:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365624448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708839.783792:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789708839.783831:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876645365624448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708839.783838:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789708839.783904:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bed0a2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365624448:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789708839.784005:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708839.784417:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365624704:0@lo:400:kworker.0 00000100:00100000:3.0:1789708839.784493:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708839.784555:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708839.784566:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365625088:0@lo:400:kworker.0 00000100:00100000:3.0:1789708839.784606:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708839.784639:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365625216:0@lo:400:kworker.0 00000100:00100000:2.0:1789708839.784708:0:22851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365624704 00000100:00100000:2.0:1789708839.784715:0:22851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365624704 00000100:00100000:2.0:1789708839.784755:0:22851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789708839.784762:0:22851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3616:x1876645365624704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708839.784821:0:22851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49ba98ed-5d0d-46d3-aa10-fc006dc67b25+24:3616:x1876645365624704:12345-0@lo:400:kworker.0 Request processed in 59us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708839.784829:0:22851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789708839.784871:0:22857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365625088 00000100:00100000:2.0:1789708839.784875:0:22857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365625088 00000100:00100000:2.0:1789708839.784903:0:22857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789708839.784910:0:22857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee18003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365625088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708839.784944:0:22857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee18003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876645365625088:12345-0@lo:400:kworker.0 Request processed in 34us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708839.784950:0:22857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789708839.784973:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365624960:0@lo:400:kworker.0 00000100:00100000:2.0:1789708839.785001:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708839.785080:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708839.785108:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365625728:0@lo:400:kworker.0 00000100:00100000:3.0:1789708839.785133:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708839.785181:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876645365625088:0@lo:400:kworker.0 00000100:00100000:0.0:1789708839.785188:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365624960 00000100:00100000:0.0:1789708839.785195:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365624960 00000100:00100000:3.0:1789708839.785198:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:49ba98ed-5d0d-46d3-aa10-fc006dc67b25:3616:1876645365624704:0@lo:400:kworker.0 00000100:00100000:3.0:1789708839.785245:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708839.785255:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365625600:0@lo:400:kworker.0 00000100:00100000:1.0:1789708839.785292:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365625728 00000100:00100000:1.0:1789708839.785299:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365625728 00000100:00100000:0.0:1789708839.785365:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365625216 00000100:00100000:0.0:1789708839.785369:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365625216 00000100:00100000:0.0:1789708839.785389:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789708839.785400:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3618:x1876645365624960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708839.785457:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708839.785479:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3618:x1876645365624960:12345-0@lo:400:kworker.0 Request processed in 80us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708839.785487:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789708839.785510:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365625600 00000100:00100000:0.0:1789708839.785515:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789708839.785524:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365625216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708839.785560:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876645365625216:12345-0@lo:400:kworker.0 Request processed in 37us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708839.785565:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789708839.785585:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365624832:0@lo:400:kworker.0 00000100:00100000:0.0:1789708839.785611:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708839.785633:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365625344:0@lo:400:kworker.0 00000100:00100000:0.0:1789708839.785656:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708839.785674:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365625856:0@lo:400:kworker.0 00000100:00100000:0.0:1789708839.785695:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708839.785734:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365625600 00000100:00100000:2.0:1789708839.785793:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876645365624960:0@lo:400:kworker.0 00000100:00100000:2.0:1789708839.785800:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365625472:0@lo:400:kworker.0 00000100:00100000:2.0:1789708839.785836:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708839.785873:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365625344 00000100:00100000:2.0:1789708839.785878:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365625344 00000100:00100000:2.0:1789708839.785895:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365625856 00000100:00100000:2.0:1789708839.785898:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365625856 00000100:00100000:1.0:1789708839.788962:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365625472 00000100:00100000:1.0:1789708839.788975:0:24389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365625472 00000100:00100000:1.0:1789708839.789003:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789708839.789013:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365625344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708839.789125:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876645365625344:12345-0@lo:400:kworker.0 Request processed in 112us (3468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708839.789133:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789708839.789159:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789708839.789166:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed09ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365625728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708839.789196:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed09ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876645365625728:12345-0@lo:400:kworker.0 Request processed in 31us (4062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708839.789202:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789708839.789226:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789708839.789232:0:24389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365625472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708839.789284:0:24389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876645365625472:12345-0@lo:400:kworker.0 Request processed in 52us (3447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708839.789291:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789708839.789338:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365624832 00000100:00100000:1.0:1789708839.789343:0:22863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365624832 00000100:00100000:1.0:1789708839.789379:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789708839.789387:0:22863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365624832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708839.790944:0:22863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365624832:12345-0@lo:400:kworker.0 Request processed in 1552us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708839.790957:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789708839.791032:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365624832:0@lo:400:kworker.0 00000100:00100000:1.0:1789708839.791050:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876645365625344:0@lo:400:kworker.0 00000100:00100000:1.0:1789708839.791127:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876645365625472:0@lo:400:kworker.0 00000100:00100000:1.0:1789708839.791167:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876645365625216:0@lo:400:kworker.0 00000100:00100000:1.0:1789708839.791179:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876645365625728:0@lo:400:kworker.0 00000100:00100000:3.0:1789708839.793570:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789708839.793592:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365625600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708839.793724:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876645365625600:12345-0@lo:400:kworker.0 Request processed in 140us (8269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708839.793731:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789708839.794911:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789708839.794922:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789708839.794926:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789708839.795945:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee363cf480 x1876645365625600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708839.795964:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee363cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876645365625600:0@lo:400:kworker.0 00000100:00100000:2.0:1789708839.798037:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789708839.798054:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365625856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708839.798940:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876645365625856:12345-0@lo:400:kworker.0 Request processed in 890us (13241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708839.798950:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1789708839.801104:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bee086f9500 x1876645365625856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708839.801123:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876645365625856:0@lo:400:kworker.0 00000040:00080000:1.0:1789708839.974514:0:22893:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789708839.974524:0:22893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708839.974556:0:22893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789708839.974573:0:22893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:1.0:1789708840.488991:0:23614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789708840.678469:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708840.783689:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789708840.783832:0:24371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357202176 00000100:00100000:1.0:1789708840.783843:0:24371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357202176 00002000:00100000:1.0:1789708840.783935:0:24371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9bee086f9f80 x1876645357202176/t0(0) o4->f0477c79-9289-4814-b031-7f11416b686f@192.168.201.52@tcp:226/0 lens 504/0 e 0 to 0 dl 1789708851 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789708840.783970:0:24371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086f9f80 with x1876645357202176 ext(0->8) 00002000:00010000:1.0:1789708840.783976:0:24371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee086f9f80 00000100:00100000:1.0:1789708840.784010:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789708840.784023:0:24371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f0477c79-9289-4814-b031-7f11416b686f+8:2398:x1876645357202176:12345-192.168.201.52@tcp:4:bash.0 00000100:00100000:3.0:1789708840.785044:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00080000:0.0:1789708840.788818:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708840.794083:0:24365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357202304 00000100:00100000:1.0:1789708840.794101:0:24365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357202304 00000100:00100000:1.0:1789708840.794177:0:24365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:1.0:1789708840.794187:0:24365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0477c79-9289-4814-b031-7f11416b686f+11:2397:x1876645357202304:12345-192.168.201.52@tcp:16:kworker.0 00000100:00100000:2.0:1789708840.794881:0:24371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f0477c79-9289-4814-b031-7f11416b686f+11:2398:x1876645357202176:12345-192.168.201.52@tcp:4:bash.0 Request processed in 10857us (11199us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789708840.794897:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00002000:00100000:2.0:1789708840.794909:0:24371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9bee086f9f80 x1876645357202176/t12884901895(0) o4->f0477c79-9289-4814-b031-7f11416b686f@192.168.201.52@tcp:226/0 lens 504/448 e 0 to 0 dl 1789708851 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789708840.794919:0:24371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bee086f9f80 with x1876645357202176 ext(0->8) 00002000:00010000:2.0:1789708840.794924:0:24371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bee086f9f80 00000001:00080000:1.0:1789708840.799660:0:24362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1789708840.799689:0:24362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000100:00100000:0.0:1789708840.799960:0:24365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0477c79-9289-4814-b031-7f11416b686f+6:2397:x1876645357202304:12345-192.168.201.52@tcp:16:kworker.0 Request processed in 5764us (14909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708840.799975:0:24365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:3.0:1789708843.008426:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708843.008705:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708843.008727:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708843.008746:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708843.008764:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708843.008779:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708843.008794:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708843.008810:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708843.008843:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789708843.008863:0:22859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357202688 00000100:00100000:3.0:1789708843.008872:0:22859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357202688 00000100:00100000:2.0:1789708843.008967:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357202816 00000100:00100000:2.0:1789708843.008972:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357202816 00000100:00100000:2.0:1789708843.009007:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357202944 00000100:00100000:2.0:1789708843.009010:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357202944 00000100:00100000:2.0:1789708843.009023:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357203328 00000100:00100000:2.0:1789708843.009026:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357203328 00000100:00100000:2.0:1789708843.009038:0:25061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357203456 00000100:00100000:2.0:1789708843.009040:0:25061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357203456 00000100:00100000:2.0:1789708843.009057:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708843.009066:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0477c79-9289-4814-b031-7f11416b686f+6:2395:x1876645357202816:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708843.009138:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0477c79-9289-4814-b031-7f11416b686f+6:2395:x1876645357202816:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 71us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708843.009170:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708843.009190:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789708843.009197:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0477c79-9289-4814-b031-7f11416b686f+5:2394:x1876645357202944:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:2.0:1789708843.009216:0:25061:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ef2f 00000100:00080000:2.0:1789708843.009230:0:25061:0:(import.c:65:import_set_state_nolock()) ffff9bed05556000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789708843.009290:0:25061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901890 00000100:00100000:2.0:1789708843.009403:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0477c79-9289-4814-b031-7f11416b686f+2:2394:x1876645357202944:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 206us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708843.009410:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789708843.009422:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708843.009429:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2394:x1876645357203328:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:2.0:1789708843.009439:0:25061:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ef6e 00000100:00080000:2.0:1789708843.009445:0:25061:0:(import.c:65:import_set_state_nolock()) ffff9bee3ef91000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789708843.009467:0:25061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901895 00000100:00100000:2.0:1789708843.009537:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+2:2394:x1876645357203328:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 108us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708843.009544:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789708843.009556:0:25061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1789708843.009561:0:25061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee3e92b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2394:x1876645357203456:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:2.0:1789708843.009573:0:25061:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf45f43947e47ef67 00000100:00080000:2.0:1789708843.009577:0:25061:0:(import.c:65:import_set_state_nolock()) ffff9bee3ef92000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789708843.009592:0:25061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901890 00000100:00100000:2.0:1789708843.009639:0:25061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee3e92b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a81b64b8-af70-4a00-9ea8-af55bda03a1b+2:2394:x1876645357203456:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 78us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708843.009654:0:25061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1789708843.009675:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357202560 00000100:00100000:2.0:1789708843.009678:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357202560 00000100:00100000:2.0:1789708843.009698:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357203072 00000100:00100000:2.0:1789708843.009700:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357203072 00000100:00100000:2.0:1789708843.009711:0:22858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357203200 00000100:00100000:2.0:1789708843.009713:0:22858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357203200 00000100:00100000:2.0:1789708843.009725:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:2.0:1789708843.009731:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+25:2395:x1876645357202560:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708843.009760:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0477c79-9289-4814-b031-7f11416b686f+25:2395:x1876645357202560:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 29us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708843.009766:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:2.0:1789708843.009777:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:2.0:1789708843.009782:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2396:x1876645357203072:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708843.009803:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+6:2396:x1876645357203072:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 20us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708843.009809:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:2.0:1789708843.009819:0:22858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:2.0:1789708843.009824:0:22858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357203200:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708843.009842:0:22858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a81b64b8-af70-4a00-9ea8-af55bda03a1b+5:2396:x1876645357203200:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 19us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708843.009847:0:22858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:2.0:1789708843.009862:0:22852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645357202432 00000100:00100000:2.0:1789708843.009865:0:22852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645357202432 00000100:00100000:2.0:1789708843.009885:0:22852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:2.0:1789708843.009897:0:22852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bed0a3a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+13:2395:x1876645357202432:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789708843.009919:0:22852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bed0a3a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e05fc1a0-5078-439b-8c88-b0181334973b+13:2395:x1876645357202432:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708843.009924:0:22852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 174 00010000:00010000:2.0:1789708843.010064:0:22846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708843.010071:0:25066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708843.010497:0:22845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708843.010512:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789708843.010516:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789708843.010518:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789708843.010521:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789708843.010557:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708843.010572:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365625984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708843.010616:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708843.011038:0:24369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365625984 00000100:00100000:1.0:1789708843.011044:0:24369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365625984 00000100:00100000:1.0:1789708843.011086:0:24369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789708843.011093:0:24369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365625984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789708843.011115:0:24369:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789708843.011167:0:24369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876645365625984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708843.011173:0:24369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789708843.011254:0:22853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708843.011298:0:3617:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1789708843.011304:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bee18000000, transno 12884901892 00000004:00080000:1.0:1789708843.011314:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1789708843.011345:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876645365625984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708843.011541:0:22859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:3.0:1789708843.011550:0:22859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee363cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+5:2395:x1876645357202688:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789708843.011587:0:22859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee363cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0477c79-9289-4814-b031-7f11416b686f+5:2395:x1876645357202688:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 40us (2883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708843.011593:0:22859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:0.0:1789708843.012040:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bee086f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365626112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789708843.012078:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708843.012122:0:25134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645365626112 00000100:00100000:0.0:1789708843.012127:0:25134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645365626112 00000100:00100000:0.0:1789708843.012168:0:25134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789708843.012175:0:25134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bee086f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365626112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789708843.012196:0:25134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789708843.012230:0:25134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bee086f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876645365626112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708843.012236:0:25134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789708843.012287:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bee086f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876645365626112:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1789708843.013831:0:22837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901930 is committed 00000020:00080000:3.0:1789708843.013855:0:22837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bee3e872180 refcount 2 committed 0 result 0 batchid 8589934676 00000020:00080000:3.0:1789708843.013860:0:22837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee3eddad00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bee3e872780 00000020:00080000:3.0:1789708843.013870:0:22837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bee3eddaa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bee2e237400 00000020:00080000:0.0:1789708843.013932:0:22897:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934676 committed batchid 4294967514 00000020:00080000:0.0:1789708843.013982:0:22897:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967514 00010000:00010000:1.0:1789708843.014449:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708843.014467:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708843.014476:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708843.014481:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bee30492800 already unused, calling callback (ffffffffc1a211b0) 00010000:00010000:1.0:1789708843.014486:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708843.014494:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708843.014510:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bee18087d00) 00010000:00010000:1.0:1789708843.014513:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708843.014517:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708843.014524:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bee30492800/0xf45f43947e47f270 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22859 initiator: MDT0 lru_score: 0 lru_type: 0 Debug log: 52725 lines, 52725 kept, 0 dropped, 0 bad.